Nov 18 18:24:01 user nova-compute[74692]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74692) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 18 18:24:01 user nova-compute[74692]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74692) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 18 18:24:01 user nova-compute[74692]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74692) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 18 18:24:01 user nova-compute[74692]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 18 18:24:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:24:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:24:02 user nova-compute[74692]: INFO nova.virt.driver [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 18 18:24:02 user nova-compute[74692]: INFO nova.compute.provider_config [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] Acquiring lock "singleton_lock" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] Acquired lock "singleton_lock" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] Releasing lock "singleton_lock" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] Full set of CONF: {{(pid=74692) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ******************************************************************************** {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] Configuration options gathered from: {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ================================================================================ {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] allow_resize_to_same_host      = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] arq_binding_timeout            = 300 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] backdoor_port                  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] backdoor_socket                = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] block_device_allocate_retries  = 300 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] block_device_allocate_retries_interval = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cert                           = self.pem {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] compute_monitors               = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] config_dir                     = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] config_drive_format            = iso9660 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] config_source                  = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] console_host                   = user {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] control_exchange               = nova {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cpu_allocation_ratio           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] daemon                         = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] debug                          = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] default_access_ip_network_name = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] default_availability_zone      = nova {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] default_ephemeral_format       = ext4 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] default_green_pool_size        = 1000 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] default_schedule_zone          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] disk_allocation_ratio          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] enable_new_services            = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] enabled_ssl_apis               = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] flat_injected                  = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] force_config_drive             = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] force_raw_images               = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] graceful_shutdown_timeout      = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] heal_instance_info_cache_interval = 60 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] host                           = user {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] instance_build_timeout         = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] instance_delete_interval       = 300 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] instance_name_template         = instance-%08x {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] instance_usage_audit           = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] instance_usage_audit_period    = month {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] internal_service_availability_zone = internal {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] key                            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] live_migration_retry_count     = 30 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] log_config_append              = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] log_dir                        = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] log_file                       = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] log_options                    = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] log_rotate_interval            = 1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] log_rotate_interval_type       = days {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] log_rotation_type              = none {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] long_rpc_timeout               = 1800 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] max_concurrent_builds          = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] max_concurrent_live_migrations = 1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] max_concurrent_snapshots       = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] max_local_block_devices        = 3 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] max_logfile_count              = 30 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] max_logfile_size_mb            = 200 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] maximum_instance_delete_attempts = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] metadata_listen                = 0.0.0.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] metadata_listen_port           = 8775 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] metadata_workers               = 3 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] migrate_max_retries            = -1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] mkisofs_cmd                    = genisoimage {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] my_ip                          = 10.0.0.210 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] network_allocate_retries       = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] osapi_compute_listen_port      = 8774 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] osapi_compute_unique_server_name_scope =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] osapi_compute_workers          = 3 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] password_length                = 12 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] periodic_enable                = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] periodic_fuzzy_delay           = 60 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] pointer_model                  = ps2mouse {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] preallocate_images             = none {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] publish_errors                 = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] pybasedir                      = /opt/stack/nova {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ram_allocation_ratio           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] rate_limit_burst               = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] rate_limit_except_level        = CRITICAL {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] rate_limit_interval            = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] reboot_timeout                 = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] reclaim_instance_interval      = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] record                         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] reimage_timeout_per_gb         = 60 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] report_interval                = 120 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] rescue_timeout                 = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] reserved_host_cpus             = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] reserved_host_disk_mb          = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] reserved_host_memory_mb        = 512 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] reserved_huge_pages            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] resize_confirm_window          = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] resize_fs_using_block_device   = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] resume_guests_state_on_host_boot = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] rpc_response_timeout           = 60 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] run_external_periodic_tasks    = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] running_deleted_instance_action = reap {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] running_deleted_instance_timeout = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] scheduler_instance_sync_interval = 120 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] service_down_time              = 720 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] servicegroup_driver            = db {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] shelved_offload_time           = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] shelved_poll_interval          = 3600 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] shutdown_timeout               = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] source_is_ipv6                 = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ssl_only                       = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] state_path                     = /opt/stack/data/nova {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] sync_power_state_interval      = 600 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] sync_power_state_pool_size     = 1000 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] syslog_log_facility            = LOG_USER {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] tempdir                        = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] timeout_nbd                    = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] transport_url                  = **** {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] update_resources_interval      = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] use_cow_images                 = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] use_eventlog                   = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] use_journal                    = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] use_json                       = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] use_rootwrap_daemon            = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] use_stderr                     = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] use_syslog                     = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vcpu_pin_set                   = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vif_plugging_is_fatal          = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vif_plugging_timeout           = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] virt_mkfs                      = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] volume_usage_poll_interval     = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] watch_log_file                 = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] web                            = /usr/share/spice-html5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_concurrency.disable_process_locking = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.auth_strategy              = keystone {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.compute_link_prefix        = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.dhcp_domain                = novalocal {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.enable_instance_password   = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.glance_link_prefix         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.instance_list_per_project_cells = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.list_records_by_skipping_down_cells = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.local_metadata_per_cell    = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.max_limit                  = 1000 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.metadata_cache_expiration  = 15 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.neutron_default_tenant_id  = default {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.use_forwarded_for          = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.use_neutron_default_nets   = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.vendordata_dynamic_targets = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.vendordata_jsonfile_path   = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.backend_argument         = **** {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.config_prefix            = cache.oslo {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.dead_timeout             = 60.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.debug_cache_backend      = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.enable_retry_client      = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.enable_socket_keepalive  = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.enabled                  = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.expiration_time          = 600 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.hashclient_retry_attempts = 2 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.memcache_dead_retry      = 300 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.memcache_password        =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.memcache_sasl_enabled    = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.memcache_username        =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.proxies                  = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.retry_attempts           = 2 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.retry_delay              = 0.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.socket_keepalive_count   = 1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.socket_keepalive_idle    = 1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.socket_keepalive_interval = 1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.tls_allowed_ciphers      = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.tls_cafile               = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.tls_certfile             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.tls_enabled              = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cache.tls_keyfile              = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cinder.auth_section            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cinder.auth_type               = password {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cinder.cafile                  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cinder.certfile                = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cinder.collect_timing          = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cinder.cross_az_attach         = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cinder.debug                   = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cinder.endpoint_template       = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cinder.http_retries            = 3 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cinder.insecure                = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cinder.keyfile                 = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cinder.os_region_name          = RegionOne {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cinder.split_loggers           = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cinder.timeout                 = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] compute.cpu_dedicated_set      = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] compute.cpu_shared_set         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] compute.image_type_exclude_list = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] compute.resource_provider_association_refresh = 300 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] compute.shutdown_retry_interval = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] conductor.workers              = 3 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] console.allowed_origins        = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] console.ssl_ciphers            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] console.ssl_minimum_version    = default {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] consoleauth.token_ttl          = 600 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.cafile                  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.certfile                = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.collect_timing          = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.connect_retries         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.connect_retry_delay     = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.endpoint_override       = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.insecure                = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.keyfile                 = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.max_version             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.min_version             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.region_name             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.service_name            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.service_type            = accelerator {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.split_loggers           = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.status_code_retries     = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.status_code_retry_delay = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.timeout                 = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] cyborg.version                 = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.backend               = sqlalchemy {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.connection            = **** {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.connection_debug      = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.connection_parameters =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.connection_recycle_time = 3600 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.connection_trace      = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.db_inc_retry_interval = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.db_max_retries        = 20 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.db_max_retry_interval = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.db_retry_interval     = 1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.max_overflow          = 50 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.max_pool_size         = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.max_retries           = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.mysql_wsrep_sync_wait = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.pool_timeout          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.retry_interval        = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.slave_connection      = **** {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] database.sqlite_synchronous    = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.backend           = sqlalchemy {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.connection        = **** {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.connection_debug  = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.connection_parameters =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.connection_recycle_time = 3600 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.connection_trace  = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.db_inc_retry_interval = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.db_max_retries    = 20 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.db_max_retry_interval = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.db_retry_interval = 1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.max_overflow      = 50 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.max_pool_size     = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.max_retries       = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.pool_timeout      = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.retry_interval    = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.slave_connection  = **** {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] api_database.sqlite_synchronous = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] devices.enabled_mdev_types     = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ephemeral_storage_encryption.enabled = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.api_servers             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.cafile                  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.certfile                = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.collect_timing          = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.connect_retries         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.connect_retry_delay     = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.debug                   = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.default_trusted_certificate_ids = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.enable_certificate_validation = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.enable_rbd_download     = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.endpoint_override       = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.insecure                = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.keyfile                 = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.max_version             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.min_version             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.num_retries             = 3 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.rbd_ceph_conf           =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.rbd_connect_timeout     = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.rbd_pool                =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.rbd_user                =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.region_name             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.service_name            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.service_type            = image {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.split_loggers           = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.status_code_retries     = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.status_code_retry_delay = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.timeout                 = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.verify_glance_signatures = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] glance.version                 = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] guestfs.debug                  = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.config_drive_cdrom      = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.config_drive_inject_password = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.enable_remotefx         = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.instances_path_share    =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.limit_cpu_features      = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.use_multipath_io        = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.vswitch_name            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] mks.enabled                    = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] image_cache.manager_interval   = 2400 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] image_cache.precache_concurrency = 1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] image_cache.remove_unused_base_images = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] image_cache.subdirectory_name  = _base {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.api_max_retries         = 60 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.api_retry_interval      = 2 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.auth_section            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.auth_type               = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.cafile                  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.certfile                = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.collect_timing          = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.conductor_group         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.connect_retries         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.connect_retry_delay     = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.endpoint_override       = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.insecure                = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.keyfile                 = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.max_version             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.min_version             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.peer_list               = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.region_name             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.serial_console_state_timeout = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.service_name            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.service_type            = baremetal {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.split_loggers           = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.status_code_retries     = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.status_code_retry_delay = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.timeout                 = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ironic.version                 = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] key_manager.fixed_key          = **** {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.barbican_api_version  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.barbican_endpoint     = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.barbican_endpoint_type = public {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.barbican_region_name  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.cafile                = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.certfile              = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.collect_timing        = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.insecure              = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.keyfile               = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.number_of_retries     = 60 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.retry_delay           = 1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.send_service_user_token = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.split_loggers         = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.timeout               = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.verify_ssl            = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican.verify_ssl_path       = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican_service_user.auth_section = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican_service_user.auth_type = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican_service_user.cafile   = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican_service_user.certfile = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican_service_user.collect_timing = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican_service_user.insecure = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican_service_user.keyfile  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican_service_user.split_loggers = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] barbican_service_user.timeout  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.approle_role_id          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.approle_secret_id        = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.cafile                   = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.certfile                 = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.collect_timing           = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.insecure                 = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.keyfile                  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.kv_mountpoint            = secret {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.kv_path                  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.kv_version               = 2 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.namespace                = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.root_token_id            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.split_loggers            = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.ssl_ca_crt_file          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.timeout                  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.use_ssl                  = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.auth_section          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.auth_type             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.cafile                = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.certfile              = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.collect_timing        = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.connect_retries       = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.connect_retry_delay   = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.endpoint_override     = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.insecure              = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.keyfile               = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.max_version           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.min_version           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.region_name           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.service_name          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.service_type          = identity {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.split_loggers         = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.status_code_retries   = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.status_code_retry_delay = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.timeout               = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] keystone.version               = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.connection_uri         =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.cpu_mode               = custom {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: WARNING oslo_config.cfg [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.cpu_power_governor_high = performance {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.cpu_power_management   = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.device_detach_attempts = 8 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.device_detach_timeout  = 20 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.disk_cachemodes        = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.disk_prefix            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.enabled_perf_events    = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.file_backed_memory     = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.gid_maps               = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.hw_disk_discard        = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.hw_machine_type        = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.images_rbd_pool        = rbd {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.images_type            = default {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.images_volume_group    = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.inject_key             = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.inject_partition       = -2 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.inject_password        = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.iscsi_iface            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.iser_use_multipath     = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.live_migration_downtime = 500 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.live_migration_inbound_addr = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.live_migration_scheme  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.live_migration_timeout_action = abort {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.live_migration_tunnelled = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: WARNING oslo_config.cfg [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 18 18:24:02 user nova-compute[74692]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 18 18:24:02 user nova-compute[74692]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 18 18:24:02 user nova-compute[74692]: and ``live_migration_inbound_addr`` respectively.
Nov 18 18:24:02 user nova-compute[74692]: ).  Its value may be silently ignored in the future.
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.live_migration_with_native_tls = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.max_queues             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.nfs_mount_options      = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.num_pcie_ports         = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.pmem_namespaces        = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.quobyte_client_cfg     = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.rbd_secret_uuid        = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.rbd_user               = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.rescue_image_id        = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.rescue_kernel_id       = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.rx_queue_size          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.smbfs_mount_options    =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.snapshot_compression   = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.snapshot_image_format  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.sparse_logical_volumes = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.swtpm_enabled          = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.swtpm_group            = tss {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.swtpm_user             = tss {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.sysinfo_serial         = unique {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.tb_cache_size          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.tx_queue_size          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.uid_maps               = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.use_virtio_for_bridges = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.virt_type              = kvm {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.volume_clear           = zero {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.volume_clear_size      = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.volume_use_multipath   = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.vzstorage_cache_path   = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.auth_section           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.auth_type              = password {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.cafile                 = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.certfile               = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.collect_timing         = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.connect_retries        = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.connect_retry_delay    = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.default_floating_pool  = public {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.endpoint_override      = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.extension_sync_interval = 600 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.http_retries           = 3 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.insecure               = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.keyfile                = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.max_version            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.min_version            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.ovs_bridge             = br-int {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.physnets               = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.region_name            = RegionOne {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.service_metadata_proxy = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.service_name           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.service_type           = network {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.split_loggers          = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.status_code_retries    = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.status_code_retry_delay = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.timeout                = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] neutron.version                = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] notifications.bdms_in_notifications = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] notifications.default_level    = INFO {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] notifications.notification_format = unversioned {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] notifications.notify_on_state_change = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] pci.alias                      = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] pci.device_spec                = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] pci.report_in_placement        = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.auth_section         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.auth_type            = password {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.cafile               = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.certfile             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.collect_timing       = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.connect_retries      = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.connect_retry_delay  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.default_domain_id    = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.default_domain_name  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.domain_id            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.domain_name          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.endpoint_override    = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.insecure             = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.keyfile              = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.max_version          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.min_version          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.password             = **** {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.project_domain_id    = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.project_domain_name  = Default {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.project_id           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.project_name         = service {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.region_name          = RegionOne {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.service_name         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.service_type         = placement {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.split_loggers        = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.status_code_retries  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.status_code_retry_delay = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.system_scope         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.timeout              = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.trust_id             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.user_domain_id       = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.user_domain_name     = Default {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.user_id              = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.username             = placement {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] placement.version              = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] quota.cores                    = 20 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] quota.count_usage_from_placement = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] quota.injected_file_content_bytes = 10240 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] quota.injected_file_path_length = 255 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] quota.injected_files           = 5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] quota.instances                = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] quota.key_pairs                = 100 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] quota.metadata_items           = 128 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] quota.ram                      = 51200 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] quota.recheck_quota            = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] quota.server_group_members     = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] quota.server_groups            = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] rdp.enabled                    = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] scheduler.image_metadata_prefilter = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] scheduler.max_attempts         = 3 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] scheduler.max_placement_results = 1000 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] scheduler.workers              = 3 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.host_subset_size = 1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.isolated_hosts = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.isolated_images = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.pci_in_placement = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.track_instance_changes = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] metrics.required               = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] metrics.weight_multiplier      = 1.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] metrics.weight_setting         = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] serial_console.enabled         = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] serial_console.port_range      = 10000:20000 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] serial_console.serialproxy_port = 6083 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] service_user.auth_section      = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] service_user.auth_type         = password {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] service_user.cafile            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] service_user.certfile          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] service_user.collect_timing    = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] service_user.insecure          = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] service_user.keyfile           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] service_user.send_service_user_token = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] service_user.split_loggers     = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] service_user.timeout           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] spice.agent_enabled            = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] spice.enabled                  = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] spice.html5proxy_port          = 6082 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] spice.image_compression        = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] spice.jpeg_compression         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] spice.playback_compression     = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] spice.server_listen            = 127.0.0.1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] spice.streaming_mode           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] spice.zlib_compression         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] upgrade_levels.baseapi         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] upgrade_levels.compute         = auto {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] upgrade_levels.conductor       = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] upgrade_levels.scheduler       = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vendordata_dynamic_auth.cafile = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vendordata_dynamic_auth.certfile = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vendordata_dynamic_auth.insecure = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vendordata_dynamic_auth.timeout = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.api_retry_count         = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.ca_file                 = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.cache_prefix            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.cluster_name            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.connection_pool_size    = 10 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.console_delay_seconds   = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.datastore_regex         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.host_ip                 = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.host_password           = **** {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.host_port               = 443 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.host_username           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.insecure                = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.integration_bridge      = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.maximum_objects         = 100 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.pbm_default_policy      = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.pbm_enabled             = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.pbm_wsdl_location       = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.serial_port_proxy_uri   = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.serial_port_service_uri = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.task_poll_interval      = 0.5 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.use_linked_clone        = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.vnc_keymap              = en-us {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.vnc_port                = 5900 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vmware.vnc_port_total          = 10000 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vnc.auth_schemes               = ['none'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vnc.enabled                    = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vnc.novncproxy_port            = 6080 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vnc.vencrypt_ca_certs          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vnc.vencrypt_client_cert       = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vnc.vencrypt_client_key        = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.disable_rootwrap   = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.enable_numa_live_migration = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.libvirt_disable_apic = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] wsgi.client_socket_timeout     = 900 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] wsgi.default_pool_size         = 1000 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] wsgi.keep_alive                = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] wsgi.max_header_line           = 16384 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] wsgi.ssl_ca_file               = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] wsgi.ssl_cert_file             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] wsgi.ssl_key_file              = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] wsgi.tcp_keepidle              = 600 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] zvm.ca_file                    = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] zvm.cloud_connector_url        = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] zvm.reachable_timeout          = 300 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_policy.enforce_new_defaults = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_policy.enforce_scope      = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_policy.policy_default_rule = default {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] profiler.connection_string     = messaging:// {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] profiler.enabled               = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] profiler.es_doc_type           = notification {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] profiler.es_scroll_size        = 10000 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] profiler.es_scroll_time        = 2m {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] profiler.filter_error_trace    = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] profiler.hmac_keys             = **** {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] profiler.sentinel_service_name = mymaster {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] profiler.socket_timeout        = 0.1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] profiler.trace_requests        = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] profiler.trace_sqlalchemy      = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] profiler_jaeger.process_tags   = {} {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] profiler_jaeger.service_name_prefix = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] profiler_otlp.service_name_prefix = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] remote_debug.host              = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] remote_debug.port              = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_notifications.retry = -1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.auth_section        = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.auth_type           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.cafile              = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.certfile            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.collect_timing      = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.connect_retries     = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.connect_retry_delay = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.endpoint_id         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.endpoint_override   = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.insecure            = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.keyfile             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.max_version         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.min_version         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.region_name         = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.service_name        = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.service_type        = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.split_loggers       = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.status_code_retries = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.status_code_retry_delay = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.timeout             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.valid_interfaces    = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_limit.version             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_reports.file_event_handler = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] oslo_reports.log_dir           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vif_plug_ovs_privileged.group  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] vif_plug_ovs_privileged.user   = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_vif_ovs.isolate_vif         = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] os_brick.lock_path             = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] privsep_osbrick.capabilities   = [21] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] privsep_osbrick.group          = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] privsep_osbrick.helper_command = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] privsep_osbrick.user           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] nova_sys_admin.group           = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] nova_sys_admin.helper_command  = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] nova_sys_admin.user            = None {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG oslo_service.service [None req-8e290c21-8318-4449-8113-5f11b294cde3 None None] ******************************************************************************** {{(pid=74692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 18 18:24:02 user nova-compute[74692]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 18 18:24:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Connecting to libvirt: qemu:///system {{(pid=74692) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f41d5bb63e0> {{(pid=74692) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 18 18:24:02 user nova-compute[74692]: libvirt:  error : internal error: could not initialize domain event timer
Nov 18 18:24:02 user nova-compute[74692]: WARNING nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 18 18:24:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f41d5bb63e0> {{(pid=74692) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Starting native event thread {{(pid=74692) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Starting green dispatch thread {{(pid=74692) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 18 18:24:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Starting connection event dispatch thread {{(pid=74692) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 18 18:24:02 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Connection event '1' reason 'None'
Nov 18 18:24:02 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 18 18:24:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.mount [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Initialising _HostMountState generation 0 {{(pid=74692) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 18 18:24:09 user nova-compute[74692]: INFO nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Libvirt host capabilities <capabilities>
Nov 18 18:24:09 user nova-compute[74692]:   <host>
Nov 18 18:24:09 user nova-compute[74692]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 18 18:24:09 user nova-compute[74692]:     <cpu>
Nov 18 18:24:09 user nova-compute[74692]:       <arch>x86_64</arch>
Nov 18 18:24:09 user nova-compute[74692]:       <model>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <vendor>Intel</vendor>
Nov 18 18:24:09 user nova-compute[74692]:       <microcode version='1070'/>
Nov 18 18:24:09 user nova-compute[74692]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 18 18:24:09 user nova-compute[74692]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature name='ss'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature name='vmx'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature name='pcid'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature name='osxsave'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature name='hypervisor'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature name='arat'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature name='tsc_adjust'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature name='md-clear'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature name='stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature name='arch-capabilities'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature name='ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature name='invtsc'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature name='rsba'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature name='skip-l1dfl-vmentry'/>
Nov 18 18:24:09 user nova-compute[74692]:       <pages unit='KiB' size='4'/>
Nov 18 18:24:09 user nova-compute[74692]:       <pages unit='KiB' size='2048'/>
Nov 18 18:24:09 user nova-compute[74692]:     </cpu>
Nov 18 18:24:09 user nova-compute[74692]:     <power_management>
Nov 18 18:24:09 user nova-compute[74692]:       <suspend_mem/>
Nov 18 18:24:09 user nova-compute[74692]:       <suspend_disk/>
Nov 18 18:24:09 user nova-compute[74692]:       <suspend_hybrid/>
Nov 18 18:24:09 user nova-compute[74692]:     </power_management>
Nov 18 18:24:09 user nova-compute[74692]:     <iommu support='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     <migration_features>
Nov 18 18:24:09 user nova-compute[74692]:       <live/>
Nov 18 18:24:09 user nova-compute[74692]:       <uri_transports>
Nov 18 18:24:09 user nova-compute[74692]:         <uri_transport>tcp</uri_transport>
Nov 18 18:24:09 user nova-compute[74692]:         <uri_transport>rdma</uri_transport>
Nov 18 18:24:09 user nova-compute[74692]:       </uri_transports>
Nov 18 18:24:09 user nova-compute[74692]:     </migration_features>
Nov 18 18:24:09 user nova-compute[74692]:     <topology>
Nov 18 18:24:09 user nova-compute[74692]:       <cells num='2'>
Nov 18 18:24:09 user nova-compute[74692]:         <cell id='0'>
Nov 18 18:24:09 user nova-compute[74692]:           <memory unit='KiB'>8140616</memory>
Nov 18 18:24:09 user nova-compute[74692]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 18 18:24:09 user nova-compute[74692]:           <pages unit='KiB' size='2048'>0</pages>
Nov 18 18:24:09 user nova-compute[74692]:           <distances>
Nov 18 18:24:09 user nova-compute[74692]:             <sibling id='0' value='10'/>
Nov 18 18:24:09 user nova-compute[74692]:             <sibling id='1' value='20'/>
Nov 18 18:24:09 user nova-compute[74692]:           </distances>
Nov 18 18:24:09 user nova-compute[74692]:           <cpus num='6'>
Nov 18 18:24:09 user nova-compute[74692]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 18 18:24:09 user nova-compute[74692]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 18 18:24:09 user nova-compute[74692]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 18 18:24:09 user nova-compute[74692]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 18 18:24:09 user nova-compute[74692]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 18 18:24:09 user nova-compute[74692]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 18 18:24:09 user nova-compute[74692]:           </cpus>
Nov 18 18:24:09 user nova-compute[74692]:         </cell>
Nov 18 18:24:09 user nova-compute[74692]:         <cell id='1'>
Nov 18 18:24:09 user nova-compute[74692]:           <memory unit='KiB'>8255068</memory>
Nov 18 18:24:09 user nova-compute[74692]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 18 18:24:09 user nova-compute[74692]:           <pages unit='KiB' size='2048'>0</pages>
Nov 18 18:24:09 user nova-compute[74692]:           <distances>
Nov 18 18:24:09 user nova-compute[74692]:             <sibling id='0' value='20'/>
Nov 18 18:24:09 user nova-compute[74692]:             <sibling id='1' value='10'/>
Nov 18 18:24:09 user nova-compute[74692]:           </distances>
Nov 18 18:24:09 user nova-compute[74692]:           <cpus num='6'>
Nov 18 18:24:09 user nova-compute[74692]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 18 18:24:09 user nova-compute[74692]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 18 18:24:09 user nova-compute[74692]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 18 18:24:09 user nova-compute[74692]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 18 18:24:09 user nova-compute[74692]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 18 18:24:09 user nova-compute[74692]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 18 18:24:09 user nova-compute[74692]:           </cpus>
Nov 18 18:24:09 user nova-compute[74692]:         </cell>
Nov 18 18:24:09 user nova-compute[74692]:       </cells>
Nov 18 18:24:09 user nova-compute[74692]:     </topology>
Nov 18 18:24:09 user nova-compute[74692]:     <cache>
Nov 18 18:24:09 user nova-compute[74692]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 18 18:24:09 user nova-compute[74692]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 18 18:24:09 user nova-compute[74692]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 18 18:24:09 user nova-compute[74692]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 18 18:24:09 user nova-compute[74692]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 18 18:24:09 user nova-compute[74692]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 18 18:24:09 user nova-compute[74692]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 18 18:24:09 user nova-compute[74692]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 18 18:24:09 user nova-compute[74692]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 18 18:24:09 user nova-compute[74692]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 18 18:24:09 user nova-compute[74692]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 18 18:24:09 user nova-compute[74692]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 18 18:24:09 user nova-compute[74692]:     </cache>
Nov 18 18:24:09 user nova-compute[74692]:     <secmodel>
Nov 18 18:24:09 user nova-compute[74692]:       <model>apparmor</model>
Nov 18 18:24:09 user nova-compute[74692]:       <doi>0</doi>
Nov 18 18:24:09 user nova-compute[74692]:     </secmodel>
Nov 18 18:24:09 user nova-compute[74692]:     <secmodel>
Nov 18 18:24:09 user nova-compute[74692]:       <model>dac</model>
Nov 18 18:24:09 user nova-compute[74692]:       <doi>0</doi>
Nov 18 18:24:09 user nova-compute[74692]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 18 18:24:09 user nova-compute[74692]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 18 18:24:09 user nova-compute[74692]:     </secmodel>
Nov 18 18:24:09 user nova-compute[74692]:   </host>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='alpha'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>64</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>clipper</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='armv6l'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>32</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>integratorcp</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>borzoi</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>spitz</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>nuri</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>musca-b1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>versatileab</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>kzm</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>musca-a</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>smdkc210</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sx1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>z2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>tosa</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>sabrelite</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>realview-eb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>n810</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>n800</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>versatilepb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>terrier</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mainstone</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>midway</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>musicpal</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>microbit</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>cubieboard</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>verdex</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>netduino2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>raspi2b</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>cheetah</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>highbank</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>akita</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>connex</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>collie</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>raspi0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='armv7l'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>32</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>integratorcp</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>borzoi</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>spitz</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>nuri</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>musca-b1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>versatileab</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>kzm</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>musca-a</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>smdkc210</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sx1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>z2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>tosa</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>sabrelite</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>realview-eb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>n810</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>n800</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>versatilepb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>terrier</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mainstone</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>midway</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>musicpal</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>microbit</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>cubieboard</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>verdex</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>netduino2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>raspi2b</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>cheetah</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>highbank</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>akita</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>connex</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>collie</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>raspi0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='aarch64'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>64</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>integratorcp</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>borzoi</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>spitz</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>nuri</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>musca-b1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>versatileab</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>kzm</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>musca-a</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>smdkc210</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sx1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>z2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>tosa</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>sabrelite</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>realview-eb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>n810</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>n800</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>versatilepb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>terrier</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mainstone</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>midway</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>musicpal</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>microbit</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>cubieboard</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>verdex</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>netduino2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>raspi3b</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>raspi2b</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>cheetah</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>highbank</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>akita</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>connex</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>collie</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>raspi0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <acpi default='on' toggle='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='cris'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>32</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='i686'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>32</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>x-remote</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>isapc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>microvm</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='kvm'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <pae/>
Nov 18 18:24:09 user nova-compute[74692]:       <nonpae/>
Nov 18 18:24:09 user nova-compute[74692]:       <acpi default='on' toggle='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:       <apic default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='m68k'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>32</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>an5206</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>q800</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>next-cube</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='microblaze'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>32</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='microblazeel'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>32</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='mips'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>32</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='16'>malta</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mipssim</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='mipsel'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>32</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='16'>malta</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mipssim</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='mips64'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>64</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='16'>malta</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mipssim</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>pica61</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>magnum</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='mips64el'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>64</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='16'>malta</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mipssim</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>pica61</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>magnum</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='16'>boston</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='ppc'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>32</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>g3beige</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mac99</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>ppce500</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>pegasos2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sam460ex</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>bamboo</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>40p</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>ref405ep</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>taihu</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='ppc64'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>64</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2048'>powernv9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>taihu</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2048'>powernv10</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>ppce500</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>40p</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>pegasos2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>bamboo</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>g3beige</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mac99</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sam460ex</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>ref405ep</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2048'>powernv8</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='ppc64le'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>64</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2048'>powernv9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>taihu</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2048'>powernv10</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>ppce500</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>40p</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>pegasos2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>bamboo</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>g3beige</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>mac99</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sam460ex</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>ref405ep</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2048'>powernv8</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='riscv32'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>32</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='8'>spike</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>opentitan</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='5'>sifive_u</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sifive_e</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='8'>virt</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='riscv64'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>64</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='8'>spike</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='5'>sifive_u</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>shakti_c</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sifive_e</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='8'>virt</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='s390x'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>64</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='sh4'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>32</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>shix</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>r2d</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='sh4eb'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>64</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>shix</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>r2d</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='sparc'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>32</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>SS-5</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>SS-20</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>LX</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>SS-4</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>SS-10</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>Voyager</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='sparc64'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>64</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sun4u</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>niagara</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>sun4v</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='x86_64'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>64</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>x-remote</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='1'>isapc</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>microvm</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='kvm'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <acpi default='on' toggle='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:       <apic default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='xtensa'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>32</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>sim</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>kc705</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>ml605</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>virt</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>lx200</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>lx60</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]:   <guest>
Nov 18 18:24:09 user nova-compute[74692]:     <os_type>hvm</os_type>
Nov 18 18:24:09 user nova-compute[74692]:     <arch name='xtensaeb'>
Nov 18 18:24:09 user nova-compute[74692]:       <wordsize>32</wordsize>
Nov 18 18:24:09 user nova-compute[74692]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='4'>sim</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>kc705</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>ml605</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>virt</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>lx200</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>lx60</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 18 18:24:09 user nova-compute[74692]:       <domain type='qemu'/>
Nov 18 18:24:09 user nova-compute[74692]:     </arch>
Nov 18 18:24:09 user nova-compute[74692]:     <features>
Nov 18 18:24:09 user nova-compute[74692]:       <cpuselection/>
Nov 18 18:24:09 user nova-compute[74692]:       <deviceboot/>
Nov 18 18:24:09 user nova-compute[74692]:       <disksnapshot default='on' toggle='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     </features>
Nov 18 18:24:09 user nova-compute[74692]:   </guest>
Nov 18 18:24:09 user nova-compute[74692]: </capabilities>
Nov 18 18:24:09 user nova-compute[74692]: 
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 18 18:24:09 user nova-compute[74692]: <domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:   <path>/usr/bin/qemu-system-i386</path>
Nov 18 18:24:09 user nova-compute[74692]:   <domain>kvm</domain>
Nov 18 18:24:09 user nova-compute[74692]:   <machine>pc-q35-6.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:   <arch>i686</arch>
Nov 18 18:24:09 user nova-compute[74692]:   <vcpu max='288'/>
Nov 18 18:24:09 user nova-compute[74692]:   <iothreads supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:   <os supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='firmware'/>
Nov 18 18:24:09 user nova-compute[74692]:     <loader supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>rom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pflash</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='readonly'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>yes</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='secure'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </loader>
Nov 18 18:24:09 user nova-compute[74692]:   </os>
Nov 18 18:24:09 user nova-compute[74692]:   <cpu>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-passthrough' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='hostPassthroughMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='maximum' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='maximumMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>on</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-model' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <vendor>Intel</vendor>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ss'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='vmx'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='pcid'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='hypervisor'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arat'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='umip'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='md-clear'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibpb'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibrs'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='erms'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='lm'/>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='custom' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>qemu64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>qemu32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>phenom</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>n270</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>kvm64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>kvm32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>coreduo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>core2duo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>athlon</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Westmere-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Westmere</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Snowridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Penryn</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G5</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G4</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G1</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Nehalem-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Nehalem</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Rome</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Milan</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Dhyana</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cooperlake</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Conroe</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>486</model>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:   </cpu>
Nov 18 18:24:09 user nova-compute[74692]:   <memoryBacking supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='sourceType'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>file</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>anonymous</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>memfd</value>
Nov 18 18:24:09 user nova-compute[74692]:     </enum>
Nov 18 18:24:09 user nova-compute[74692]:   </memoryBacking>
Nov 18 18:24:09 user nova-compute[74692]:   <devices>
Nov 18 18:24:09 user nova-compute[74692]:     <disk supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='diskDevice'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>disk</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cdrom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>floppy</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>lun</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='bus'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>fdc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sata</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </disk>
Nov 18 18:24:09 user nova-compute[74692]:     <graphics supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sdl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vnc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>spice</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egl-headless</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </graphics>
Nov 18 18:24:09 user nova-compute[74692]:     <video supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='modelType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cirrus</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vmvga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>qxl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>none</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>bochs</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>ramfb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </video>
Nov 18 18:24:09 user nova-compute[74692]:     <hostdev supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='mode'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>subsystem</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='startupPolicy'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>default</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>mandatory</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>requisite</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>optional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='subsysType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pci</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='capsType'/>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='pciBackend'/>
Nov 18 18:24:09 user nova-compute[74692]:     </hostdev>
Nov 18 18:24:09 user nova-compute[74692]:     <rng supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>random</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egd</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>builtin</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </rng>
Nov 18 18:24:09 user nova-compute[74692]:     <filesystem supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='driverType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>path</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>handle</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtiofs</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </filesystem>
Nov 18 18:24:09 user nova-compute[74692]:     <tpm supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-tis</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-crb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>passthrough</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>emulator</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </tpm>
Nov 18 18:24:09 user nova-compute[74692]:   </devices>
Nov 18 18:24:09 user nova-compute[74692]:   <features>
Nov 18 18:24:09 user nova-compute[74692]:     <gic supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     <vmcoreinfo supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <genid supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backingStoreInput supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backup supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <sev supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:   </features>
Nov 18 18:24:09 user nova-compute[74692]: </domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:  {{(pid=74692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 18 18:24:09 user nova-compute[74692]: <domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:   <path>/usr/bin/qemu-system-i386</path>
Nov 18 18:24:09 user nova-compute[74692]:   <domain>kvm</domain>
Nov 18 18:24:09 user nova-compute[74692]:   <machine>pc-q35-jammy</machine>
Nov 18 18:24:09 user nova-compute[74692]:   <arch>i686</arch>
Nov 18 18:24:09 user nova-compute[74692]:   <vcpu max='288'/>
Nov 18 18:24:09 user nova-compute[74692]:   <iothreads supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:   <os supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='firmware'/>
Nov 18 18:24:09 user nova-compute[74692]:     <loader supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>rom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pflash</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='readonly'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>yes</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='secure'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </loader>
Nov 18 18:24:09 user nova-compute[74692]:   </os>
Nov 18 18:24:09 user nova-compute[74692]:   <cpu>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-passthrough' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='hostPassthroughMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='maximum' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='maximumMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>on</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-model' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <vendor>Intel</vendor>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ss'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='vmx'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='pcid'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='hypervisor'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arat'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='umip'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='md-clear'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibpb'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibrs'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='erms'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='lm'/>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='custom' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>qemu64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>qemu32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>phenom</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>n270</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>kvm64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>kvm32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>coreduo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>core2duo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>athlon</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Westmere-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Westmere</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Snowridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Penryn</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G5</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G4</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G1</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Nehalem-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Nehalem</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Rome</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Milan</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Dhyana</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cooperlake</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Conroe</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>486</model>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:   </cpu>
Nov 18 18:24:09 user nova-compute[74692]:   <memoryBacking supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='sourceType'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>file</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>anonymous</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>memfd</value>
Nov 18 18:24:09 user nova-compute[74692]:     </enum>
Nov 18 18:24:09 user nova-compute[74692]:   </memoryBacking>
Nov 18 18:24:09 user nova-compute[74692]:   <devices>
Nov 18 18:24:09 user nova-compute[74692]:     <disk supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='diskDevice'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>disk</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cdrom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>floppy</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>lun</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='bus'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>fdc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sata</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </disk>
Nov 18 18:24:09 user nova-compute[74692]:     <graphics supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sdl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vnc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>spice</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egl-headless</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </graphics>
Nov 18 18:24:09 user nova-compute[74692]:     <video supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='modelType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cirrus</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vmvga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>qxl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>none</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>bochs</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>ramfb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </video>
Nov 18 18:24:09 user nova-compute[74692]:     <hostdev supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='mode'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>subsystem</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='startupPolicy'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>default</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>mandatory</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>requisite</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>optional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='subsysType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pci</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='capsType'/>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='pciBackend'/>
Nov 18 18:24:09 user nova-compute[74692]:     </hostdev>
Nov 18 18:24:09 user nova-compute[74692]:     <rng supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>random</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egd</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>builtin</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </rng>
Nov 18 18:24:09 user nova-compute[74692]:     <filesystem supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='driverType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>path</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>handle</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtiofs</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </filesystem>
Nov 18 18:24:09 user nova-compute[74692]:     <tpm supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-tis</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-crb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>passthrough</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>emulator</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </tpm>
Nov 18 18:24:09 user nova-compute[74692]:   </devices>
Nov 18 18:24:09 user nova-compute[74692]:   <features>
Nov 18 18:24:09 user nova-compute[74692]:     <gic supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     <vmcoreinfo supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <genid supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backingStoreInput supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backup supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <sev supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:   </features>
Nov 18 18:24:09 user nova-compute[74692]: </domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:  {{(pid=74692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 18 18:24:09 user nova-compute[74692]: <domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:   <path>/usr/bin/qemu-system-i386</path>
Nov 18 18:24:09 user nova-compute[74692]:   <domain>kvm</domain>
Nov 18 18:24:09 user nova-compute[74692]:   <machine>pc-i440fx-6.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:   <arch>i686</arch>
Nov 18 18:24:09 user nova-compute[74692]:   <vcpu max='255'/>
Nov 18 18:24:09 user nova-compute[74692]:   <iothreads supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:   <os supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='firmware'/>
Nov 18 18:24:09 user nova-compute[74692]:     <loader supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>rom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pflash</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='readonly'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>yes</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='secure'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </loader>
Nov 18 18:24:09 user nova-compute[74692]:   </os>
Nov 18 18:24:09 user nova-compute[74692]:   <cpu>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-passthrough' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='hostPassthroughMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='maximum' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='maximumMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>on</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-model' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <vendor>Intel</vendor>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ss'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='vmx'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='pcid'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='hypervisor'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arat'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='umip'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='md-clear'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibpb'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibrs'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='erms'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='lm'/>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='custom' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>qemu64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>qemu32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>phenom</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>n270</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>kvm64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>kvm32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>coreduo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>core2duo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>athlon</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Westmere-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Westmere</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Snowridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Penryn</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G5</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G4</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G1</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Nehalem-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Nehalem</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Rome</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Milan</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Dhyana</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cooperlake</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Conroe</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>486</model>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:   </cpu>
Nov 18 18:24:09 user nova-compute[74692]:   <memoryBacking supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='sourceType'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>file</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>anonymous</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>memfd</value>
Nov 18 18:24:09 user nova-compute[74692]:     </enum>
Nov 18 18:24:09 user nova-compute[74692]:   </memoryBacking>
Nov 18 18:24:09 user nova-compute[74692]:   <devices>
Nov 18 18:24:09 user nova-compute[74692]:     <disk supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='diskDevice'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>disk</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cdrom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>floppy</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>lun</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='bus'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>ide</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>fdc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sata</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </disk>
Nov 18 18:24:09 user nova-compute[74692]:     <graphics supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sdl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vnc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>spice</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egl-headless</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </graphics>
Nov 18 18:24:09 user nova-compute[74692]:     <video supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='modelType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cirrus</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vmvga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>qxl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>none</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>bochs</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>ramfb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </video>
Nov 18 18:24:09 user nova-compute[74692]:     <hostdev supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='mode'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>subsystem</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='startupPolicy'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>default</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>mandatory</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>requisite</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>optional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='subsysType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pci</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='capsType'/>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='pciBackend'/>
Nov 18 18:24:09 user nova-compute[74692]:     </hostdev>
Nov 18 18:24:09 user nova-compute[74692]:     <rng supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>random</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egd</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>builtin</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </rng>
Nov 18 18:24:09 user nova-compute[74692]:     <filesystem supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='driverType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>path</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>handle</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtiofs</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </filesystem>
Nov 18 18:24:09 user nova-compute[74692]:     <tpm supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-tis</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-crb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>passthrough</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>emulator</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </tpm>
Nov 18 18:24:09 user nova-compute[74692]:   </devices>
Nov 18 18:24:09 user nova-compute[74692]:   <features>
Nov 18 18:24:09 user nova-compute[74692]:     <gic supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     <vmcoreinfo supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <genid supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backingStoreInput supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backup supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <sev supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:   </features>
Nov 18 18:24:09 user nova-compute[74692]: </domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:  {{(pid=74692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 18 18:24:09 user nova-compute[74692]: <domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:   <path>/usr/bin/qemu-system-i386</path>
Nov 18 18:24:09 user nova-compute[74692]:   <domain>kvm</domain>
Nov 18 18:24:09 user nova-compute[74692]:   <machine>pc-i440fx-jammy</machine>
Nov 18 18:24:09 user nova-compute[74692]:   <arch>i686</arch>
Nov 18 18:24:09 user nova-compute[74692]:   <vcpu max='255'/>
Nov 18 18:24:09 user nova-compute[74692]:   <iothreads supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:   <os supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='firmware'/>
Nov 18 18:24:09 user nova-compute[74692]:     <loader supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>rom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pflash</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='readonly'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>yes</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='secure'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </loader>
Nov 18 18:24:09 user nova-compute[74692]:   </os>
Nov 18 18:24:09 user nova-compute[74692]:   <cpu>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-passthrough' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='hostPassthroughMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='maximum' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='maximumMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>on</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-model' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <vendor>Intel</vendor>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ss'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='vmx'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='pcid'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='hypervisor'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arat'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='umip'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='md-clear'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibpb'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibrs'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='erms'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='lm'/>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='custom' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>qemu64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>qemu32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>phenom</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>n270</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>kvm64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>kvm32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>coreduo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>core2duo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>athlon</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Westmere-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Westmere</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Snowridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Penryn</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G5</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G4</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G1</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Nehalem-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Nehalem</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Rome</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Milan</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Dhyana</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cooperlake</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Conroe</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>486</model>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:   </cpu>
Nov 18 18:24:09 user nova-compute[74692]:   <memoryBacking supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='sourceType'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>file</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>anonymous</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>memfd</value>
Nov 18 18:24:09 user nova-compute[74692]:     </enum>
Nov 18 18:24:09 user nova-compute[74692]:   </memoryBacking>
Nov 18 18:24:09 user nova-compute[74692]:   <devices>
Nov 18 18:24:09 user nova-compute[74692]:     <disk supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='diskDevice'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>disk</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cdrom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>floppy</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>lun</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='bus'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>ide</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>fdc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sata</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </disk>
Nov 18 18:24:09 user nova-compute[74692]:     <graphics supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sdl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vnc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>spice</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egl-headless</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </graphics>
Nov 18 18:24:09 user nova-compute[74692]:     <video supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='modelType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cirrus</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vmvga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>qxl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>none</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>bochs</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>ramfb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </video>
Nov 18 18:24:09 user nova-compute[74692]:     <hostdev supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='mode'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>subsystem</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='startupPolicy'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>default</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>mandatory</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>requisite</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>optional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='subsysType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pci</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='capsType'/>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='pciBackend'/>
Nov 18 18:24:09 user nova-compute[74692]:     </hostdev>
Nov 18 18:24:09 user nova-compute[74692]:     <rng supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>random</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egd</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>builtin</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </rng>
Nov 18 18:24:09 user nova-compute[74692]:     <filesystem supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='driverType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>path</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>handle</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtiofs</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </filesystem>
Nov 18 18:24:09 user nova-compute[74692]:     <tpm supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-tis</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-crb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>passthrough</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>emulator</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </tpm>
Nov 18 18:24:09 user nova-compute[74692]:   </devices>
Nov 18 18:24:09 user nova-compute[74692]:   <features>
Nov 18 18:24:09 user nova-compute[74692]:     <gic supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     <vmcoreinfo supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <genid supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backingStoreInput supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backup supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <sev supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:   </features>
Nov 18 18:24:09 user nova-compute[74692]: </domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:  {{(pid=74692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 18 18:24:09 user nova-compute[74692]: <domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 18 18:24:09 user nova-compute[74692]:   <domain>kvm</domain>
Nov 18 18:24:09 user nova-compute[74692]:   <machine>pc-q35-6.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:   <arch>x86_64</arch>
Nov 18 18:24:09 user nova-compute[74692]:   <vcpu max='288'/>
Nov 18 18:24:09 user nova-compute[74692]:   <iothreads supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:   <os supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='firmware'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>efi</value>
Nov 18 18:24:09 user nova-compute[74692]:     </enum>
Nov 18 18:24:09 user nova-compute[74692]:     <loader supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>rom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pflash</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='readonly'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>yes</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='secure'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>yes</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </loader>
Nov 18 18:24:09 user nova-compute[74692]:   </os>
Nov 18 18:24:09 user nova-compute[74692]:   <cpu>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-passthrough' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='hostPassthroughMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>on</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='maximum' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='maximumMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>on</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-model' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <vendor>Intel</vendor>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ss'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='vmx'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='pcid'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='hypervisor'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arat'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='umip'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='md-clear'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='invtsc'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibpb'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibrs'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='rsba'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='pschange-mc-no'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='erms'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='custom' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>qemu64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>qemu32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>phenom</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>n270</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>kvm64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>kvm32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>coreduo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>core2duo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>athlon</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Westmere-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Westmere</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Snowridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Penryn</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G5</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G4</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Opteron_G1</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Nehalem</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Rome</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Milan</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Dhyana</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cooperlake</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Conroe</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>486</model>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:   </cpu>
Nov 18 18:24:09 user nova-compute[74692]:   <memoryBacking supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='sourceType'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>file</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>anonymous</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>memfd</value>
Nov 18 18:24:09 user nova-compute[74692]:     </enum>
Nov 18 18:24:09 user nova-compute[74692]:   </memoryBacking>
Nov 18 18:24:09 user nova-compute[74692]:   <devices>
Nov 18 18:24:09 user nova-compute[74692]:     <disk supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='diskDevice'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>disk</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cdrom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>floppy</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>lun</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='bus'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>fdc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sata</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </disk>
Nov 18 18:24:09 user nova-compute[74692]:     <graphics supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sdl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vnc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>spice</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egl-headless</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </graphics>
Nov 18 18:24:09 user nova-compute[74692]:     <video supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='modelType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cirrus</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vmvga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>qxl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>none</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>bochs</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>ramfb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </video>
Nov 18 18:24:09 user nova-compute[74692]:     <hostdev supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='mode'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>subsystem</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='startupPolicy'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>default</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>mandatory</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>requisite</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>optional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='subsysType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pci</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='capsType'/>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='pciBackend'/>
Nov 18 18:24:09 user nova-compute[74692]:     </hostdev>
Nov 18 18:24:09 user nova-compute[74692]:     <rng supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>random</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egd</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>builtin</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </rng>
Nov 18 18:24:09 user nova-compute[74692]:     <filesystem supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='driverType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>path</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>handle</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtiofs</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </filesystem>
Nov 18 18:24:09 user nova-compute[74692]:     <tpm supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-tis</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-crb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>passthrough</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>emulator</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </tpm>
Nov 18 18:24:09 user nova-compute[74692]:   </devices>
Nov 18 18:24:09 user nova-compute[74692]:   <features>
Nov 18 18:24:09 user nova-compute[74692]:     <gic supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     <vmcoreinfo supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <genid supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backingStoreInput supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backup supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <sev supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:   </features>
Nov 18 18:24:09 user nova-compute[74692]: </domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:  {{(pid=74692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 18 18:24:09 user nova-compute[74692]: <domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 18 18:24:09 user nova-compute[74692]:   <domain>kvm</domain>
Nov 18 18:24:09 user nova-compute[74692]:   <machine>pc-q35-jammy</machine>
Nov 18 18:24:09 user nova-compute[74692]:   <arch>x86_64</arch>
Nov 18 18:24:09 user nova-compute[74692]:   <vcpu max='288'/>
Nov 18 18:24:09 user nova-compute[74692]:   <iothreads supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:   <os supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='firmware'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>efi</value>
Nov 18 18:24:09 user nova-compute[74692]:     </enum>
Nov 18 18:24:09 user nova-compute[74692]:     <loader supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>rom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pflash</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='readonly'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>yes</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='secure'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>yes</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </loader>
Nov 18 18:24:09 user nova-compute[74692]:   </os>
Nov 18 18:24:09 user nova-compute[74692]:   <cpu>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-passthrough' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='hostPassthroughMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>on</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='maximum' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='maximumMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>on</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-model' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <vendor>Intel</vendor>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ss'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='vmx'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='pcid'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='hypervisor'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arat'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='umip'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='md-clear'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='invtsc'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibpb'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibrs'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='rsba'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='pschange-mc-no'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='erms'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='custom' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>qemu64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>qemu32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>phenom</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>n270</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>kvm64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>kvm32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>coreduo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>core2duo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>athlon</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Westmere-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Westmere</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Snowridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Penryn</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G5</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G4</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Opteron_G1</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Nehalem</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Rome</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Milan</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Dhyana</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cooperlake</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Conroe</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>486</model>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:   </cpu>
Nov 18 18:24:09 user nova-compute[74692]:   <memoryBacking supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='sourceType'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>file</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>anonymous</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>memfd</value>
Nov 18 18:24:09 user nova-compute[74692]:     </enum>
Nov 18 18:24:09 user nova-compute[74692]:   </memoryBacking>
Nov 18 18:24:09 user nova-compute[74692]:   <devices>
Nov 18 18:24:09 user nova-compute[74692]:     <disk supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='diskDevice'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>disk</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cdrom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>floppy</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>lun</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='bus'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>fdc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sata</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </disk>
Nov 18 18:24:09 user nova-compute[74692]:     <graphics supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sdl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vnc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>spice</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egl-headless</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </graphics>
Nov 18 18:24:09 user nova-compute[74692]:     <video supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='modelType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cirrus</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vmvga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>qxl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>none</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>bochs</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>ramfb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </video>
Nov 18 18:24:09 user nova-compute[74692]:     <hostdev supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='mode'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>subsystem</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='startupPolicy'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>default</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>mandatory</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>requisite</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>optional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='subsysType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pci</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='capsType'/>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='pciBackend'/>
Nov 18 18:24:09 user nova-compute[74692]:     </hostdev>
Nov 18 18:24:09 user nova-compute[74692]:     <rng supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>random</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egd</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>builtin</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </rng>
Nov 18 18:24:09 user nova-compute[74692]:     <filesystem supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='driverType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>path</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>handle</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtiofs</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </filesystem>
Nov 18 18:24:09 user nova-compute[74692]:     <tpm supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-tis</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-crb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>passthrough</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>emulator</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </tpm>
Nov 18 18:24:09 user nova-compute[74692]:   </devices>
Nov 18 18:24:09 user nova-compute[74692]:   <features>
Nov 18 18:24:09 user nova-compute[74692]:     <gic supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     <vmcoreinfo supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <genid supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backingStoreInput supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backup supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <sev supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:   </features>
Nov 18 18:24:09 user nova-compute[74692]: </domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:  {{(pid=74692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 18 18:24:09 user nova-compute[74692]: <domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 18 18:24:09 user nova-compute[74692]:   <domain>kvm</domain>
Nov 18 18:24:09 user nova-compute[74692]:   <machine>pc-i440fx-6.2</machine>
Nov 18 18:24:09 user nova-compute[74692]:   <arch>x86_64</arch>
Nov 18 18:24:09 user nova-compute[74692]:   <vcpu max='255'/>
Nov 18 18:24:09 user nova-compute[74692]:   <iothreads supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:   <os supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='firmware'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>efi</value>
Nov 18 18:24:09 user nova-compute[74692]:     </enum>
Nov 18 18:24:09 user nova-compute[74692]:     <loader supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>rom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pflash</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='readonly'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>yes</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='secure'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </loader>
Nov 18 18:24:09 user nova-compute[74692]:   </os>
Nov 18 18:24:09 user nova-compute[74692]:   <cpu>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-passthrough' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='hostPassthroughMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>on</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='maximum' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='maximumMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>on</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-model' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <vendor>Intel</vendor>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ss'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='vmx'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='pcid'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='hypervisor'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arat'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='umip'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='md-clear'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='invtsc'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibpb'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibrs'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='rsba'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='pschange-mc-no'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='erms'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='custom' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>qemu64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>qemu32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>phenom</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>n270</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>kvm64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>kvm32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>coreduo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>core2duo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>athlon</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Westmere-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Westmere</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Snowridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Penryn</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G5</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G4</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Opteron_G1</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Nehalem</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Rome</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Milan</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Dhyana</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cooperlake</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Conroe</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>486</model>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:   </cpu>
Nov 18 18:24:09 user nova-compute[74692]:   <memoryBacking supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='sourceType'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>file</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>anonymous</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>memfd</value>
Nov 18 18:24:09 user nova-compute[74692]:     </enum>
Nov 18 18:24:09 user nova-compute[74692]:   </memoryBacking>
Nov 18 18:24:09 user nova-compute[74692]:   <devices>
Nov 18 18:24:09 user nova-compute[74692]:     <disk supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='diskDevice'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>disk</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cdrom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>floppy</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>lun</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='bus'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>ide</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>fdc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sata</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </disk>
Nov 18 18:24:09 user nova-compute[74692]:     <graphics supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sdl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vnc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>spice</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egl-headless</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </graphics>
Nov 18 18:24:09 user nova-compute[74692]:     <video supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='modelType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cirrus</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vmvga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>qxl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>none</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>bochs</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>ramfb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </video>
Nov 18 18:24:09 user nova-compute[74692]:     <hostdev supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='mode'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>subsystem</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='startupPolicy'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>default</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>mandatory</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>requisite</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>optional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='subsysType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pci</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='capsType'/>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='pciBackend'/>
Nov 18 18:24:09 user nova-compute[74692]:     </hostdev>
Nov 18 18:24:09 user nova-compute[74692]:     <rng supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>random</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egd</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>builtin</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </rng>
Nov 18 18:24:09 user nova-compute[74692]:     <filesystem supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='driverType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>path</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>handle</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtiofs</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </filesystem>
Nov 18 18:24:09 user nova-compute[74692]:     <tpm supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-tis</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-crb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>passthrough</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>emulator</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </tpm>
Nov 18 18:24:09 user nova-compute[74692]:   </devices>
Nov 18 18:24:09 user nova-compute[74692]:   <features>
Nov 18 18:24:09 user nova-compute[74692]:     <gic supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     <vmcoreinfo supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <genid supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backingStoreInput supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backup supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <sev supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:   </features>
Nov 18 18:24:09 user nova-compute[74692]: </domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:  {{(pid=74692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 18 18:24:09 user nova-compute[74692]: <domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 18 18:24:09 user nova-compute[74692]:   <domain>kvm</domain>
Nov 18 18:24:09 user nova-compute[74692]:   <machine>pc-i440fx-jammy</machine>
Nov 18 18:24:09 user nova-compute[74692]:   <arch>x86_64</arch>
Nov 18 18:24:09 user nova-compute[74692]:   <vcpu max='255'/>
Nov 18 18:24:09 user nova-compute[74692]:   <iothreads supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:   <os supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='firmware'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>efi</value>
Nov 18 18:24:09 user nova-compute[74692]:     </enum>
Nov 18 18:24:09 user nova-compute[74692]:     <loader supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>rom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pflash</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='readonly'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>yes</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='secure'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>no</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </loader>
Nov 18 18:24:09 user nova-compute[74692]:   </os>
Nov 18 18:24:09 user nova-compute[74692]:   <cpu>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-passthrough' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='hostPassthroughMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>on</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='maximum' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='maximumMigratable'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>on</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>off</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='host-model' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <vendor>Intel</vendor>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ss'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='vmx'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='pcid'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='hypervisor'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arat'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='umip'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='md-clear'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='invtsc'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibpb'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='ibrs'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-stibp'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='rsba'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='require' name='pschange-mc-no'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='erms'/>
Nov 18 18:24:09 user nova-compute[74692]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:     <mode name='custom' supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>qemu64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>qemu32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>phenom</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>pentium</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>n270</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>kvm64</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>kvm32</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>coreduo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>core2duo</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>athlon</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Westmere-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Westmere</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Snowridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Skylake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>SandyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Penryn</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G5</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G4</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G3</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Opteron_G2</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Opteron_G1</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Nehalem</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>IvyBridge</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Icelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Haswell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Rome</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-Milan</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>EPYC</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Dhyana</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cooperlake</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>Conroe</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='no'>Broadwell</model>
Nov 18 18:24:09 user nova-compute[74692]:       <model usable='yes'>486</model>
Nov 18 18:24:09 user nova-compute[74692]:     </mode>
Nov 18 18:24:09 user nova-compute[74692]:   </cpu>
Nov 18 18:24:09 user nova-compute[74692]:   <memoryBacking supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:     <enum name='sourceType'>
Nov 18 18:24:09 user nova-compute[74692]:       <value>file</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>anonymous</value>
Nov 18 18:24:09 user nova-compute[74692]:       <value>memfd</value>
Nov 18 18:24:09 user nova-compute[74692]:     </enum>
Nov 18 18:24:09 user nova-compute[74692]:   </memoryBacking>
Nov 18 18:24:09 user nova-compute[74692]:   <devices>
Nov 18 18:24:09 user nova-compute[74692]:     <disk supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='diskDevice'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>disk</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cdrom</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>floppy</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>lun</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='bus'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>ide</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>fdc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sata</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </disk>
Nov 18 18:24:09 user nova-compute[74692]:     <graphics supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='type'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>sdl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vnc</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>spice</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egl-headless</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </graphics>
Nov 18 18:24:09 user nova-compute[74692]:     <video supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='modelType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>cirrus</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>vmvga</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>qxl</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>none</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>bochs</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>ramfb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </video>
Nov 18 18:24:09 user nova-compute[74692]:     <hostdev supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='mode'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>subsystem</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='startupPolicy'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>default</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>mandatory</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>requisite</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>optional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='subsysType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>usb</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>pci</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>scsi</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='capsType'/>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='pciBackend'/>
Nov 18 18:24:09 user nova-compute[74692]:     </hostdev>
Nov 18 18:24:09 user nova-compute[74692]:     <rng supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtio-non-transitional</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>random</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>egd</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>builtin</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </rng>
Nov 18 18:24:09 user nova-compute[74692]:     <filesystem supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='driverType'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>path</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>handle</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>virtiofs</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </filesystem>
Nov 18 18:24:09 user nova-compute[74692]:     <tpm supported='yes'>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='model'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-tis</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>tpm-crb</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:       <enum name='backendModel'>
Nov 18 18:24:09 user nova-compute[74692]:         <value>passthrough</value>
Nov 18 18:24:09 user nova-compute[74692]:         <value>emulator</value>
Nov 18 18:24:09 user nova-compute[74692]:       </enum>
Nov 18 18:24:09 user nova-compute[74692]:     </tpm>
Nov 18 18:24:09 user nova-compute[74692]:   </devices>
Nov 18 18:24:09 user nova-compute[74692]:   <features>
Nov 18 18:24:09 user nova-compute[74692]:     <gic supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:     <vmcoreinfo supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <genid supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backingStoreInput supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <backup supported='yes'/>
Nov 18 18:24:09 user nova-compute[74692]:     <sev supported='no'/>
Nov 18 18:24:09 user nova-compute[74692]:   </features>
Nov 18 18:24:09 user nova-compute[74692]: </domainCapabilities>
Nov 18 18:24:09 user nova-compute[74692]:  {{(pid=74692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Checking secure boot support for host arch (x86_64) {{(pid=74692) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 18 18:24:09 user nova-compute[74692]: INFO nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Secure Boot support detected
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] cpu compare xml: <cpu match="exact">
Nov 18 18:24:09 user nova-compute[74692]:   <model>Nehalem</model>
Nov 18 18:24:09 user nova-compute[74692]: </cpu>
Nov 18 18:24:09 user nova-compute[74692]:  {{(pid=74692) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 18 18:24:09 user nova-compute[74692]: INFO nova.virt.node [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Generated node identity 582be55c-ee9f-496e-b354-5900b8401d2c
Nov 18 18:24:09 user nova-compute[74692]: INFO nova.virt.node [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Wrote node identity 582be55c-ee9f-496e-b354-5900b8401d2c to /opt/stack/data/nova/compute_id
Nov 18 18:24:09 user nova-compute[74692]: WARNING nova.compute.manager [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Compute nodes ['582be55c-ee9f-496e-b354-5900b8401d2c'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 18 18:24:09 user nova-compute[74692]: INFO nova.compute.manager [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 18 18:24:09 user nova-compute[74692]: WARNING nova.compute.manager [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 18 18:24:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:24:09 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:24:10 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:24:10 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:24:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Hypervisor/Node resource view: name=user free_ram=10973MB free_disk=26.118003845214844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:24:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:24:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:24:10 user nova-compute[74692]: WARNING nova.compute.resource_tracker [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] No compute node record for user:582be55c-ee9f-496e-b354-5900b8401d2c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 582be55c-ee9f-496e-b354-5900b8401d2c could not be found.
Nov 18 18:24:10 user nova-compute[74692]: INFO nova.compute.resource_tracker [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Compute node record created for user:user with uuid: 582be55c-ee9f-496e-b354-5900b8401d2c
Nov 18 18:24:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:24:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:24:10 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] [req-a382b08b-c34f-4f81-a22a-33ab9cd5e78e] Created resource provider record via placement API for resource provider with UUID 582be55c-ee9f-496e-b354-5900b8401d2c and name user.
Nov 18 18:24:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74692) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 18 18:24:10 user nova-compute[74692]: INFO nova.virt.libvirt.host [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] kernel doesn't support AMD SEV
Nov 18 18:24:10 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Updating inventory in ProviderTree for provider 582be55c-ee9f-496e-b354-5900b8401d2c with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 18:24:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:24:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Libvirt baseline CPU <cpu>
Nov 18 18:24:10 user nova-compute[74692]:   <arch>x86_64</arch>
Nov 18 18:24:10 user nova-compute[74692]:   <model>Nehalem</model>
Nov 18 18:24:10 user nova-compute[74692]:   <vendor>Intel</vendor>
Nov 18 18:24:10 user nova-compute[74692]:   <topology sockets="6" cores="1" threads="1"/>
Nov 18 18:24:10 user nova-compute[74692]: </cpu>
Nov 18 18:24:10 user nova-compute[74692]:  {{(pid=74692) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 18 18:24:10 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Updated inventory for provider 582be55c-ee9f-496e-b354-5900b8401d2c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 18 18:24:10 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Updating resource provider 582be55c-ee9f-496e-b354-5900b8401d2c generation from 0 to 1 during operation: update_inventory {{(pid=74692) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 18 18:24:10 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Updating inventory in ProviderTree for provider 582be55c-ee9f-496e-b354-5900b8401d2c with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 18:24:10 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Updating resource provider 582be55c-ee9f-496e-b354-5900b8401d2c generation from 1 to 2 during operation: update_traits {{(pid=74692) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 18 18:24:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:24:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.653s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:24:10 user nova-compute[74692]: DEBUG nova.service [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Creating RPC server for service compute {{(pid=74692) start /opt/stack/nova/nova/service.py:182}}
Nov 18 18:24:10 user nova-compute[74692]: DEBUG nova.service [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] Join ServiceGroup membership for this service compute {{(pid=74692) start /opt/stack/nova/nova/service.py:199}}
Nov 18 18:24:10 user nova-compute[74692]: DEBUG nova.servicegroup.drivers.db [None req-8ac0dbfb-7a6d-47e9-aa20-8507f4da0fb6 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74692) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 18 18:24:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:24:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:25:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:25:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:25:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:25:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 18:25:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Didn't find any instances for network info cache update. {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 18:25:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:25:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:25:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:25:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:25:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:25:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:25:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:25:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:25:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:25:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:25:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:25:02 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:25:02 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:25:02 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:25:02 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=10388MB free_disk=26.02172088623047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:25:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:25:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:25:02 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:25:02 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:25:02 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:25:02 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:25:02 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:25:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:26:02 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:26:02 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:26:02 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:26:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:26:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:26:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:26:02 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:26:02 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:26:02 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:26:02 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=10306MB free_disk=26.086048126220703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:26:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:26:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:26:02 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:26:02 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:26:02 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:26:02 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:26:02 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:26:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:26:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:26:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:26:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:26:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:26:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:26:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:26:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:26:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:26:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 18:26:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Didn't find any instances for network info cache update. {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 18:26:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:27:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:27:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:27:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:27:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:27:01 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:27:02 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:27:02 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:27:02 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=10288MB free_disk=25.83849334716797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:27:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:27:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:27:02 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:27:02 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:27:02 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:27:02 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:27:02 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:27:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:27:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:27:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:27:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:27:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:27:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:27:04 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:27:04 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:27:04 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:27:04 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 18:27:04 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Didn't find any instances for network info cache update. {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 18:27:04 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:27:05 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:28:02 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:28:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:28:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:28:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:03 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:28:04 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:04 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:04 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=9590MB free_disk=25.858428955078125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:28:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:04 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:28:04 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:28:04 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:28:04 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:28:04 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:28:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:05 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:28:05 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:28:05 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:28:05 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:28:05 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:28:06 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:28:06 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:28:06 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:28:06 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 18:28:06 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Didn't find any instances for network info cache update. {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 18:28:06 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:28:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquiring lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:10 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:28:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:28:11 user nova-compute[74692]: INFO nova.compute.claims [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Claim successful on node user
Nov 18 18:28:11 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:28:11 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:28:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:11 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:28:11 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:28:11 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:28:11 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:28:11 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:28:11 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:28:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:28:11 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Creating image(s)
Nov 18 18:28:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquiring lock "/opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "/opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "/opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701.part --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:12 user nova-compute[74692]: DEBUG nova.policy [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9413da4a9a1d4b0c8a8ac05f03fe15da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0706238908747f1a06bc4ea7750dfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:28:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701.part --force-share --output=json" returned: 0 in 0.230s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:12 user nova-compute[74692]: DEBUG nova.virt.images [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] 503b14b1-1e1e-41a7-a748-0e4d907ae048 was qcow2, converting to raw {{(pid=74692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 18:28:12 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:28:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701.part /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701.converted {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701.part /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701.converted" returned: 0 in 0.625s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701.converted --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701.converted --force-share --output=json" returned: 0 in 0.167s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.877s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:13 user nova-compute[74692]: INFO oslo.privsep.daemon [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpcoxve2u9/privsep.sock']
Nov 18 18:28:13 user sudo[84186]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpcoxve2u9/privsep.sock
Nov 18 18:28:13 user sudo[84186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 18 18:28:14 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Successfully created port: 0f17b65c-54ab-45fb-a250-e917fc87ef10 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:28:15 user sudo[84186]: pam_unix(sudo:session): session closed for user root
Nov 18 18:28:15 user nova-compute[74692]: INFO oslo.privsep.daemon [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Spawned new privsep daemon via rootwrap
Nov 18 18:28:15 user nova-compute[74692]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 18 18:28:15 user nova-compute[74692]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 18 18:28:15 user nova-compute[74692]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 18 18:28:15 user nova-compute[74692]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84197
Nov 18 18:28:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.162s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.211s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk 1073741824" returned: 0 in 0.046s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:15 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:28:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:16 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Cannot resize image /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:28:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:28:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Ensure instance console log exists: /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:28:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:18 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Successfully updated port: 0f17b65c-54ab-45fb-a250-e917fc87ef10 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:28:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquiring lock "refresh_cache-afe4e445-5419-4a79-ae32-294e0ac0a7c0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:28:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquired lock "refresh_cache-afe4e445-5419-4a79-ae32-294e0ac0a7c0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:28:18 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:28:18 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:28:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-4bc2052f-99c9-4bef-b477-4e830cc548c2 req-5b99b72b-6a7f-4745-8b53-854763d3ef6b service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Received event network-changed-0f17b65c-54ab-45fb-a250-e917fc87ef10 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-4bc2052f-99c9-4bef-b477-4e830cc548c2 req-5b99b72b-6a7f-4745-8b53-854763d3ef6b service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Refreshing instance network info cache due to event network-changed-0f17b65c-54ab-45fb-a250-e917fc87ef10. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:28:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4bc2052f-99c9-4bef-b477-4e830cc548c2 req-5b99b72b-6a7f-4745-8b53-854763d3ef6b service nova] Acquiring lock "refresh_cache-afe4e445-5419-4a79-ae32-294e0ac0a7c0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Updating instance_info_cache with network_info: [{"id": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "address": "fa:16:3e:67:61:1d", "network": {"id": "58efb65a-1cab-4ed5-a03e-808fa70f9179", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747026108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0706238908747f1a06bc4ea7750dfdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f17b65c-54", "ovs_interfaceid": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Releasing lock "refresh_cache-afe4e445-5419-4a79-ae32-294e0ac0a7c0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Instance network_info: |[{"id": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "address": "fa:16:3e:67:61:1d", "network": {"id": "58efb65a-1cab-4ed5-a03e-808fa70f9179", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747026108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0706238908747f1a06bc4ea7750dfdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f17b65c-54", "ovs_interfaceid": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4bc2052f-99c9-4bef-b477-4e830cc548c2 req-5b99b72b-6a7f-4745-8b53-854763d3ef6b service nova] Acquired lock "refresh_cache-afe4e445-5419-4a79-ae32-294e0ac0a7c0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.network.neutron [req-4bc2052f-99c9-4bef-b477-4e830cc548c2 req-5b99b72b-6a7f-4745-8b53-854763d3ef6b service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Refreshing network info cache for port 0f17b65c-54ab-45fb-a250-e917fc87ef10 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Start _get_guest_xml network_info=[{"id": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "address": "fa:16:3e:67:61:1d", "network": {"id": "58efb65a-1cab-4ed5-a03e-808fa70f9179", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747026108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0706238908747f1a06bc4ea7750dfdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f17b65c-54", "ovs_interfaceid": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:28:19 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:19 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-38746030',display_name='tempest-DeleteServersTestJSON-server-38746030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-38746030',id=1,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0706238908747f1a06bc4ea7750dfdf',ramdisk_id='',reservation_id='r-j8tou1f4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1083559718',owner_user_name='tempest-DeleteServersTestJSON-1083559718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:28:12Z,user_data=None,user_id='9413da4a9a1d4b0c8a8ac05f03fe15da',uuid=afe4e445-5419-4a79-ae32-294e0ac0a7c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "address": "fa:16:3e:67:61:1d", "network": {"id": "58efb65a-1cab-4ed5-a03e-808fa70f9179", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747026108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0706238908747f1a06bc4ea7750dfdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f17b65c-54", "ovs_interfaceid": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Converting VIF {"id": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "address": "fa:16:3e:67:61:1d", "network": {"id": "58efb65a-1cab-4ed5-a03e-808fa70f9179", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747026108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0706238908747f1a06bc4ea7750dfdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f17b65c-54", "ovs_interfaceid": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f17b65c-54ab-45fb-a250-e917fc87ef10,network=Network(58efb65a-1cab-4ed5-a03e-808fa70f9179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f17b65c-54') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.objects.instance [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lazy-loading 'pci_devices' on Instance uuid afe4e445-5419-4a79-ae32-294e0ac0a7c0 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:28:19 user nova-compute[74692]:   <uuid>afe4e445-5419-4a79-ae32-294e0ac0a7c0</uuid>
Nov 18 18:28:19 user nova-compute[74692]:   <name>instance-00000001</name>
Nov 18 18:28:19 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:28:19 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:28:19 user nova-compute[74692]:   <metadata>
Nov 18 18:28:19 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:28:19 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:28:19 user nova-compute[74692]:       <nova:name>tempest-DeleteServersTestJSON-server-38746030</nova:name>
Nov 18 18:28:19 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:28:19</nova:creationTime>
Nov 18 18:28:19 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:28:19 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:28:19 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:28:19 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:28:19 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:28:19 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:28:19 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:28:19 user nova-compute[74692]:       <nova:owner>
Nov 18 18:28:19 user nova-compute[74692]:         <nova:user uuid="9413da4a9a1d4b0c8a8ac05f03fe15da">tempest-DeleteServersTestJSON-1083559718-project-member</nova:user>
Nov 18 18:28:19 user nova-compute[74692]:         <nova:project uuid="c0706238908747f1a06bc4ea7750dfdf">tempest-DeleteServersTestJSON-1083559718</nova:project>
Nov 18 18:28:19 user nova-compute[74692]:       </nova:owner>
Nov 18 18:28:19 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:28:19 user nova-compute[74692]:       <nova:ports>
Nov 18 18:28:19 user nova-compute[74692]:         <nova:port uuid="0f17b65c-54ab-45fb-a250-e917fc87ef10">
Nov 18 18:28:19 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 18:28:19 user nova-compute[74692]:         </nova:port>
Nov 18 18:28:19 user nova-compute[74692]:       </nova:ports>
Nov 18 18:28:19 user nova-compute[74692]:     </nova:instance>
Nov 18 18:28:19 user nova-compute[74692]:   </metadata>
Nov 18 18:28:19 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:28:19 user nova-compute[74692]:     <system>
Nov 18 18:28:19 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:28:19 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:28:19 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:28:19 user nova-compute[74692]:       <entry name="serial">afe4e445-5419-4a79-ae32-294e0ac0a7c0</entry>
Nov 18 18:28:19 user nova-compute[74692]:       <entry name="uuid">afe4e445-5419-4a79-ae32-294e0ac0a7c0</entry>
Nov 18 18:28:19 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:28:19 user nova-compute[74692]:     </system>
Nov 18 18:28:19 user nova-compute[74692]:   </sysinfo>
Nov 18 18:28:19 user nova-compute[74692]:   <os>
Nov 18 18:28:19 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:28:19 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:28:19 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:28:19 user nova-compute[74692]:   </os>
Nov 18 18:28:19 user nova-compute[74692]:   <features>
Nov 18 18:28:19 user nova-compute[74692]:     <acpi/>
Nov 18 18:28:19 user nova-compute[74692]:     <apic/>
Nov 18 18:28:19 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:28:19 user nova-compute[74692]:   </features>
Nov 18 18:28:19 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:28:19 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:28:19 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:28:19 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:28:19 user nova-compute[74692]:   </clock>
Nov 18 18:28:19 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:28:19 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:28:19 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:28:19 user nova-compute[74692]:   </cpu>
Nov 18 18:28:19 user nova-compute[74692]:   <devices>
Nov 18 18:28:19 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:28:19 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:28:19 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk"/>
Nov 18 18:28:19 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:28:19 user nova-compute[74692]:     </disk>
Nov 18 18:28:19 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:28:19 user nova-compute[74692]:       <mac address="fa:16:3e:67:61:1d"/>
Nov 18 18:28:19 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:28:19 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:28:19 user nova-compute[74692]:       <target dev="tap0f17b65c-54"/>
Nov 18 18:28:19 user nova-compute[74692]:     </interface>
Nov 18 18:28:19 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:28:19 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/console.log" append="off"/>
Nov 18 18:28:19 user nova-compute[74692]:     </serial>
Nov 18 18:28:19 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:28:19 user nova-compute[74692]:     <video>
Nov 18 18:28:19 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:28:19 user nova-compute[74692]:     </video>
Nov 18 18:28:19 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:28:19 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:28:19 user nova-compute[74692]:     </rng>
Nov 18 18:28:19 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:28:19 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:28:19 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:28:19 user nova-compute[74692]:     </memballoon>
Nov 18 18:28:19 user nova-compute[74692]:   </devices>
Nov 18 18:28:19 user nova-compute[74692]: </domain>
Nov 18 18:28:19 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-38746030',display_name='tempest-DeleteServersTestJSON-server-38746030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-38746030',id=1,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0706238908747f1a06bc4ea7750dfdf',ramdisk_id='',reservation_id='r-j8tou1f4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1083559718',owner_user_name='tempest-DeleteServersTestJSON-1083559718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:28:12Z,user_data=None,user_id='9413da4a9a1d4b0c8a8ac05f03fe15da',uuid=afe4e445-5419-4a79-ae32-294e0ac0a7c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "address": "fa:16:3e:67:61:1d", "network": {"id": "58efb65a-1cab-4ed5-a03e-808fa70f9179", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747026108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0706238908747f1a06bc4ea7750dfdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f17b65c-54", "ovs_interfaceid": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Converting VIF {"id": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "address": "fa:16:3e:67:61:1d", "network": {"id": "58efb65a-1cab-4ed5-a03e-808fa70f9179", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747026108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0706238908747f1a06bc4ea7750dfdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f17b65c-54", "ovs_interfaceid": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f17b65c-54ab-45fb-a250-e917fc87ef10,network=Network(58efb65a-1cab-4ed5-a03e-808fa70f9179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f17b65c-54') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG os_vif [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f17b65c-54ab-45fb-a250-e917fc87ef10,network=Network(58efb65a-1cab-4ed5-a03e-808fa70f9179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f17b65c-54') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Created schema index Interface.name {{(pid=74692) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Created schema index Port.name {{(pid=74692) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Created schema index Bridge.name {{(pid=74692) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [POLLOUT] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b8f4a1b-673e-5b80-913f-efc1ba58d181', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:28:19 user nova-compute[74692]: INFO oslo.privsep.daemon [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpleaa5gus/privsep.sock']
Nov 18 18:28:19 user sudo[84236]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpleaa5gus/privsep.sock
Nov 18 18:28:19 user sudo[84236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 18 18:28:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "bebb6344-183e-4367-bb0b-b575b70adfbc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:28:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:20 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:28:20 user nova-compute[74692]: INFO nova.compute.claims [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Claim successful on node user
Nov 18 18:28:20 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:28:20 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:28:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:28:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:28:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:28:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:28:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:28:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-4bc2052f-99c9-4bef-b477-4e830cc548c2 req-5b99b72b-6a7f-4745-8b53-854763d3ef6b service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Updated VIF entry in instance network info cache for port 0f17b65c-54ab-45fb-a250-e917fc87ef10. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:28:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-4bc2052f-99c9-4bef-b477-4e830cc548c2 req-5b99b72b-6a7f-4745-8b53-854763d3ef6b service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Updating instance_info_cache with network_info: [{"id": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "address": "fa:16:3e:67:61:1d", "network": {"id": "58efb65a-1cab-4ed5-a03e-808fa70f9179", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747026108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0706238908747f1a06bc4ea7750dfdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f17b65c-54", "ovs_interfaceid": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:28:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4bc2052f-99c9-4bef-b477-4e830cc548c2 req-5b99b72b-6a7f-4745-8b53-854763d3ef6b service nova] Releasing lock "refresh_cache-afe4e445-5419-4a79-ae32-294e0ac0a7c0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG nova.compute.manager [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:28:21 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Creating image(s)
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "/opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "/opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "/opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.152s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG nova.policy [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0a005c7c46c46ad9217578412ec906f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169f28da1640d9b03b4ba44b4e7b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:28:21 user sudo[84236]: pam_unix(sudo:session): session closed for user root
Nov 18 18:28:21 user nova-compute[74692]: INFO oslo.privsep.daemon [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Spawned new privsep daemon via rootwrap
Nov 18 18:28:21 user nova-compute[74692]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 18 18:28:21 user nova-compute[74692]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 18 18:28:21 user nova-compute[74692]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 18 18:28:21 user nova-compute[74692]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84246
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk 1073741824" returned: 0 in 0.049s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.185s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Cannot resize image /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Ensure instance console log exists: /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f17b65c-54, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f17b65c-54, col_values=(('qos', UUID('73e0398d-f516-4dd7-9f92-63c20f9391c3')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f17b65c-54, col_values=(('external_ids', {'iface-id': '0f17b65c-54ab-45fb-a250-e917fc87ef10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:61:1d', 'vm-uuid': 'afe4e445-5419-4a79-ae32-294e0ac0a7c0'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:28:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:21 user nova-compute[74692]: INFO os_vif [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f17b65c-54ab-45fb-a250-e917fc87ef10,network=Network(58efb65a-1cab-4ed5-a03e-808fa70f9179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f17b65c-54')
Nov 18 18:28:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:28:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] No VIF found with MAC fa:16:3e:67:61:1d, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:28:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:23 user nova-compute[74692]: DEBUG nova.network.neutron [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Successfully created port: 3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:28:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:28:25 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Instance spawned successfully.
Nov 18 18:28:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:25 user nova-compute[74692]: INFO nova.compute.manager [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Took 13.97 seconds to spawn the instance on the hypervisor.
Nov 18 18:28:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:25 user nova-compute[74692]: INFO nova.compute.manager [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Took 14.93 seconds to build instance.
Nov 18 18:28:25 user nova-compute[74692]: DEBUG nova.network.neutron [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Successfully updated port: 3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6987727d-d6b2-4df4-bf41-bcbe952d9979 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.346s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquired lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG nova.network.neutron [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-d86dbfc0-2f97-46ee-94af-188f7cc0a1a8 req-0e5d0261-8b14-487e-a77e-e74a7b6dccf2 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received event network-changed-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-d86dbfc0-2f97-46ee-94af-188f7cc0a1a8 req-0e5d0261-8b14-487e-a77e-e74a7b6dccf2 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Refreshing instance network info cache due to event network-changed-3ea5c349-f13f-453c-81e5-388c93e6dfa4. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:28:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d86dbfc0-2f97-46ee-94af-188f7cc0a1a8 req-0e5d0261-8b14-487e-a77e-e74a7b6dccf2 service nova] Acquiring lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.network.neutron [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.network.neutron [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updating instance_info_cache with network_info: [{"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Releasing lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Instance network_info: |[{"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d86dbfc0-2f97-46ee-94af-188f7cc0a1a8 req-0e5d0261-8b14-487e-a77e-e74a7b6dccf2 service nova] Acquired lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.network.neutron [req-d86dbfc0-2f97-46ee-94af-188f7cc0a1a8 req-0e5d0261-8b14-487e-a77e-e74a7b6dccf2 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Refreshing network info cache for port 3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Start _get_guest_xml network_info=[{"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:28:26 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:26 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1074163696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1074163696',id=2,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeLBOPFzK9EaCTBkDnIIkEDoB/rVhgGY9JYnZGbi0tGbLRkFO76l0CO4COQkIW7VJcbNIL08CVp8x3z68j+yJdAOAZQA/in4FEAcfWxAJTCv0DtidMPu5KzAnRV9OgdZw==',key_name='tempest-keypair-1821240249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f169f28da1640d9b03b4ba44b4e7b7c',ramdisk_id='',reservation_id='r-s1ly0l0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1768400085',owner_user_name='tempest-AttachVolumeShelveTestJSON-1768400085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:28:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a005c7c46c46ad9217578412ec906f',uuid=bebb6344-183e-4367-bb0b-b575b70adfbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converting VIF {"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:98:ed,bridge_name='br-int',has_traffic_filtering=True,id=3ea5c349-f13f-453c-81e5-388c93e6dfa4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea5c349-f1') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.objects.instance [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'pci_devices' on Instance uuid bebb6344-183e-4367-bb0b-b575b70adfbc {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:28:26 user nova-compute[74692]:   <uuid>bebb6344-183e-4367-bb0b-b575b70adfbc</uuid>
Nov 18 18:28:26 user nova-compute[74692]:   <name>instance-00000002</name>
Nov 18 18:28:26 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:28:26 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:28:26 user nova-compute[74692]:   <metadata>
Nov 18 18:28:26 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:28:26 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:28:26 user nova-compute[74692]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1074163696</nova:name>
Nov 18 18:28:26 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:28:26</nova:creationTime>
Nov 18 18:28:26 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:28:26 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:28:26 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:28:26 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:28:26 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:28:26 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:28:26 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:28:26 user nova-compute[74692]:       <nova:owner>
Nov 18 18:28:26 user nova-compute[74692]:         <nova:user uuid="c0a005c7c46c46ad9217578412ec906f">tempest-AttachVolumeShelveTestJSON-1768400085-project-member</nova:user>
Nov 18 18:28:26 user nova-compute[74692]:         <nova:project uuid="1f169f28da1640d9b03b4ba44b4e7b7c">tempest-AttachVolumeShelveTestJSON-1768400085</nova:project>
Nov 18 18:28:26 user nova-compute[74692]:       </nova:owner>
Nov 18 18:28:26 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:28:26 user nova-compute[74692]:       <nova:ports>
Nov 18 18:28:26 user nova-compute[74692]:         <nova:port uuid="3ea5c349-f13f-453c-81e5-388c93e6dfa4">
Nov 18 18:28:26 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 18:28:26 user nova-compute[74692]:         </nova:port>
Nov 18 18:28:26 user nova-compute[74692]:       </nova:ports>
Nov 18 18:28:26 user nova-compute[74692]:     </nova:instance>
Nov 18 18:28:26 user nova-compute[74692]:   </metadata>
Nov 18 18:28:26 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:28:26 user nova-compute[74692]:     <system>
Nov 18 18:28:26 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:28:26 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:28:26 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:28:26 user nova-compute[74692]:       <entry name="serial">bebb6344-183e-4367-bb0b-b575b70adfbc</entry>
Nov 18 18:28:26 user nova-compute[74692]:       <entry name="uuid">bebb6344-183e-4367-bb0b-b575b70adfbc</entry>
Nov 18 18:28:26 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:28:26 user nova-compute[74692]:     </system>
Nov 18 18:28:26 user nova-compute[74692]:   </sysinfo>
Nov 18 18:28:26 user nova-compute[74692]:   <os>
Nov 18 18:28:26 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:28:26 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:28:26 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:28:26 user nova-compute[74692]:   </os>
Nov 18 18:28:26 user nova-compute[74692]:   <features>
Nov 18 18:28:26 user nova-compute[74692]:     <acpi/>
Nov 18 18:28:26 user nova-compute[74692]:     <apic/>
Nov 18 18:28:26 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:28:26 user nova-compute[74692]:   </features>
Nov 18 18:28:26 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:28:26 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:28:26 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:28:26 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:28:26 user nova-compute[74692]:   </clock>
Nov 18 18:28:26 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:28:26 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:28:26 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:28:26 user nova-compute[74692]:   </cpu>
Nov 18 18:28:26 user nova-compute[74692]:   <devices>
Nov 18 18:28:26 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:28:26 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:28:26 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk"/>
Nov 18 18:28:26 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:28:26 user nova-compute[74692]:     </disk>
Nov 18 18:28:26 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:28:26 user nova-compute[74692]:       <mac address="fa:16:3e:d3:98:ed"/>
Nov 18 18:28:26 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:28:26 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:28:26 user nova-compute[74692]:       <target dev="tap3ea5c349-f1"/>
Nov 18 18:28:26 user nova-compute[74692]:     </interface>
Nov 18 18:28:26 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:28:26 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/console.log" append="off"/>
Nov 18 18:28:26 user nova-compute[74692]:     </serial>
Nov 18 18:28:26 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:28:26 user nova-compute[74692]:     <video>
Nov 18 18:28:26 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:28:26 user nova-compute[74692]:     </video>
Nov 18 18:28:26 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:28:26 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:28:26 user nova-compute[74692]:     </rng>
Nov 18 18:28:26 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:28:26 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:28:26 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:28:26 user nova-compute[74692]:     </memballoon>
Nov 18 18:28:26 user nova-compute[74692]:   </devices>
Nov 18 18:28:26 user nova-compute[74692]: </domain>
Nov 18 18:28:26 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1074163696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1074163696',id=2,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeLBOPFzK9EaCTBkDnIIkEDoB/rVhgGY9JYnZGbi0tGbLRkFO76l0CO4COQkIW7VJcbNIL08CVp8x3z68j+yJdAOAZQA/in4FEAcfWxAJTCv0DtidMPu5KzAnRV9OgdZw==',key_name='tempest-keypair-1821240249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f169f28da1640d9b03b4ba44b4e7b7c',ramdisk_id='',reservation_id='r-s1ly0l0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1768400085',owner_user_name='tempest-AttachVolumeShelveTestJSON-1768400085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:28:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a005c7c46c46ad9217578412ec906f',uuid=bebb6344-183e-4367-bb0b-b575b70adfbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converting VIF {"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:98:ed,bridge_name='br-int',has_traffic_filtering=True,id=3ea5c349-f13f-453c-81e5-388c93e6dfa4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea5c349-f1') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG os_vif [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:98:ed,bridge_name='br-int',has_traffic_filtering=True,id=3ea5c349-f13f-453c-81e5-388c93e6dfa4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea5c349-f1') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e4ed527-386d-5681-85d8-98ef4c173eb7', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ea5c349-f1, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ea5c349-f1, col_values=(('qos', UUID('f4a9ab58-a6c2-46b6-a384-080efba53676')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ea5c349-f1, col_values=(('external_ids', {'iface-id': '3ea5c349-f13f-453c-81e5-388c93e6dfa4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:98:ed', 'vm-uuid': 'bebb6344-183e-4367-bb0b-b575b70adfbc'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:28:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:26 user nova-compute[74692]: INFO os_vif [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:98:ed,bridge_name='br-int',has_traffic_filtering=True,id=3ea5c349-f13f-453c-81e5-388c93e6dfa4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea5c349-f1')
Nov 18 18:28:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:28:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] No VIF found with MAC fa:16:3e:d3:98:ed, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:28:27 user nova-compute[74692]: DEBUG nova.network.neutron [req-d86dbfc0-2f97-46ee-94af-188f7cc0a1a8 req-0e5d0261-8b14-487e-a77e-e74a7b6dccf2 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updated VIF entry in instance network info cache for port 3ea5c349-f13f-453c-81e5-388c93e6dfa4. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:28:27 user nova-compute[74692]: DEBUG nova.network.neutron [req-d86dbfc0-2f97-46ee-94af-188f7cc0a1a8 req-0e5d0261-8b14-487e-a77e-e74a7b6dccf2 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updating instance_info_cache with network_info: [{"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:28:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d86dbfc0-2f97-46ee-94af-188f7cc0a1a8 req-0e5d0261-8b14-487e-a77e-e74a7b6dccf2 service nova] Releasing lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:28:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:32 user nova-compute[74692]: DEBUG nova.compute.manager [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:28:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:28:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Instance spawned successfully.
Nov 18 18:28:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:28:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:32 user nova-compute[74692]: INFO nova.compute.manager [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Took 11.18 seconds to spawn the instance on the hypervisor.
Nov 18 18:28:32 user nova-compute[74692]: DEBUG nova.compute.manager [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:28:32 user nova-compute[74692]: INFO nova.compute.manager [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Took 11.98 seconds to build instance.
Nov 18 18:28:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-42b043d7-b2d7-427c-95f3-533e6eb28c9d tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.130s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:35 user nova-compute[74692]: DEBUG nova.compute.manager [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:28:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:36 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:28:36 user nova-compute[74692]: INFO nova.compute.claims [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Claim successful on node user
Nov 18 18:28:36 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:28:36 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:28:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:28:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:28:36 user nova-compute[74692]: DEBUG nova.network.neutron [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:28:36 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 18 18:28:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:28:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:36 user nova-compute[74692]: DEBUG nova.policy [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ed810ee90bd421dae9874b8561716c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4468fb75f9614b1a9830981e411c0af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:28:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG nova.compute.manager [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:28:37 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Creating image(s)
Nov 18 18:28:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "/opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "/opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "7d2e942f16d61fc19875780fc1c5781911eee9ed" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7d2e942f16d61fc19875780fc1c5781911eee9ed" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed.part --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquiring lock "d17447e1-2e91-4d25-bf3a-3705927ec122" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed.part --force-share --output=json" returned: 0 in 0.234s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG nova.virt.images [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] 9626391d-96b8-4ee6-9103-722c22865918 was qcow2, converting to raw {{(pid=74692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:28:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed.part /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed.converted {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:28:38 user nova-compute[74692]: INFO nova.compute.claims [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Claim successful on node user
Nov 18 18:28:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed.part /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed.converted" returned: 0 in 0.327s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed.converted --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed.converted --force-share --output=json" returned: 0 in 0.258s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7d2e942f16d61fc19875780fc1c5781911eee9ed" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.472s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed --force-share --output=json" returned: 0 in 0.240s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "7d2e942f16d61fc19875780fc1c5781911eee9ed" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7d2e942f16d61fc19875780fc1c5781911eee9ed" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG nova.network.neutron [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Successfully created port: c79b925e-78c4-4334-a547-9294f9b4c8fe {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.894s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.903s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:38 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:28:38 user nova-compute[74692]: INFO nova.compute.claims [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Claim successful on node user
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed --force-share --output=json" returned: 0 in 0.276s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed,backing_fmt=raw /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed,backing_fmt=raw /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk 1073741824" returned: 0 in 0.133s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG nova.network.neutron [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7d2e942f16d61fc19875780fc1c5781911eee9ed" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.436s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:39 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:28:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG nova.policy [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4c515db29f14ce1a90391bc0c05cb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac758bb60347ad8ea3b4f2bf9292cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed --force-share --output=json" returned: 0 in 0.327s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:28:39 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Creating image(s)
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquiring lock "/opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "/opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "/opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Cannot resize image /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Ensure instance console log exists: /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.918s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.276s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:39 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:28:40 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.201s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG nova.policy [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39b207b60dbe460f83bf961a995e5342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722ae3b1a66f46c9a0679d562b22e470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk 1073741824" returned: 0 in 0.089s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:28:40 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Creating image(s)
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.228s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG nova.network.neutron [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Successfully updated port: c79b925e-78c4-4334-a547-9294f9b4c8fe {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "refresh_cache-7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquired lock "refresh_cache-7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG nova.network.neutron [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-3984eb6e-300f-493c-bbe4-7afdbeddcada req-9742e68e-ea5c-417b-8f11-27fc58ac2d71 service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Received event network-changed-c79b925e-78c4-4334-a547-9294f9b4c8fe {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-3984eb6e-300f-493c-bbe4-7afdbeddcada req-9742e68e-ea5c-417b-8f11-27fc58ac2d71 service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Refreshing instance network info cache due to event network-changed-c79b925e-78c4-4334-a547-9294f9b4c8fe. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3984eb6e-300f-493c-bbe4-7afdbeddcada req-9742e68e-ea5c-417b-8f11-27fc58ac2d71 service nova] Acquiring lock "refresh_cache-7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.270s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG nova.network.neutron [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Cannot resize image /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Ensure instance console log exists: /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.262s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG nova.network.neutron [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Successfully created port: 11c1b5b3-4d09-4461-9d7f-d879f706805c {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk 1073741824" returned: 0 in 0.096s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.362s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.218s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.network.neutron [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Updating instance_info_cache with network_info: [{"id": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "address": "fa:16:3e:61:b3:d1", "network": {"id": "820dd503-a51a-4b71-82db-3df377e71223", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-3428666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468fb75f9614b1a9830981e411c0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b925e-78", "ovs_interfaceid": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Releasing lock "refresh_cache-7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.compute.manager [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Instance network_info: |[{"id": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "address": "fa:16:3e:61:b3:d1", "network": {"id": "820dd503-a51a-4b71-82db-3df377e71223", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-3428666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468fb75f9614b1a9830981e411c0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b925e-78", "ovs_interfaceid": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3984eb6e-300f-493c-bbe4-7afdbeddcada req-9742e68e-ea5c-417b-8f11-27fc58ac2d71 service nova] Acquired lock "refresh_cache-7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.network.neutron [req-3984eb6e-300f-493c-bbe4-7afdbeddcada req-9742e68e-ea5c-417b-8f11-27fc58ac2d71 service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Refreshing network info cache for port c79b925e-78c4-4334-a547-9294f9b4c8fe {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Start _get_guest_xml network_info=[{"id": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "address": "fa:16:3e:61:b3:d1", "network": {"id": "820dd503-a51a-4b71-82db-3df377e71223", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-3428666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468fb75f9614b1a9830981e411c0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b925e-78", "ovs_interfaceid": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:28:26Z,direct_url=<?>,disk_format='qcow2',id=9626391d-96b8-4ee6-9103-722c22865918,min_disk=0,min_ram=0,name='',owner='73cd898c857c44bdb7fb4b6e37fd57a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:28:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'scsi', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'image_id': '9626391d-96b8-4ee6-9103-722c22865918'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:28:41 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:41 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:28:26Z,direct_url=<?>,disk_format='qcow2',id=9626391d-96b8-4ee6-9103-722c22865918,min_disk=0,min_ram=0,name='',owner='73cd898c857c44bdb7fb4b6e37fd57a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:28:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:28:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-185263152',display_name='tempest-AttachSCSIVolumeTestJSON-server-185263152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-185263152',id=3,image_ref='9626391d-96b8-4ee6-9103-722c22865918',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPU7Il7iP4ihoBEomQ7mTYWdt4j2/nyza5CAMM57eUdKYAhgvy6jK9zBf1qt/lYQ65oU3IHLHeI3rmcbO6u/l46v+/lhKT+gazw/ecfZ//5tmtWIv8aEEj3zTT5oqLxVyw==',key_name='tempest-keypair-507163191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4468fb75f9614b1a9830981e411c0af8',ramdisk_id='',reservation_id='r-14bhrlh8',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9626391d-96b8-4ee6-9103-722c22865918',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-580137397',owner_user_name='tempest-AttachSCSIVolumeTestJSON-580137397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:28:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ed810ee90bd421dae9874b8561716c0',uuid=7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "address": "fa:16:3e:61:b3:d1", "network": {"id": "820dd503-a51a-4b71-82db-3df377e71223", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-3428666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468fb75f9614b1a9830981e411c0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b925e-78", "ovs_interfaceid": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Converting VIF {"id": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "address": "fa:16:3e:61:b3:d1", "network": {"id": "820dd503-a51a-4b71-82db-3df377e71223", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-3428666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468fb75f9614b1a9830981e411c0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b925e-78", "ovs_interfaceid": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:b3:d1,bridge_name='br-int',has_traffic_filtering=True,id=c79b925e-78c4-4334-a547-9294f9b4c8fe,network=Network(820dd503-a51a-4b71-82db-3df377e71223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79b925e-78') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.objects.instance [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:28:41 user nova-compute[74692]:   <uuid>7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1</uuid>
Nov 18 18:28:41 user nova-compute[74692]:   <name>instance-00000003</name>
Nov 18 18:28:41 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:28:41 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:28:41 user nova-compute[74692]:   <metadata>
Nov 18 18:28:41 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:28:41 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:28:41 user nova-compute[74692]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-185263152</nova:name>
Nov 18 18:28:41 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:28:41</nova:creationTime>
Nov 18 18:28:41 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:28:41 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:28:41 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:28:41 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:28:41 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:28:41 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:28:41 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:28:41 user nova-compute[74692]:       <nova:owner>
Nov 18 18:28:41 user nova-compute[74692]:         <nova:user uuid="7ed810ee90bd421dae9874b8561716c0">tempest-AttachSCSIVolumeTestJSON-580137397-project-member</nova:user>
Nov 18 18:28:41 user nova-compute[74692]:         <nova:project uuid="4468fb75f9614b1a9830981e411c0af8">tempest-AttachSCSIVolumeTestJSON-580137397</nova:project>
Nov 18 18:28:41 user nova-compute[74692]:       </nova:owner>
Nov 18 18:28:41 user nova-compute[74692]:       <nova:root type="image" uuid="9626391d-96b8-4ee6-9103-722c22865918"/>
Nov 18 18:28:41 user nova-compute[74692]:       <nova:ports>
Nov 18 18:28:41 user nova-compute[74692]:         <nova:port uuid="c79b925e-78c4-4334-a547-9294f9b4c8fe">
Nov 18 18:28:41 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 18 18:28:41 user nova-compute[74692]:         </nova:port>
Nov 18 18:28:41 user nova-compute[74692]:       </nova:ports>
Nov 18 18:28:41 user nova-compute[74692]:     </nova:instance>
Nov 18 18:28:41 user nova-compute[74692]:   </metadata>
Nov 18 18:28:41 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:28:41 user nova-compute[74692]:     <system>
Nov 18 18:28:41 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:28:41 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:28:41 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:28:41 user nova-compute[74692]:       <entry name="serial">7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1</entry>
Nov 18 18:28:41 user nova-compute[74692]:       <entry name="uuid">7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1</entry>
Nov 18 18:28:41 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:28:41 user nova-compute[74692]:     </system>
Nov 18 18:28:41 user nova-compute[74692]:   </sysinfo>
Nov 18 18:28:41 user nova-compute[74692]:   <os>
Nov 18 18:28:41 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:28:41 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:28:41 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:28:41 user nova-compute[74692]:   </os>
Nov 18 18:28:41 user nova-compute[74692]:   <features>
Nov 18 18:28:41 user nova-compute[74692]:     <acpi/>
Nov 18 18:28:41 user nova-compute[74692]:     <apic/>
Nov 18 18:28:41 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:28:41 user nova-compute[74692]:   </features>
Nov 18 18:28:41 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:28:41 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:28:41 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:28:41 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:28:41 user nova-compute[74692]:   </clock>
Nov 18 18:28:41 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:28:41 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:28:41 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:28:41 user nova-compute[74692]:   </cpu>
Nov 18 18:28:41 user nova-compute[74692]:   <devices>
Nov 18 18:28:41 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:28:41 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:28:41 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk"/>
Nov 18 18:28:41 user nova-compute[74692]:       <target dev="sda" bus="scsi"/>
Nov 18 18:28:41 user nova-compute[74692]:       <address type="drive" controller="0" unit="0"/>
Nov 18 18:28:41 user nova-compute[74692]:     </disk>
Nov 18 18:28:41 user nova-compute[74692]:     <disk type="file" device="cdrom">
Nov 18 18:28:41 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none"/>
Nov 18 18:28:41 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk.config"/>
Nov 18 18:28:41 user nova-compute[74692]:       <target dev="sdb" bus="scsi"/>
Nov 18 18:28:41 user nova-compute[74692]:       <address type="drive" controller="0" unit="1"/>
Nov 18 18:28:41 user nova-compute[74692]:     </disk>
Nov 18 18:28:41 user nova-compute[74692]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 18 18:28:41 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:28:41 user nova-compute[74692]:       <mac address="fa:16:3e:61:b3:d1"/>
Nov 18 18:28:41 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:28:41 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:28:41 user nova-compute[74692]:       <target dev="tapc79b925e-78"/>
Nov 18 18:28:41 user nova-compute[74692]:     </interface>
Nov 18 18:28:41 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:28:41 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/console.log" append="off"/>
Nov 18 18:28:41 user nova-compute[74692]:     </serial>
Nov 18 18:28:41 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:28:41 user nova-compute[74692]:     <video>
Nov 18 18:28:41 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:28:41 user nova-compute[74692]:     </video>
Nov 18 18:28:41 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:28:41 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:28:41 user nova-compute[74692]:     </rng>
Nov 18 18:28:41 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:28:41 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:28:41 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:28:41 user nova-compute[74692]:     </memballoon>
Nov 18 18:28:41 user nova-compute[74692]:   </devices>
Nov 18 18:28:41 user nova-compute[74692]: </domain>
Nov 18 18:28:41 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:28:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-185263152',display_name='tempest-AttachSCSIVolumeTestJSON-server-185263152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-185263152',id=3,image_ref='9626391d-96b8-4ee6-9103-722c22865918',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPU7Il7iP4ihoBEomQ7mTYWdt4j2/nyza5CAMM57eUdKYAhgvy6jK9zBf1qt/lYQ65oU3IHLHeI3rmcbO6u/l46v+/lhKT+gazw/ecfZ//5tmtWIv8aEEj3zTT5oqLxVyw==',key_name='tempest-keypair-507163191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4468fb75f9614b1a9830981e411c0af8',ramdisk_id='',reservation_id='r-14bhrlh8',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9626391d-96b8-4ee6-9103-722c22865918',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-580137397',owner_user_name='tempest-AttachSCSIVolumeTestJSON-580137397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:28:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ed810ee90bd421dae9874b8561716c0',uuid=7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "address": "fa:16:3e:61:b3:d1", "network": {"id": "820dd503-a51a-4b71-82db-3df377e71223", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-3428666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468fb75f9614b1a9830981e411c0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b925e-78", "ovs_interfaceid": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Converting VIF {"id": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "address": "fa:16:3e:61:b3:d1", "network": {"id": "820dd503-a51a-4b71-82db-3df377e71223", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-3428666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468fb75f9614b1a9830981e411c0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b925e-78", "ovs_interfaceid": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:b3:d1,bridge_name='br-int',has_traffic_filtering=True,id=c79b925e-78c4-4334-a547-9294f9b4c8fe,network=Network(820dd503-a51a-4b71-82db-3df377e71223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79b925e-78') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG os_vif [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:b3:d1,bridge_name='br-int',has_traffic_filtering=True,id=c79b925e-78c4-4334-a547-9294f9b4c8fe,network=Network(820dd503-a51a-4b71-82db-3df377e71223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79b925e-78') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd75c7e0d-fe06-52a9-b8e0-2bdfbe36c05b', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc79b925e-78, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc79b925e-78, col_values=(('qos', UUID('929d5af3-fbef-4fc1-92b6-3768d1620723')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc79b925e-78, col_values=(('external_ids', {'iface-id': 'c79b925e-78c4-4334-a547-9294f9b4c8fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:b3:d1', 'vm-uuid': '7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Cannot resize image /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Ensure instance console log exists: /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:41 user nova-compute[74692]: INFO os_vif [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:b3:d1,bridge_name='br-int',has_traffic_filtering=True,id=c79b925e-78c4-4334-a547-9294f9b4c8fe,network=Network(820dd503-a51a-4b71-82db-3df377e71223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79b925e-78')
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] No BDM found with device name sda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:28:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] No VIF found with MAC fa:16:3e:61:b3:d1, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:28:41 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Using config drive
Nov 18 18:28:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Successfully created port: 9935070a-ab06-4411-afeb-9039ecbea8bc {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG nova.network.neutron [req-3984eb6e-300f-493c-bbe4-7afdbeddcada req-9742e68e-ea5c-417b-8f11-27fc58ac2d71 service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Updated VIF entry in instance network info cache for port c79b925e-78c4-4334-a547-9294f9b4c8fe. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG nova.network.neutron [req-3984eb6e-300f-493c-bbe4-7afdbeddcada req-9742e68e-ea5c-417b-8f11-27fc58ac2d71 service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Updating instance_info_cache with network_info: [{"id": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "address": "fa:16:3e:61:b3:d1", "network": {"id": "820dd503-a51a-4b71-82db-3df377e71223", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-3428666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468fb75f9614b1a9830981e411c0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b925e-78", "ovs_interfaceid": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3984eb6e-300f-493c-bbe4-7afdbeddcada req-9742e68e-ea5c-417b-8f11-27fc58ac2d71 service nova] Releasing lock "refresh_cache-7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:28:42 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Creating config drive at /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk.config
Nov 18 18:28:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpak6742k7 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpak6742k7" returned: 0 in 0.104s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG nova.network.neutron [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Successfully updated port: 11c1b5b3-4d09-4461-9d7f-d879f706805c {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquiring lock "refresh_cache-d17447e1-2e91-4d25-bf3a-3705927ec122" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquired lock "refresh_cache-d17447e1-2e91-4d25-bf3a-3705927ec122" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG nova.network.neutron [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "76506747-4a6b-40bd-b812-bf114be5e8b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG nova.network.neutron [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-8ce99a92-6073-46ec-9be2-5de0645940bd req-7acf17d5-36e2-4646-8d7c-6ce258106126 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Received event network-changed-11c1b5b3-4d09-4461-9d7f-d879f706805c {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-8ce99a92-6073-46ec-9be2-5de0645940bd req-7acf17d5-36e2-4646-8d7c-6ce258106126 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Refreshing instance network info cache due to event network-changed-11c1b5b3-4d09-4461-9d7f-d879f706805c. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:28:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ce99a92-6073-46ec-9be2-5de0645940bd req-7acf17d5-36e2-4646-8d7c-6ce258106126 service nova] Acquiring lock "refresh_cache-d17447e1-2e91-4d25-bf3a-3705927ec122" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:28:43 user nova-compute[74692]: INFO nova.compute.claims [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Claim successful on node user
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.network.neutron [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Updating instance_info_cache with network_info: [{"id": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "address": "fa:16:3e:1c:ef:47", "network": {"id": "dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1097989855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ac758bb60347ad8ea3b4f2bf9292cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c1b5b3-4d", "ovs_interfaceid": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Releasing lock "refresh_cache-d17447e1-2e91-4d25-bf3a-3705927ec122" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Instance network_info: |[{"id": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "address": "fa:16:3e:1c:ef:47", "network": {"id": "dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1097989855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ac758bb60347ad8ea3b4f2bf9292cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c1b5b3-4d", "ovs_interfaceid": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ce99a92-6073-46ec-9be2-5de0645940bd req-7acf17d5-36e2-4646-8d7c-6ce258106126 service nova] Acquired lock "refresh_cache-d17447e1-2e91-4d25-bf3a-3705927ec122" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.network.neutron [req-8ce99a92-6073-46ec-9be2-5de0645940bd req-7acf17d5-36e2-4646-8d7c-6ce258106126 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Refreshing network info cache for port 11c1b5b3-4d09-4461-9d7f-d879f706805c {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Start _get_guest_xml network_info=[{"id": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "address": "fa:16:3e:1c:ef:47", "network": {"id": "dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1097989855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ac758bb60347ad8ea3b4f2bf9292cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c1b5b3-4d", "ovs_interfaceid": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:28:43 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:43 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-249703929',display_name='tempest-TestVolumeSwap-server-249703929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-249703929',id=4,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQ7ErB8zROeG+FGRKKvlR1IkYXszX5weiDoTQKIhfh4EXQdCxcRtkr8WfKfna809njSowyZfpj3fDwytT1EfqSL6kmSNh1FuyPnTDPu/UsR3ulvIFAENerxWH8sm/2x2w==',key_name='tempest-keypair-376439620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ac758bb60347ad8ea3b4f2bf9292cf',ramdisk_id='',reservation_id='r-prbtc42f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-553284986',owner_user_name='tempest-TestVolumeSwap-553284986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:28:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4c515db29f14ce1a90391bc0c05cb05',uuid=d17447e1-2e91-4d25-bf3a-3705927ec122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "address": "fa:16:3e:1c:ef:47", "network": {"id": "dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1097989855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ac758bb60347ad8ea3b4f2bf9292cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c1b5b3-4d", "ovs_interfaceid": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Converting VIF {"id": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "address": "fa:16:3e:1c:ef:47", "network": {"id": "dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1097989855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ac758bb60347ad8ea3b4f2bf9292cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c1b5b3-4d", "ovs_interfaceid": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ef:47,bridge_name='br-int',has_traffic_filtering=True,id=11c1b5b3-4d09-4461-9d7f-d879f706805c,network=Network(dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c1b5b3-4d') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.objects.instance [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lazy-loading 'pci_devices' on Instance uuid d17447e1-2e91-4d25-bf3a-3705927ec122 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:28:43 user nova-compute[74692]:   <uuid>d17447e1-2e91-4d25-bf3a-3705927ec122</uuid>
Nov 18 18:28:43 user nova-compute[74692]:   <name>instance-00000004</name>
Nov 18 18:28:43 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:28:43 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:28:43 user nova-compute[74692]:   <metadata>
Nov 18 18:28:43 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:28:43 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:28:43 user nova-compute[74692]:       <nova:name>tempest-TestVolumeSwap-server-249703929</nova:name>
Nov 18 18:28:43 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:28:43</nova:creationTime>
Nov 18 18:28:43 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:28:43 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:28:43 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:28:43 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:28:43 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:28:43 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:28:43 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:28:43 user nova-compute[74692]:       <nova:owner>
Nov 18 18:28:43 user nova-compute[74692]:         <nova:user uuid="c4c515db29f14ce1a90391bc0c05cb05">tempest-TestVolumeSwap-553284986-project-member</nova:user>
Nov 18 18:28:43 user nova-compute[74692]:         <nova:project uuid="c7ac758bb60347ad8ea3b4f2bf9292cf">tempest-TestVolumeSwap-553284986</nova:project>
Nov 18 18:28:43 user nova-compute[74692]:       </nova:owner>
Nov 18 18:28:43 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:28:43 user nova-compute[74692]:       <nova:ports>
Nov 18 18:28:43 user nova-compute[74692]:         <nova:port uuid="11c1b5b3-4d09-4461-9d7f-d879f706805c">
Nov 18 18:28:43 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 18:28:43 user nova-compute[74692]:         </nova:port>
Nov 18 18:28:43 user nova-compute[74692]:       </nova:ports>
Nov 18 18:28:43 user nova-compute[74692]:     </nova:instance>
Nov 18 18:28:43 user nova-compute[74692]:   </metadata>
Nov 18 18:28:43 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:28:43 user nova-compute[74692]:     <system>
Nov 18 18:28:43 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:28:43 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:28:43 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:28:43 user nova-compute[74692]:       <entry name="serial">d17447e1-2e91-4d25-bf3a-3705927ec122</entry>
Nov 18 18:28:43 user nova-compute[74692]:       <entry name="uuid">d17447e1-2e91-4d25-bf3a-3705927ec122</entry>
Nov 18 18:28:43 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:28:43 user nova-compute[74692]:     </system>
Nov 18 18:28:43 user nova-compute[74692]:   </sysinfo>
Nov 18 18:28:43 user nova-compute[74692]:   <os>
Nov 18 18:28:43 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:28:43 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:28:43 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:28:43 user nova-compute[74692]:   </os>
Nov 18 18:28:43 user nova-compute[74692]:   <features>
Nov 18 18:28:43 user nova-compute[74692]:     <acpi/>
Nov 18 18:28:43 user nova-compute[74692]:     <apic/>
Nov 18 18:28:43 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:28:43 user nova-compute[74692]:   </features>
Nov 18 18:28:43 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:28:43 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:28:43 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:28:43 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:28:43 user nova-compute[74692]:   </clock>
Nov 18 18:28:43 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:28:43 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:28:43 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:28:43 user nova-compute[74692]:   </cpu>
Nov 18 18:28:43 user nova-compute[74692]:   <devices>
Nov 18 18:28:43 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:28:43 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:28:43 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk"/>
Nov 18 18:28:43 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:28:43 user nova-compute[74692]:     </disk>
Nov 18 18:28:43 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:28:43 user nova-compute[74692]:       <mac address="fa:16:3e:1c:ef:47"/>
Nov 18 18:28:43 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:28:43 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:28:43 user nova-compute[74692]:       <target dev="tap11c1b5b3-4d"/>
Nov 18 18:28:43 user nova-compute[74692]:     </interface>
Nov 18 18:28:43 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:28:43 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/console.log" append="off"/>
Nov 18 18:28:43 user nova-compute[74692]:     </serial>
Nov 18 18:28:43 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:28:43 user nova-compute[74692]:     <video>
Nov 18 18:28:43 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:28:43 user nova-compute[74692]:     </video>
Nov 18 18:28:43 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:28:43 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:28:43 user nova-compute[74692]:     </rng>
Nov 18 18:28:43 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:28:43 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:28:43 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:28:43 user nova-compute[74692]:     </memballoon>
Nov 18 18:28:43 user nova-compute[74692]:   </devices>
Nov 18 18:28:43 user nova-compute[74692]: </domain>
Nov 18 18:28:43 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-249703929',display_name='tempest-TestVolumeSwap-server-249703929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-249703929',id=4,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQ7ErB8zROeG+FGRKKvlR1IkYXszX5weiDoTQKIhfh4EXQdCxcRtkr8WfKfna809njSowyZfpj3fDwytT1EfqSL6kmSNh1FuyPnTDPu/UsR3ulvIFAENerxWH8sm/2x2w==',key_name='tempest-keypair-376439620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ac758bb60347ad8ea3b4f2bf9292cf',ramdisk_id='',reservation_id='r-prbtc42f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-553284986',owner_user_name='tempest-TestVolumeSwap-553284986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:28:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4c515db29f14ce1a90391bc0c05cb05',uuid=d17447e1-2e91-4d25-bf3a-3705927ec122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "address": "fa:16:3e:1c:ef:47", "network": {"id": "dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1097989855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ac758bb60347ad8ea3b4f2bf9292cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c1b5b3-4d", "ovs_interfaceid": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Converting VIF {"id": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "address": "fa:16:3e:1c:ef:47", "network": {"id": "dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1097989855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ac758bb60347ad8ea3b4f2bf9292cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c1b5b3-4d", "ovs_interfaceid": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ef:47,bridge_name='br-int',has_traffic_filtering=True,id=11c1b5b3-4d09-4461-9d7f-d879f706805c,network=Network(dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c1b5b3-4d') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG os_vif [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ef:47,bridge_name='br-int',has_traffic_filtering=True,id=11c1b5b3-4d09-4461-9d7f-d879f706805c,network=Network(dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c1b5b3-4d') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef30861a-a3cf-5358-be30-01664dd20ac5', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11c1b5b3-4d, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11c1b5b3-4d, col_values=(('qos', UUID('19392b63-814c-4a5b-9f16-f2a749fb0b48')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11c1b5b3-4d, col_values=(('external_ids', {'iface-id': '11c1b5b3-4d09-4461-9d7f-d879f706805c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:ef:47', 'vm-uuid': 'd17447e1-2e91-4d25-bf3a-3705927ec122'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:28:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:44 user nova-compute[74692]: INFO os_vif [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ef:47,bridge_name='br-int',has_traffic_filtering=True,id=11c1b5b3-4d09-4461-9d7f-d879f706805c,network=Network(dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c1b5b3-4d')
Nov 18 18:28:44 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Successfully updated port: 9935070a-ab06-4411-afeb-9039ecbea8bc {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-0738be7d-7688-4f32-a11b-24fa01cd4a9c req-48824502-fb65-4196-b2ca-b9c7556d2517 service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Received event network-vif-plugged-0f17b65c-54ab-45fb-a250-e917fc87ef10 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0738be7d-7688-4f32-a11b-24fa01cd4a9c req-48824502-fb65-4196-b2ca-b9c7556d2517 service nova] Acquiring lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0738be7d-7688-4f32-a11b-24fa01cd4a9c req-48824502-fb65-4196-b2ca-b9c7556d2517 service nova] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0738be7d-7688-4f32-a11b-24fa01cd4a9c req-48824502-fb65-4196-b2ca-b9c7556d2517 service nova] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-0738be7d-7688-4f32-a11b-24fa01cd4a9c req-48824502-fb65-4196-b2ca-b9c7556d2517 service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] No waiting events found dispatching network-vif-plugged-0f17b65c-54ab-45fb-a250-e917fc87ef10 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:28:44 user nova-compute[74692]: WARNING nova.compute.manager [req-0738be7d-7688-4f32-a11b-24fa01cd4a9c req-48824502-fb65-4196-b2ca-b9c7556d2517 service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Received unexpected event network-vif-plugged-0f17b65c-54ab-45fb-a250-e917fc87ef10 for instance with vm_state active and task_state None.
Nov 18 18:28:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquired lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.083s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:28:44 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:28:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] No VIF found with MAC fa:16:3e:1c:ef:47, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:28:44 user nova-compute[74692]: INFO nova.virt.block_device [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Booting with volume a2912de2-b649-4082-bc87-4b46b3981cd0 at /dev/vda
Nov 18 18:28:44 user nova-compute[74692]: DEBUG nova.policy [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0babd17983e74a4792e3c72b70e4298b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '210268bb72854d749ca0e5865b441377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG os_brick.utils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:28:44 user nova-compute[74692]: INFO oslo.privsep.daemon [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmppi3m_fz8/privsep.sock']
Nov 18 18:28:44 user sudo[84784]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmppi3m_fz8/privsep.sock
Nov 18 18:28:44 user sudo[84784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 18 18:28:44 user nova-compute[74692]: DEBUG nova.network.neutron [req-8ce99a92-6073-46ec-9be2-5de0645940bd req-7acf17d5-36e2-4646-8d7c-6ce258106126 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Updated VIF entry in instance network info cache for port 11c1b5b3-4d09-4461-9d7f-d879f706805c. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:28:44 user nova-compute[74692]: DEBUG nova.network.neutron [req-8ce99a92-6073-46ec-9be2-5de0645940bd req-7acf17d5-36e2-4646-8d7c-6ce258106126 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Updating instance_info_cache with network_info: [{"id": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "address": "fa:16:3e:1c:ef:47", "network": {"id": "dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1097989855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ac758bb60347ad8ea3b4f2bf9292cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c1b5b3-4d", "ovs_interfaceid": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ce99a92-6073-46ec-9be2-5de0645940bd req-7acf17d5-36e2-4646-8d7c-6ce258106126 service nova] Releasing lock "refresh_cache-d17447e1-2e91-4d25-bf3a-3705927ec122" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Updating instance_info_cache with network_info: [{"id": "9935070a-ab06-4411-afeb-9039ecbea8bc", "address": "fa:16:3e:a9:05:46", "network": {"id": "da3ff499-fbcd-4f27-bd2a-6f4d23814cc6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1280089118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9935070a-ab", "ovs_interfaceid": "9935070a-ab06-4411-afeb-9039ecbea8bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Releasing lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Instance network_info: |[{"id": "9935070a-ab06-4411-afeb-9039ecbea8bc", "address": "fa:16:3e:a9:05:46", "network": {"id": "da3ff499-fbcd-4f27-bd2a-6f4d23814cc6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1280089118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9935070a-ab", "ovs_interfaceid": "9935070a-ab06-4411-afeb-9039ecbea8bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Start _get_guest_xml network_info=[{"id": "9935070a-ab06-4411-afeb-9039ecbea8bc", "address": "fa:16:3e:a9:05:46", "network": {"id": "da3ff499-fbcd-4f27-bd2a-6f4d23814cc6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1280089118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9935070a-ab", "ovs_interfaceid": "9935070a-ab06-4411-afeb-9039ecbea8bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:28:45 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:45 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-796391196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-796391196',id=5,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3gJO/TwdDSf1yN3ZchrXCyXLk6TezdqH7o7X0wfuK4mUN+34DlZO1554usfJkK2dsoaKwNDHuloE+Z5C2eKZ2s7LsvuKmsXer8Y96AOq7N/zPoRVeXal22WhpetQTiRg==',key_name='tempest-keypair-1001776154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='722ae3b1a66f46c9a0679d562b22e470',ramdisk_id='',reservation_id='r-j9yyn7m1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1784015919',owner_user_name='tempest-TaggedAttachmentsTest-1784015919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:28:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39b207b60dbe460f83bf961a995e5342',uuid=0b9551f1-bc3e-4221-95fc-3b3a4a33251c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9935070a-ab06-4411-afeb-9039ecbea8bc", "address": "fa:16:3e:a9:05:46", "network": {"id": "da3ff499-fbcd-4f27-bd2a-6f4d23814cc6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1280089118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9935070a-ab", "ovs_interfaceid": "9935070a-ab06-4411-afeb-9039ecbea8bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Converting VIF {"id": "9935070a-ab06-4411-afeb-9039ecbea8bc", "address": "fa:16:3e:a9:05:46", "network": {"id": "da3ff499-fbcd-4f27-bd2a-6f4d23814cc6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1280089118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9935070a-ab", "ovs_interfaceid": "9935070a-ab06-4411-afeb-9039ecbea8bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:05:46,bridge_name='br-int',has_traffic_filtering=True,id=9935070a-ab06-4411-afeb-9039ecbea8bc,network=Network(da3ff499-fbcd-4f27-bd2a-6f4d23814cc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9935070a-ab') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.objects.instance [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b9551f1-bc3e-4221-95fc-3b3a4a33251c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:28:45 user nova-compute[74692]:   <uuid>0b9551f1-bc3e-4221-95fc-3b3a4a33251c</uuid>
Nov 18 18:28:45 user nova-compute[74692]:   <name>instance-00000005</name>
Nov 18 18:28:45 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:28:45 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:28:45 user nova-compute[74692]:   <metadata>
Nov 18 18:28:45 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:28:45 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:28:45 user nova-compute[74692]:       <nova:name>tempest-device-tagging-server-796391196</nova:name>
Nov 18 18:28:45 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:28:45</nova:creationTime>
Nov 18 18:28:45 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:28:45 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:28:45 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:28:45 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:28:45 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:28:45 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:28:45 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:28:45 user nova-compute[74692]:       <nova:owner>
Nov 18 18:28:45 user nova-compute[74692]:         <nova:user uuid="39b207b60dbe460f83bf961a995e5342">tempest-TaggedAttachmentsTest-1784015919-project-member</nova:user>
Nov 18 18:28:45 user nova-compute[74692]:         <nova:project uuid="722ae3b1a66f46c9a0679d562b22e470">tempest-TaggedAttachmentsTest-1784015919</nova:project>
Nov 18 18:28:45 user nova-compute[74692]:       </nova:owner>
Nov 18 18:28:45 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:28:45 user nova-compute[74692]:       <nova:ports>
Nov 18 18:28:45 user nova-compute[74692]:         <nova:port uuid="9935070a-ab06-4411-afeb-9039ecbea8bc">
Nov 18 18:28:45 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 18:28:45 user nova-compute[74692]:         </nova:port>
Nov 18 18:28:45 user nova-compute[74692]:       </nova:ports>
Nov 18 18:28:45 user nova-compute[74692]:     </nova:instance>
Nov 18 18:28:45 user nova-compute[74692]:   </metadata>
Nov 18 18:28:45 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:28:45 user nova-compute[74692]:     <system>
Nov 18 18:28:45 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:28:45 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:28:45 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:28:45 user nova-compute[74692]:       <entry name="serial">0b9551f1-bc3e-4221-95fc-3b3a4a33251c</entry>
Nov 18 18:28:45 user nova-compute[74692]:       <entry name="uuid">0b9551f1-bc3e-4221-95fc-3b3a4a33251c</entry>
Nov 18 18:28:45 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:28:45 user nova-compute[74692]:     </system>
Nov 18 18:28:45 user nova-compute[74692]:   </sysinfo>
Nov 18 18:28:45 user nova-compute[74692]:   <os>
Nov 18 18:28:45 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:28:45 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:28:45 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:28:45 user nova-compute[74692]:   </os>
Nov 18 18:28:45 user nova-compute[74692]:   <features>
Nov 18 18:28:45 user nova-compute[74692]:     <acpi/>
Nov 18 18:28:45 user nova-compute[74692]:     <apic/>
Nov 18 18:28:45 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:28:45 user nova-compute[74692]:   </features>
Nov 18 18:28:45 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:28:45 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:28:45 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:28:45 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:28:45 user nova-compute[74692]:   </clock>
Nov 18 18:28:45 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:28:45 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:28:45 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:28:45 user nova-compute[74692]:   </cpu>
Nov 18 18:28:45 user nova-compute[74692]:   <devices>
Nov 18 18:28:45 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:28:45 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:28:45 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk"/>
Nov 18 18:28:45 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:28:45 user nova-compute[74692]:     </disk>
Nov 18 18:28:45 user nova-compute[74692]:     <disk type="file" device="cdrom">
Nov 18 18:28:45 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none"/>
Nov 18 18:28:45 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk.config"/>
Nov 18 18:28:45 user nova-compute[74692]:       <target dev="hda" bus="ide"/>
Nov 18 18:28:45 user nova-compute[74692]:     </disk>
Nov 18 18:28:45 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:28:45 user nova-compute[74692]:       <mac address="fa:16:3e:a9:05:46"/>
Nov 18 18:28:45 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:28:45 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:28:45 user nova-compute[74692]:       <target dev="tap9935070a-ab"/>
Nov 18 18:28:45 user nova-compute[74692]:     </interface>
Nov 18 18:28:45 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:28:45 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/console.log" append="off"/>
Nov 18 18:28:45 user nova-compute[74692]:     </serial>
Nov 18 18:28:45 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:28:45 user nova-compute[74692]:     <video>
Nov 18 18:28:45 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:28:45 user nova-compute[74692]:     </video>
Nov 18 18:28:45 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:28:45 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:28:45 user nova-compute[74692]:     </rng>
Nov 18 18:28:45 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:28:45 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:28:45 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:28:45 user nova-compute[74692]:     </memballoon>
Nov 18 18:28:45 user nova-compute[74692]:   </devices>
Nov 18 18:28:45 user nova-compute[74692]: </domain>
Nov 18 18:28:45 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-796391196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-796391196',id=5,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3gJO/TwdDSf1yN3ZchrXCyXLk6TezdqH7o7X0wfuK4mUN+34DlZO1554usfJkK2dsoaKwNDHuloE+Z5C2eKZ2s7LsvuKmsXer8Y96AOq7N/zPoRVeXal22WhpetQTiRg==',key_name='tempest-keypair-1001776154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='722ae3b1a66f46c9a0679d562b22e470',ramdisk_id='',reservation_id='r-j9yyn7m1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1784015919',owner_user_name='tempest-TaggedAttachmentsTest-1784015919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:28:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39b207b60dbe460f83bf961a995e5342',uuid=0b9551f1-bc3e-4221-95fc-3b3a4a33251c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9935070a-ab06-4411-afeb-9039ecbea8bc", "address": "fa:16:3e:a9:05:46", "network": {"id": "da3ff499-fbcd-4f27-bd2a-6f4d23814cc6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1280089118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9935070a-ab", "ovs_interfaceid": "9935070a-ab06-4411-afeb-9039ecbea8bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Converting VIF {"id": "9935070a-ab06-4411-afeb-9039ecbea8bc", "address": "fa:16:3e:a9:05:46", "network": {"id": "da3ff499-fbcd-4f27-bd2a-6f4d23814cc6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1280089118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9935070a-ab", "ovs_interfaceid": "9935070a-ab06-4411-afeb-9039ecbea8bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:05:46,bridge_name='br-int',has_traffic_filtering=True,id=9935070a-ab06-4411-afeb-9039ecbea8bc,network=Network(da3ff499-fbcd-4f27-bd2a-6f4d23814cc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9935070a-ab') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG os_vif [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:05:46,bridge_name='br-int',has_traffic_filtering=True,id=9935070a-ab06-4411-afeb-9039ecbea8bc,network=Network(da3ff499-fbcd-4f27-bd2a-6f4d23814cc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9935070a-ab') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbd40435-2a33-5f86-bdd8-d137d17a6562', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9935070a-ab, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9935070a-ab, col_values=(('qos', UUID('a1bbc12f-7ac9-4e81-b39d-5078c138b5bb')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9935070a-ab, col_values=(('external_ids', {'iface-id': '9935070a-ab06-4411-afeb-9039ecbea8bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:05:46', 'vm-uuid': '0b9551f1-bc3e-4221-95fc-3b3a4a33251c'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:45 user nova-compute[74692]: INFO os_vif [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:05:46,bridge_name='br-int',has_traffic_filtering=True,id=9935070a-ab06-4411-afeb-9039ecbea8bc,network=Network(da3ff499-fbcd-4f27-bd2a-6f4d23814cc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9935070a-ab')
Nov 18 18:28:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-ffd31edb-c6a1-4cfc-aba2-4abeac986384 req-1155d3b1-10be-48a8-874c-07af0bfb5bb1 service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Received event network-vif-plugged-0f17b65c-54ab-45fb-a250-e917fc87ef10 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ffd31edb-c6a1-4cfc-aba2-4abeac986384 req-1155d3b1-10be-48a8-874c-07af0bfb5bb1 service nova] Acquiring lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ffd31edb-c6a1-4cfc-aba2-4abeac986384 req-1155d3b1-10be-48a8-874c-07af0bfb5bb1 service nova] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ffd31edb-c6a1-4cfc-aba2-4abeac986384 req-1155d3b1-10be-48a8-874c-07af0bfb5bb1 service nova] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-ffd31edb-c6a1-4cfc-aba2-4abeac986384 req-1155d3b1-10be-48a8-874c-07af0bfb5bb1 service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] No waiting events found dispatching network-vif-plugged-0f17b65c-54ab-45fb-a250-e917fc87ef10 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:28:46 user nova-compute[74692]: WARNING nova.compute.manager [req-ffd31edb-c6a1-4cfc-aba2-4abeac986384 req-1155d3b1-10be-48a8-874c-07af0bfb5bb1 service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Received unexpected event network-vif-plugged-0f17b65c-54ab-45fb-a250-e917fc87ef10 for instance with vm_state active and task_state None.
Nov 18 18:28:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-ffd31edb-c6a1-4cfc-aba2-4abeac986384 req-1155d3b1-10be-48a8-874c-07af0bfb5bb1 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received event network-changed-9935070a-ab06-4411-afeb-9039ecbea8bc {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-ffd31edb-c6a1-4cfc-aba2-4abeac986384 req-1155d3b1-10be-48a8-874c-07af0bfb5bb1 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Refreshing instance network info cache due to event network-changed-9935070a-ab06-4411-afeb-9039ecbea8bc. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ffd31edb-c6a1-4cfc-aba2-4abeac986384 req-1155d3b1-10be-48a8-874c-07af0bfb5bb1 service nova] Acquiring lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ffd31edb-c6a1-4cfc-aba2-4abeac986384 req-1155d3b1-10be-48a8-874c-07af0bfb5bb1 service nova] Acquired lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG nova.network.neutron [req-ffd31edb-c6a1-4cfc-aba2-4abeac986384 req-1155d3b1-10be-48a8-874c-07af0bfb5bb1 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Refreshing network info cache for port 9935070a-ab06-4411-afeb-9039ecbea8bc {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] No BDM found with device name hda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] No VIF found with MAC fa:16:3e:a9:05:46, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:28:46 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Using config drive
Nov 18 18:28:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:46 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Creating config drive at /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk.config
Nov 18 18:28:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcl200dj1 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Successfully created port: 9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcl200dj1" returned: 0 in 0.080s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG nova.network.neutron [req-ffd31edb-c6a1-4cfc-aba2-4abeac986384 req-1155d3b1-10be-48a8-874c-07af0bfb5bb1 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Updated VIF entry in instance network info cache for port 9935070a-ab06-4411-afeb-9039ecbea8bc. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG nova.network.neutron [req-ffd31edb-c6a1-4cfc-aba2-4abeac986384 req-1155d3b1-10be-48a8-874c-07af0bfb5bb1 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Updating instance_info_cache with network_info: [{"id": "9935070a-ab06-4411-afeb-9039ecbea8bc", "address": "fa:16:3e:a9:05:46", "network": {"id": "da3ff499-fbcd-4f27-bd2a-6f4d23814cc6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1280089118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9935070a-ab", "ovs_interfaceid": "9935070a-ab06-4411-afeb-9039ecbea8bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ffd31edb-c6a1-4cfc-aba2-4abeac986384 req-1155d3b1-10be-48a8-874c-07af0bfb5bb1 service nova] Releasing lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:47 user sudo[84784]: pam_unix(sudo:session): session closed for user root
Nov 18 18:28:47 user nova-compute[74692]: INFO oslo.privsep.daemon [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Spawned new privsep daemon via rootwrap
Nov 18 18:28:47 user nova-compute[74692]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 18 18:28:47 user nova-compute[74692]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 18 18:28:47 user nova-compute[74692]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 18 18:28:47 user nova-compute[74692]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84932
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c667c403-0ad5-4808-8071-70dba90cbbae]: (2,) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[78de0690-f778-4396-8723-906965a2dc97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:47 user nova-compute[74692]: WARNING os_brick.initiator.connectors.nvmeof [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8a8c2f-ba15-4568-8a2f-e0c1938ffd0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e8d696-1e69-4421-ac64-d7bdb71e7d4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd1f6d0-22fb-4feb-8e46-5285c2153d81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:28:47 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2848eba7-e8d6-4d25-b03f-a106dbcf4e57]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG os_brick.utils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] <== get_connector_properties: return (2795ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Updating existing volume attachment record: f2326f72-4c63-430e-ad6b-cf7dc9bfdef2 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Successfully updated port: 9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Acquiring lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "refresh_cache-76506747-4a6b-40bd-b812-bf114be5e8b4" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquired lock "refresh_cache-76506747-4a6b-40bd-b812-bf114be5e8b4" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:48 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:28:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:48 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:28:48 user nova-compute[74692]: INFO nova.compute.claims [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Claim successful on node user
Nov 18 18:28:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-8f7aab07-6ebc-4800-8e96-47b74bea0af1 req-aff4e7ae-d975-4e46-9f12-1de440b37aac service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received event network-changed-9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-8f7aab07-6ebc-4800-8e96-47b74bea0af1 req-aff4e7ae-d975-4e46-9f12-1de440b37aac service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Refreshing instance network info cache due to event network-changed-9ba43cb0-30b9-43ae-8f81-3df420497fff. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:28:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8f7aab07-6ebc-4800-8e96-47b74bea0af1 req-aff4e7ae-d975-4e46-9f12-1de440b37aac service nova] Acquiring lock "refresh_cache-76506747-4a6b-40bd-b812-bf114be5e8b4" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:28:48 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:28:48 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:28:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.716s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:48 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:28:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:48 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Updating instance_info_cache with network_info: [{"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Releasing lock "refresh_cache-76506747-4a6b-40bd-b812-bf114be5e8b4" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Instance network_info: |[{"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8f7aab07-6ebc-4800-8e96-47b74bea0af1 req-aff4e7ae-d975-4e46-9f12-1de440b37aac service nova] Acquired lock "refresh_cache-76506747-4a6b-40bd-b812-bf114be5e8b4" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG nova.network.neutron [req-8f7aab07-6ebc-4800-8e96-47b74bea0af1 req-aff4e7ae-d975-4e46-9f12-1de440b37aac service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Refreshing network info cache for port 9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG nova.network.neutron [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:28:49 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:28:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG nova.policy [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9c96bec473f4f869266a850ec3d2540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e80926040f74a899bc7af0af8cc7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:28:49 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Creating image(s)
Nov 18 18:28:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Acquiring lock "/opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "/opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "/opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.190s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.207s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:28:49 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Instance spawned successfully.
Nov 18 18:28:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk 1073741824" returned: 0 in 0.121s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:50 user nova-compute[74692]: INFO nova.compute.manager [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Took 13.02 seconds to spawn the instance on the hypervisor.
Nov 18 18:28:50 user nova-compute[74692]: DEBUG nova.compute.manager [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.260s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:50 user nova-compute[74692]: INFO nova.compute.manager [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Took 14.22 seconds to build instance.
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-769753bc-68a6-4eae-ac70-f0db30729307 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.386s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Cannot resize image /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Ensure instance console log exists: /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG nova.network.neutron [req-8f7aab07-6ebc-4800-8e96-47b74bea0af1 req-aff4e7ae-d975-4e46-9f12-1de440b37aac service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Updated VIF entry in instance network info cache for port 9ba43cb0-30b9-43ae-8f81-3df420497fff. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG nova.network.neutron [req-8f7aab07-6ebc-4800-8e96-47b74bea0af1 req-aff4e7ae-d975-4e46-9f12-1de440b37aac service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Updating instance_info_cache with network_info: [{"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8f7aab07-6ebc-4800-8e96-47b74bea0af1 req-aff4e7ae-d975-4e46-9f12-1de440b37aac service nova] Releasing lock "refresh_cache-76506747-4a6b-40bd-b812-bf114be5e8b4" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received event network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] Acquiring lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] No waiting events found dispatching network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:28:50 user nova-compute[74692]: WARNING nova.compute.manager [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received unexpected event network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 for instance with vm_state active and task_state None.
Nov 18 18:28:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received event network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] Acquiring lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] No waiting events found dispatching network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:28:50 user nova-compute[74692]: WARNING nova.compute.manager [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received unexpected event network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 for instance with vm_state active and task_state None.
Nov 18 18:28:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Received event network-vif-plugged-c79b925e-78c4-4334-a547-9294f9b4c8fe {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] Acquiring lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] No waiting events found dispatching network-vif-plugged-c79b925e-78c4-4334-a547-9294f9b4c8fe {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:28:50 user nova-compute[74692]: WARNING nova.compute.manager [req-58f959e6-3be6-4c78-a265-0dded5a4c0d3 req-59f0c164-b671-44b7-960c-4ec9997510da service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Received unexpected event network-vif-plugged-c79b925e-78c4-4334-a547-9294f9b4c8fe for instance with vm_state active and task_state None.
Nov 18 18:28:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:28:51 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Instance spawned successfully.
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:28:51 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Instance spawned successfully.
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:28:51 user nova-compute[74692]: INFO nova.compute.manager [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Took 12.02 seconds to spawn the instance on the hypervisor.
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.network.neutron [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Successfully created port: aec7a2cf-bc00-43f3-819b-fc6e0471448f {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:28:51 user nova-compute[74692]: INFO nova.compute.manager [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Took 13.90 seconds to build instance.
Nov 18 18:28:51 user nova-compute[74692]: INFO nova.compute.manager [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Took 11.52 seconds to spawn the instance on the hypervisor.
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4c27e71-f10f-45f0-b203-92d06bb562f0 tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.116s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-139355c9-0fd5-4a1b-9b8b-5fd9b46ebcac req-d7c1cdbf-be6d-43e5-b49d-fee3b697823f service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Received event network-vif-plugged-11c1b5b3-4d09-4461-9d7f-d879f706805c {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-139355c9-0fd5-4a1b-9b8b-5fd9b46ebcac req-d7c1cdbf-be6d-43e5-b49d-fee3b697823f service nova] Acquiring lock "d17447e1-2e91-4d25-bf3a-3705927ec122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-139355c9-0fd5-4a1b-9b8b-5fd9b46ebcac req-d7c1cdbf-be6d-43e5-b49d-fee3b697823f service nova] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-139355c9-0fd5-4a1b-9b8b-5fd9b46ebcac req-d7c1cdbf-be6d-43e5-b49d-fee3b697823f service nova] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-139355c9-0fd5-4a1b-9b8b-5fd9b46ebcac req-d7c1cdbf-be6d-43e5-b49d-fee3b697823f service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] No waiting events found dispatching network-vif-plugged-11c1b5b3-4d09-4461-9d7f-d879f706805c {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:28:51 user nova-compute[74692]: WARNING nova.compute.manager [req-139355c9-0fd5-4a1b-9b8b-5fd9b46ebcac req-d7c1cdbf-be6d-43e5-b49d-fee3b697823f service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Received unexpected event network-vif-plugged-11c1b5b3-4d09-4461-9d7f-d879f706805c for instance with vm_state active and task_state None.
Nov 18 18:28:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:51 user nova-compute[74692]: INFO nova.compute.manager [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Took 14.01 seconds to build instance.
Nov 18 18:28:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9f2c16e6-3cd7-4fcb-a1fc-a800fd10e059 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.210s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Received event network-vif-plugged-c79b925e-78c4-4334-a547-9294f9b4c8fe {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] Acquiring lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] No waiting events found dispatching network-vif-plugged-c79b925e-78c4-4334-a547-9294f9b4c8fe {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:28:52 user nova-compute[74692]: WARNING nova.compute.manager [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Received unexpected event network-vif-plugged-c79b925e-78c4-4334-a547-9294f9b4c8fe for instance with vm_state active and task_state None.
Nov 18 18:28:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received event network-vif-plugged-9935070a-ab06-4411-afeb-9039ecbea8bc {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] Acquiring lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] No waiting events found dispatching network-vif-plugged-9935070a-ab06-4411-afeb-9039ecbea8bc {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:28:52 user nova-compute[74692]: WARNING nova.compute.manager [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received unexpected event network-vif-plugged-9935070a-ab06-4411-afeb-9039ecbea8bc for instance with vm_state active and task_state None.
Nov 18 18:28:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received event network-vif-plugged-9935070a-ab06-4411-afeb-9039ecbea8bc {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] Acquiring lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] No waiting events found dispatching network-vif-plugged-9935070a-ab06-4411-afeb-9039ecbea8bc {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:28:52 user nova-compute[74692]: WARNING nova.compute.manager [req-1cde261f-3ed8-4bc0-bca5-5d6f8842a3ca req-510aa06d-3386-4146-8985-b5b9dab1313b service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received unexpected event network-vif-plugged-9935070a-ab06-4411-afeb-9039ecbea8bc for instance with vm_state active and task_state None.
Nov 18 18:28:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:53 user nova-compute[74692]: DEBUG nova.compute.manager [req-b8884f09-2ff0-49ea-8923-32266fad962f req-b8929e37-ba1b-4c10-a8dd-6463cf5cbe67 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Received event network-vif-plugged-11c1b5b3-4d09-4461-9d7f-d879f706805c {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b8884f09-2ff0-49ea-8923-32266fad962f req-b8929e37-ba1b-4c10-a8dd-6463cf5cbe67 service nova] Acquiring lock "d17447e1-2e91-4d25-bf3a-3705927ec122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b8884f09-2ff0-49ea-8923-32266fad962f req-b8929e37-ba1b-4c10-a8dd-6463cf5cbe67 service nova] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b8884f09-2ff0-49ea-8923-32266fad962f req-b8929e37-ba1b-4c10-a8dd-6463cf5cbe67 service nova] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:54 user nova-compute[74692]: DEBUG nova.compute.manager [req-b8884f09-2ff0-49ea-8923-32266fad962f req-b8929e37-ba1b-4c10-a8dd-6463cf5cbe67 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] No waiting events found dispatching network-vif-plugged-11c1b5b3-4d09-4461-9d7f-d879f706805c {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:28:54 user nova-compute[74692]: WARNING nova.compute.manager [req-b8884f09-2ff0-49ea-8923-32266fad962f req-b8929e37-ba1b-4c10-a8dd-6463cf5cbe67 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Received unexpected event network-vif-plugged-11c1b5b3-4d09-4461-9d7f-d879f706805c for instance with vm_state active and task_state None.
Nov 18 18:28:54 user nova-compute[74692]: DEBUG nova.network.neutron [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Successfully updated port: aec7a2cf-bc00-43f3-819b-fc6e0471448f {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:28:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Acquiring lock "refresh_cache-d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:28:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Acquired lock "refresh_cache-d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:28:54 user nova-compute[74692]: DEBUG nova.network.neutron [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:28:54 user nova-compute[74692]: DEBUG nova.network.neutron [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.network.neutron [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Updating instance_info_cache with network_info: [{"id": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "address": "fa:16:3e:7b:25:65", "network": {"id": "5181b213-08d4-4a73-9a77-cbf83dea1a3e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1859216473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e80926040f74a899bc7af0af8cc7343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec7a2cf-bc", "ovs_interfaceid": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Releasing lock "refresh_cache-d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Instance network_info: |[{"id": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "address": "fa:16:3e:7b:25:65", "network": {"id": "5181b213-08d4-4a73-9a77-cbf83dea1a3e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1859216473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e80926040f74a899bc7af0af8cc7343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec7a2cf-bc", "ovs_interfaceid": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Start _get_guest_xml network_info=[{"id": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "address": "fa:16:3e:7b:25:65", "network": {"id": "5181b213-08d4-4a73-9a77-cbf83dea1a3e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1859216473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e80926040f74a899bc7af0af8cc7343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec7a2cf-bc", "ovs_interfaceid": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:28:55 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:55 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1422328198',display_name='tempest-VolumesAssistedSnapshotsTest-server-1422328198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1422328198',id=7,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIelp7JxZL/0NC/EGjKtpX3EI8hNRLPBHY6vu24bc3biA1FUP8nO3qOLw9lq8pK2pKhhYDTkjczFaPE6byX1WWRCjcs54Ij9Lc49mORhI4Zzzq7Ah2baur6YUOibdk3Nw==',key_name='tempest-keypair-1324152243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e80926040f74a899bc7af0af8cc7343',ramdisk_id='',reservation_id='r-uiiiaw0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1853371017',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1853371017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:28:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9c96bec473f4f869266a850ec3d2540',uuid=d40a1c6a-a5c1-46ff-ae2f-70819a1903b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "address": "fa:16:3e:7b:25:65", "network": {"id": "5181b213-08d4-4a73-9a77-cbf83dea1a3e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1859216473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e80926040f74a899bc7af0af8cc7343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec7a2cf-bc", "ovs_interfaceid": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Converting VIF {"id": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "address": "fa:16:3e:7b:25:65", "network": {"id": "5181b213-08d4-4a73-9a77-cbf83dea1a3e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1859216473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e80926040f74a899bc7af0af8cc7343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec7a2cf-bc", "ovs_interfaceid": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:25:65,bridge_name='br-int',has_traffic_filtering=True,id=aec7a2cf-bc00-43f3-819b-fc6e0471448f,network=Network(5181b213-08d4-4a73-9a77-cbf83dea1a3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaec7a2cf-bc') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.objects.instance [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lazy-loading 'pci_devices' on Instance uuid d40a1c6a-a5c1-46ff-ae2f-70819a1903b0 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:28:55 user nova-compute[74692]:   <uuid>d40a1c6a-a5c1-46ff-ae2f-70819a1903b0</uuid>
Nov 18 18:28:55 user nova-compute[74692]:   <name>instance-00000007</name>
Nov 18 18:28:55 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:28:55 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:28:55 user nova-compute[74692]:   <metadata>
Nov 18 18:28:55 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:28:55 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:28:55 user nova-compute[74692]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1422328198</nova:name>
Nov 18 18:28:55 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:28:55</nova:creationTime>
Nov 18 18:28:55 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:28:55 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:28:55 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:28:55 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:28:55 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:28:55 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:28:55 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:28:55 user nova-compute[74692]:       <nova:owner>
Nov 18 18:28:55 user nova-compute[74692]:         <nova:user uuid="e9c96bec473f4f869266a850ec3d2540">tempest-VolumesAssistedSnapshotsTest-1853371017-project-member</nova:user>
Nov 18 18:28:55 user nova-compute[74692]:         <nova:project uuid="5e80926040f74a899bc7af0af8cc7343">tempest-VolumesAssistedSnapshotsTest-1853371017</nova:project>
Nov 18 18:28:55 user nova-compute[74692]:       </nova:owner>
Nov 18 18:28:55 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:28:55 user nova-compute[74692]:       <nova:ports>
Nov 18 18:28:55 user nova-compute[74692]:         <nova:port uuid="aec7a2cf-bc00-43f3-819b-fc6e0471448f">
Nov 18 18:28:55 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 18:28:55 user nova-compute[74692]:         </nova:port>
Nov 18 18:28:55 user nova-compute[74692]:       </nova:ports>
Nov 18 18:28:55 user nova-compute[74692]:     </nova:instance>
Nov 18 18:28:55 user nova-compute[74692]:   </metadata>
Nov 18 18:28:55 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:28:55 user nova-compute[74692]:     <system>
Nov 18 18:28:55 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:28:55 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:28:55 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:28:55 user nova-compute[74692]:       <entry name="serial">d40a1c6a-a5c1-46ff-ae2f-70819a1903b0</entry>
Nov 18 18:28:55 user nova-compute[74692]:       <entry name="uuid">d40a1c6a-a5c1-46ff-ae2f-70819a1903b0</entry>
Nov 18 18:28:55 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:28:55 user nova-compute[74692]:     </system>
Nov 18 18:28:55 user nova-compute[74692]:   </sysinfo>
Nov 18 18:28:55 user nova-compute[74692]:   <os>
Nov 18 18:28:55 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:28:55 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:28:55 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:28:55 user nova-compute[74692]:   </os>
Nov 18 18:28:55 user nova-compute[74692]:   <features>
Nov 18 18:28:55 user nova-compute[74692]:     <acpi/>
Nov 18 18:28:55 user nova-compute[74692]:     <apic/>
Nov 18 18:28:55 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:28:55 user nova-compute[74692]:   </features>
Nov 18 18:28:55 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:28:55 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:28:55 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:28:55 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:28:55 user nova-compute[74692]:   </clock>
Nov 18 18:28:55 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:28:55 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:28:55 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:28:55 user nova-compute[74692]:   </cpu>
Nov 18 18:28:55 user nova-compute[74692]:   <devices>
Nov 18 18:28:55 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:28:55 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:28:55 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk"/>
Nov 18 18:28:55 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:28:55 user nova-compute[74692]:     </disk>
Nov 18 18:28:55 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:28:55 user nova-compute[74692]:       <mac address="fa:16:3e:7b:25:65"/>
Nov 18 18:28:55 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:28:55 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:28:55 user nova-compute[74692]:       <target dev="tapaec7a2cf-bc"/>
Nov 18 18:28:55 user nova-compute[74692]:     </interface>
Nov 18 18:28:55 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:28:55 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/console.log" append="off"/>
Nov 18 18:28:55 user nova-compute[74692]:     </serial>
Nov 18 18:28:55 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:28:55 user nova-compute[74692]:     <video>
Nov 18 18:28:55 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:28:55 user nova-compute[74692]:     </video>
Nov 18 18:28:55 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:28:55 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:28:55 user nova-compute[74692]:     </rng>
Nov 18 18:28:55 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:28:55 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:28:55 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:28:55 user nova-compute[74692]:     </memballoon>
Nov 18 18:28:55 user nova-compute[74692]:   </devices>
Nov 18 18:28:55 user nova-compute[74692]: </domain>
Nov 18 18:28:55 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1422328198',display_name='tempest-VolumesAssistedSnapshotsTest-server-1422328198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1422328198',id=7,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIelp7JxZL/0NC/EGjKtpX3EI8hNRLPBHY6vu24bc3biA1FUP8nO3qOLw9lq8pK2pKhhYDTkjczFaPE6byX1WWRCjcs54Ij9Lc49mORhI4Zzzq7Ah2baur6YUOibdk3Nw==',key_name='tempest-keypair-1324152243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e80926040f74a899bc7af0af8cc7343',ramdisk_id='',reservation_id='r-uiiiaw0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1853371017',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1853371017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:28:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9c96bec473f4f869266a850ec3d2540',uuid=d40a1c6a-a5c1-46ff-ae2f-70819a1903b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "address": "fa:16:3e:7b:25:65", "network": {"id": "5181b213-08d4-4a73-9a77-cbf83dea1a3e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1859216473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e80926040f74a899bc7af0af8cc7343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec7a2cf-bc", "ovs_interfaceid": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Converting VIF {"id": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "address": "fa:16:3e:7b:25:65", "network": {"id": "5181b213-08d4-4a73-9a77-cbf83dea1a3e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1859216473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e80926040f74a899bc7af0af8cc7343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec7a2cf-bc", "ovs_interfaceid": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:25:65,bridge_name='br-int',has_traffic_filtering=True,id=aec7a2cf-bc00-43f3-819b-fc6e0471448f,network=Network(5181b213-08d4-4a73-9a77-cbf83dea1a3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaec7a2cf-bc') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG os_vif [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:25:65,bridge_name='br-int',has_traffic_filtering=True,id=aec7a2cf-bc00-43f3-819b-fc6e0471448f,network=Network(5181b213-08d4-4a73-9a77-cbf83dea1a3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaec7a2cf-bc') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cb984fc-4224-52d9-a7d6-c3b29f405bb1', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaec7a2cf-bc, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaec7a2cf-bc, col_values=(('qos', UUID('014b016f-4359-48c6-bb64-8c56dd6853eb')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaec7a2cf-bc, col_values=(('external_ids', {'iface-id': 'aec7a2cf-bc00-43f3-819b-fc6e0471448f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:25:65', 'vm-uuid': 'd40a1c6a-a5c1-46ff-ae2f-70819a1903b0'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:55 user nova-compute[74692]: INFO os_vif [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:25:65,bridge_name='br-int',has_traffic_filtering=True,id=aec7a2cf-bc00-43f3-819b-fc6e0471448f,network=Network(5181b213-08d4-4a73-9a77-cbf83dea1a3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaec7a2cf-bc')
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:28:55 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Creating image(s)
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Ensure instance console log exists: /opt/stack/data/nova/instances/76506747-4a6b-40bd-b812-bf114be5e8b4/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Start _get_guest_xml network_info=[{"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqQgpinc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '76506747-4a6b-40bd-b812-bf114be5e8b4', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2912de2-b649-4082-bc87-4b46b3981cd0', 'serial': 'a2912de2-b649-4082-bc87-4b46b3981cd0'}, 'attachment_id': 'f2326f72-4c63-430e-ad6b-cf7dc9bfdef2', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:28:55 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:55 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG os_brick.initiator.connector [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Factory for ISCSI on None {{(pid=74692) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqQgpinc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:28:55 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:28:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:28:55 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:28:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:28:55 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] No VIF found with MAC fa:16:3e:7b:25:65, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5107aba7-71e1-46fa-974b-17d7dc11b1f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:28:55 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[689e8e0d-24ef-4dc6-9247-dceec003e92e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0] added
Nov 18 18:28:55 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05a12d2-8ffc-42ef-b1ce-5298369401a3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd100a9-edf1-4653-b8bf-2d39f06c73d0]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqQgpinc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqQgpinc" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7591134e-1ef8-4710-b413-864d592af41a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kqQgpinc'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.043s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6b3f1e-0a77-4f9e-b070-e06e491940a3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5564b6-ffd5-474a-b914-c5b56056d4a3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 18:28:55 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:28:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 18:28:55 user nova-compute[74692]:  {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:28:55 user nova-compute[74692]: WARNING os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 18:28:55 user nova-compute[74692]: 
Nov 18 18:28:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[294ae227-deca-4170-a9ab-02050faa1c5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260]
Nov 18 18:28:56 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260] successful.
Nov 18 18:28:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9252261e-d79f-42bf-aa49-68a1296835b9]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27c5c03-b92d-4e6f-a5e4-9d0ef5e28ca4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:28:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:28:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27661f2-7d24-4f6b-9065-78541cb8689b]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqQgpinc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG nova.compute.manager [req-5c024cc1-f321-43e7-859d-885f49a9e7bb req-54a5addf-fd21-49f5-9bc8-05c94bf81d64 service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Received event network-changed-aec7a2cf-bc00-43f3-819b-fc6e0471448f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG nova.compute.manager [req-5c024cc1-f321-43e7-859d-885f49a9e7bb req-54a5addf-fd21-49f5-9bc8-05c94bf81d64 service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Refreshing instance network info cache due to event network-changed-aec7a2cf-bc00-43f3-819b-fc6e0471448f. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5c024cc1-f321-43e7-859d-885f49a9e7bb req-54a5addf-fd21-49f5-9bc8-05c94bf81d64 service nova] Acquiring lock "refresh_cache-d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5c024cc1-f321-43e7-859d-885f49a9e7bb req-54a5addf-fd21-49f5-9bc8-05c94bf81d64 service nova] Acquired lock "refresh_cache-d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG nova.network.neutron [req-5c024cc1-f321-43e7-859d-885f49a9e7bb req-54a5addf-fd21-49f5-9bc8-05c94bf81d64 service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Refreshing network info cache for port aec7a2cf-bc00-43f3-819b-fc6e0471448f {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:28:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG nova.network.neutron [req-5c024cc1-f321-43e7-859d-885f49a9e7bb req-54a5addf-fd21-49f5-9bc8-05c94bf81d64 service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Updated VIF entry in instance network info cache for port aec7a2cf-bc00-43f3-819b-fc6e0471448f. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG nova.network.neutron [req-5c024cc1-f321-43e7-859d-885f49a9e7bb req-54a5addf-fd21-49f5-9bc8-05c94bf81d64 service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Updating instance_info_cache with network_info: [{"id": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "address": "fa:16:3e:7b:25:65", "network": {"id": "5181b213-08d4-4a73-9a77-cbf83dea1a3e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1859216473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e80926040f74a899bc7af0af8cc7343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec7a2cf-bc", "ovs_interfaceid": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '23732306636613337', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732306636613337', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5c024cc1-f321-43e7-859d-885f49a9e7bb req-54a5addf-fd21-49f5-9bc8-05c94bf81d64 service nova] Releasing lock "refresh_cache-d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-626426105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-626426105',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTHSxq3l9P151CfI0F18PIKGxWORN+tyCeI14rp0SJ3N9oq0TLT9ZnzNpxntJM2DuX3cToXTszKRjjVF26/nMLI0+HVGYhPNvxTS05iN12eMktmp14rfpm1F3GFT67jMA==',key_name='tempest-keypair-503198552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='210268bb72854d749ca0e5865b441377',ramdisk_id='',reservation_id='r-0j9378kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-812059553',owner_user_name='tempest-ServerActionsV293TestJSON-812059553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:28:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0babd17983e74a4792e3c72b70e4298b',uuid=76506747-4a6b-40bd-b812-bf114be5e8b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Converting VIF {"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:c2:39,bridge_name='br-int',has_traffic_filtering=True,id=9ba43cb0-30b9-43ae-8f81-3df420497fff,network=Network(9f685a03-85ba-4cab-bccb-8862ef230237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba43cb0-30') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG nova.objects.instance [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lazy-loading 'pci_devices' on Instance uuid 76506747-4a6b-40bd-b812-bf114be5e8b4 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:28:57 user nova-compute[74692]:   <uuid>76506747-4a6b-40bd-b812-bf114be5e8b4</uuid>
Nov 18 18:28:57 user nova-compute[74692]:   <name>instance-00000006</name>
Nov 18 18:28:57 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:28:57 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:28:57 user nova-compute[74692]:   <metadata>
Nov 18 18:28:57 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:28:57 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:28:57 user nova-compute[74692]:       <nova:name>tempest-ServerActionsV293TestJSON-server-626426105</nova:name>
Nov 18 18:28:57 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:28:55</nova:creationTime>
Nov 18 18:28:57 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:28:57 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:28:57 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:28:57 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:28:57 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:28:57 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:28:57 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:28:57 user nova-compute[74692]:       <nova:owner>
Nov 18 18:28:57 user nova-compute[74692]:         <nova:user uuid="0babd17983e74a4792e3c72b70e4298b">tempest-ServerActionsV293TestJSON-812059553-project-member</nova:user>
Nov 18 18:28:57 user nova-compute[74692]:         <nova:project uuid="210268bb72854d749ca0e5865b441377">tempest-ServerActionsV293TestJSON-812059553</nova:project>
Nov 18 18:28:57 user nova-compute[74692]:       </nova:owner>
Nov 18 18:28:57 user nova-compute[74692]:       <nova:ports>
Nov 18 18:28:57 user nova-compute[74692]:         <nova:port uuid="9ba43cb0-30b9-43ae-8f81-3df420497fff">
Nov 18 18:28:57 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 18 18:28:57 user nova-compute[74692]:         </nova:port>
Nov 18 18:28:57 user nova-compute[74692]:       </nova:ports>
Nov 18 18:28:57 user nova-compute[74692]:     </nova:instance>
Nov 18 18:28:57 user nova-compute[74692]:   </metadata>
Nov 18 18:28:57 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:28:57 user nova-compute[74692]:     <system>
Nov 18 18:28:57 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:28:57 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:28:57 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:28:57 user nova-compute[74692]:       <entry name="serial">76506747-4a6b-40bd-b812-bf114be5e8b4</entry>
Nov 18 18:28:57 user nova-compute[74692]:       <entry name="uuid">76506747-4a6b-40bd-b812-bf114be5e8b4</entry>
Nov 18 18:28:57 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:28:57 user nova-compute[74692]:     </system>
Nov 18 18:28:57 user nova-compute[74692]:   </sysinfo>
Nov 18 18:28:57 user nova-compute[74692]:   <os>
Nov 18 18:28:57 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:28:57 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:28:57 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:28:57 user nova-compute[74692]:   </os>
Nov 18 18:28:57 user nova-compute[74692]:   <features>
Nov 18 18:28:57 user nova-compute[74692]:     <acpi/>
Nov 18 18:28:57 user nova-compute[74692]:     <apic/>
Nov 18 18:28:57 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:28:57 user nova-compute[74692]:   </features>
Nov 18 18:28:57 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:28:57 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:28:57 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:28:57 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:28:57 user nova-compute[74692]:   </clock>
Nov 18 18:28:57 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:28:57 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:28:57 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:28:57 user nova-compute[74692]:   </cpu>
Nov 18 18:28:57 user nova-compute[74692]:   <devices>
Nov 18 18:28:57 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:28:57 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:28:57 user nova-compute[74692]:       <source dev="/dev/sdb"/>
Nov 18 18:28:57 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:28:57 user nova-compute[74692]:       <serial>a2912de2-b649-4082-bc87-4b46b3981cd0</serial>
Nov 18 18:28:57 user nova-compute[74692]:     </disk>
Nov 18 18:28:57 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:28:57 user nova-compute[74692]:       <mac address="fa:16:3e:5b:c2:39"/>
Nov 18 18:28:57 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:28:57 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:28:57 user nova-compute[74692]:       <target dev="tap9ba43cb0-30"/>
Nov 18 18:28:57 user nova-compute[74692]:     </interface>
Nov 18 18:28:57 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:28:57 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/76506747-4a6b-40bd-b812-bf114be5e8b4/console.log" append="off"/>
Nov 18 18:28:57 user nova-compute[74692]:     </serial>
Nov 18 18:28:57 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:28:57 user nova-compute[74692]:     <video>
Nov 18 18:28:57 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:28:57 user nova-compute[74692]:     </video>
Nov 18 18:28:57 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:28:57 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:28:57 user nova-compute[74692]:     </rng>
Nov 18 18:28:57 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:28:57 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:28:57 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:28:57 user nova-compute[74692]:     </memballoon>
Nov 18 18:28:57 user nova-compute[74692]:   </devices>
Nov 18 18:28:57 user nova-compute[74692]: </domain>
Nov 18 18:28:57 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-626426105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-626426105',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTHSxq3l9P151CfI0F18PIKGxWORN+tyCeI14rp0SJ3N9oq0TLT9ZnzNpxntJM2DuX3cToXTszKRjjVF26/nMLI0+HVGYhPNvxTS05iN12eMktmp14rfpm1F3GFT67jMA==',key_name='tempest-keypair-503198552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='210268bb72854d749ca0e5865b441377',ramdisk_id='',reservation_id='r-0j9378kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-812059553',owner_user_name='tempest-ServerActionsV293TestJSON-812059553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:28:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0babd17983e74a4792e3c72b70e4298b',uuid=76506747-4a6b-40bd-b812-bf114be5e8b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Converting VIF {"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:c2:39,bridge_name='br-int',has_traffic_filtering=True,id=9ba43cb0-30b9-43ae-8f81-3df420497fff,network=Network(9f685a03-85ba-4cab-bccb-8862ef230237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba43cb0-30') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG os_vif [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:c2:39,bridge_name='br-int',has_traffic_filtering=True,id=9ba43cb0-30b9-43ae-8f81-3df420497fff,network=Network(9f685a03-85ba-4cab-bccb-8862ef230237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba43cb0-30') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c4778e3-eb1b-5b6b-8efc-04c829c42a58', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ba43cb0-30, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ba43cb0-30, col_values=(('qos', UUID('27d8696a-6e31-4236-993c-3e34e9a7248b')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ba43cb0-30, col_values=(('external_ids', {'iface-id': '9ba43cb0-30b9-43ae-8f81-3df420497fff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:c2:39', 'vm-uuid': '76506747-4a6b-40bd-b812-bf114be5e8b4'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:57 user nova-compute[74692]: INFO os_vif [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:c2:39,bridge_name='br-int',has_traffic_filtering=True,id=9ba43cb0-30b9-43ae-8f81-3df420497fff,network=Network(9f685a03-85ba-4cab-bccb-8862ef230237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba43cb0-30')
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:28:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] No VIF found with MAC fa:16:3e:5b:c2:39, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:28:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:28:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:28:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:28:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:28:58 user nova-compute[74692]: INFO nova.compute.claims [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Claim successful on node user
Nov 18 18:28:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:28:59 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:28:59 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:28:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.786s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:28:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:28:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:28:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:28:59 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:28:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:28:59 user nova-compute[74692]: DEBUG nova.policy [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fbcfd5f1f8949aea3a12d1cdad4fadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49de78bbe48494ca84537a8c3203c03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG nova.compute.manager [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:29:00 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Creating image(s)
Nov 18 18:29:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "/opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "/opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "/opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.285s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.252s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk 1073741824" returned: 0 in 0.074s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.352s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.242s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Checking if we can resize image /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-f80ec290-b200-481b-97e4-976c35c3aa62 req-205433a8-55c7-42ce-b140-2d41d4a7619e service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Received event network-vif-plugged-aec7a2cf-bc00-43f3-819b-fc6e0471448f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f80ec290-b200-481b-97e4-976c35c3aa62 req-205433a8-55c7-42ce-b140-2d41d4a7619e service nova] Acquiring lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f80ec290-b200-481b-97e4-976c35c3aa62 req-205433a8-55c7-42ce-b140-2d41d4a7619e service nova] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f80ec290-b200-481b-97e4-976c35c3aa62 req-205433a8-55c7-42ce-b140-2d41d4a7619e service nova] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-f80ec290-b200-481b-97e4-976c35c3aa62 req-205433a8-55c7-42ce-b140-2d41d4a7619e service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] No waiting events found dispatching network-vif-plugged-aec7a2cf-bc00-43f3-819b-fc6e0471448f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:01 user nova-compute[74692]: WARNING nova.compute.manager [req-f80ec290-b200-481b-97e4-976c35c3aa62 req-205433a8-55c7-42ce-b140-2d41d4a7619e service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Received unexpected event network-vif-plugged-aec7a2cf-bc00-43f3-819b-fc6e0471448f for instance with vm_state building and task_state spawning.
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.network.neutron [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Successfully created port: d62f0de0-f5fb-4c9b-abc0-962c4442e25a {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Cannot resize image /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Ensure instance console log exists: /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:29:01 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Instance spawned successfully.
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:01 user nova-compute[74692]: INFO nova.compute.manager [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Took 12.23 seconds to spawn the instance on the hypervisor.
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:29:01 user nova-compute[74692]: INFO nova.compute.manager [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Took 13.53 seconds to build instance.
Nov 18 18:29:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11f45f15-3d6a-4a3c-82d6-8449a3694c54 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.845s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:29:01 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Instance spawned successfully.
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:01 user nova-compute[74692]: INFO nova.compute.manager [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Took 6.29 seconds to spawn the instance on the hypervisor.
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 18:29:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:02 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] There are 0 instances to clean {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 18:29:02 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:29:02 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 18:29:02 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:29:02 user nova-compute[74692]: INFO nova.compute.manager [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Took 19.07 seconds to build instance.
Nov 18 18:29:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9a063eee-6e81-4460-9674-12fd90e66e9c tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.263s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:29:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-c304a612-2b99-408b-99bf-6f8634ec2904 req-8b1a4bd5-2edf-4b40-8cb6-59f5c2daad10 service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Received event network-vif-plugged-aec7a2cf-bc00-43f3-819b-fc6e0471448f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c304a612-2b99-408b-99bf-6f8634ec2904 req-8b1a4bd5-2edf-4b40-8cb6-59f5c2daad10 service nova] Acquiring lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c304a612-2b99-408b-99bf-6f8634ec2904 req-8b1a4bd5-2edf-4b40-8cb6-59f5c2daad10 service nova] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c304a612-2b99-408b-99bf-6f8634ec2904 req-8b1a4bd5-2edf-4b40-8cb6-59f5c2daad10 service nova] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-c304a612-2b99-408b-99bf-6f8634ec2904 req-8b1a4bd5-2edf-4b40-8cb6-59f5c2daad10 service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] No waiting events found dispatching network-vif-plugged-aec7a2cf-bc00-43f3-819b-fc6e0471448f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:03 user nova-compute[74692]: WARNING nova.compute.manager [req-c304a612-2b99-408b-99bf-6f8634ec2904 req-8b1a4bd5-2edf-4b40-8cb6-59f5c2daad10 service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Received unexpected event network-vif-plugged-aec7a2cf-bc00-43f3-819b-fc6e0471448f for instance with vm_state active and task_state None.
Nov 18 18:29:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-c304a612-2b99-408b-99bf-6f8634ec2904 req-8b1a4bd5-2edf-4b40-8cb6-59f5c2daad10 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received event network-vif-plugged-9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c304a612-2b99-408b-99bf-6f8634ec2904 req-8b1a4bd5-2edf-4b40-8cb6-59f5c2daad10 service nova] Acquiring lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c304a612-2b99-408b-99bf-6f8634ec2904 req-8b1a4bd5-2edf-4b40-8cb6-59f5c2daad10 service nova] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c304a612-2b99-408b-99bf-6f8634ec2904 req-8b1a4bd5-2edf-4b40-8cb6-59f5c2daad10 service nova] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-c304a612-2b99-408b-99bf-6f8634ec2904 req-8b1a4bd5-2edf-4b40-8cb6-59f5c2daad10 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] No waiting events found dispatching network-vif-plugged-9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:03 user nova-compute[74692]: WARNING nova.compute.manager [req-c304a612-2b99-408b-99bf-6f8634ec2904 req-8b1a4bd5-2edf-4b40-8cb6-59f5c2daad10 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received unexpected event network-vif-plugged-9ba43cb0-30b9-43ae-8f81-3df420497fff for instance with vm_state active and task_state None.
Nov 18 18:29:03 user nova-compute[74692]: DEBUG nova.network.neutron [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Successfully updated port: d62f0de0-f5fb-4c9b-abc0-962c4442e25a {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "refresh_cache-765c948c-4ad7-4e98-9fb7-ec3a9f194a05" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquired lock "refresh_cache-765c948c-4ad7-4e98-9fb7-ec3a9f194a05" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:03 user nova-compute[74692]: DEBUG nova.network.neutron [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.network.neutron [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.network.neutron [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Updating instance_info_cache with network_info: [{"id": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "address": "fa:16:3e:74:6f:59", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f0de0-f5", "ovs_interfaceid": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Releasing lock "refresh_cache-765c948c-4ad7-4e98-9fb7-ec3a9f194a05" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.compute.manager [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Instance network_info: |[{"id": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "address": "fa:16:3e:74:6f:59", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f0de0-f5", "ovs_interfaceid": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Start _get_guest_xml network_info=[{"id": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "address": "fa:16:3e:74:6f:59", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f0de0-f5", "ovs_interfaceid": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:29:04 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:29:04 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-610115112',display_name='tempest-VolumesActionsTest-instance-610115112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-610115112',id=8,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c49de78bbe48494ca84537a8c3203c03',ramdisk_id='',reservation_id='r-1zfanp70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-948228922',owner_user_name='tempest-VolumesActionsTest-948228922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:00Z,user_data=None,user_id='5fbcfd5f1f8949aea3a12d1cdad4fadd',uuid=765c948c-4ad7-4e98-9fb7-ec3a9f194a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "address": "fa:16:3e:74:6f:59", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f0de0-f5", "ovs_interfaceid": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Converting VIF {"id": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "address": "fa:16:3e:74:6f:59", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f0de0-f5", "ovs_interfaceid": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=d62f0de0-f5fb-4c9b-abc0-962c4442e25a,network=Network(77ac5902-ef13-4b4f-b0b3-7c130c82a723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62f0de0-f5') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.objects.instance [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lazy-loading 'pci_devices' on Instance uuid 765c948c-4ad7-4e98-9fb7-ec3a9f194a05 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:29:04 user nova-compute[74692]:   <uuid>765c948c-4ad7-4e98-9fb7-ec3a9f194a05</uuid>
Nov 18 18:29:04 user nova-compute[74692]:   <name>instance-00000008</name>
Nov 18 18:29:04 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:29:04 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:29:04 user nova-compute[74692]:   <metadata>
Nov 18 18:29:04 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:29:04 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:29:04 user nova-compute[74692]:       <nova:name>tempest-VolumesActionsTest-instance-610115112</nova:name>
Nov 18 18:29:04 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:29:04</nova:creationTime>
Nov 18 18:29:04 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:29:04 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:29:04 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:29:04 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:29:04 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:29:04 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:29:04 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:29:04 user nova-compute[74692]:       <nova:owner>
Nov 18 18:29:04 user nova-compute[74692]:         <nova:user uuid="5fbcfd5f1f8949aea3a12d1cdad4fadd">tempest-VolumesActionsTest-948228922-project-member</nova:user>
Nov 18 18:29:04 user nova-compute[74692]:         <nova:project uuid="c49de78bbe48494ca84537a8c3203c03">tempest-VolumesActionsTest-948228922</nova:project>
Nov 18 18:29:04 user nova-compute[74692]:       </nova:owner>
Nov 18 18:29:04 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:29:04 user nova-compute[74692]:       <nova:ports>
Nov 18 18:29:04 user nova-compute[74692]:         <nova:port uuid="d62f0de0-f5fb-4c9b-abc0-962c4442e25a">
Nov 18 18:29:04 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 18 18:29:04 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:04 user nova-compute[74692]:       </nova:ports>
Nov 18 18:29:04 user nova-compute[74692]:     </nova:instance>
Nov 18 18:29:04 user nova-compute[74692]:   </metadata>
Nov 18 18:29:04 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:29:04 user nova-compute[74692]:     <system>
Nov 18 18:29:04 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:29:04 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:29:04 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:29:04 user nova-compute[74692]:       <entry name="serial">765c948c-4ad7-4e98-9fb7-ec3a9f194a05</entry>
Nov 18 18:29:04 user nova-compute[74692]:       <entry name="uuid">765c948c-4ad7-4e98-9fb7-ec3a9f194a05</entry>
Nov 18 18:29:04 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:29:04 user nova-compute[74692]:     </system>
Nov 18 18:29:04 user nova-compute[74692]:   </sysinfo>
Nov 18 18:29:04 user nova-compute[74692]:   <os>
Nov 18 18:29:04 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:29:04 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:29:04 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:29:04 user nova-compute[74692]:   </os>
Nov 18 18:29:04 user nova-compute[74692]:   <features>
Nov 18 18:29:04 user nova-compute[74692]:     <acpi/>
Nov 18 18:29:04 user nova-compute[74692]:     <apic/>
Nov 18 18:29:04 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:29:04 user nova-compute[74692]:   </features>
Nov 18 18:29:04 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:29:04 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:29:04 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:29:04 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:29:04 user nova-compute[74692]:   </clock>
Nov 18 18:29:04 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:29:04 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:29:04 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:29:04 user nova-compute[74692]:   </cpu>
Nov 18 18:29:04 user nova-compute[74692]:   <devices>
Nov 18 18:29:04 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:29:04 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:29:04 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk"/>
Nov 18 18:29:04 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:29:04 user nova-compute[74692]:     </disk>
Nov 18 18:29:04 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:04 user nova-compute[74692]:       <mac address="fa:16:3e:74:6f:59"/>
Nov 18 18:29:04 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:04 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:04 user nova-compute[74692]:       <target dev="tapd62f0de0-f5"/>
Nov 18 18:29:04 user nova-compute[74692]:     </interface>
Nov 18 18:29:04 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:29:04 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/console.log" append="off"/>
Nov 18 18:29:04 user nova-compute[74692]:     </serial>
Nov 18 18:29:04 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:29:04 user nova-compute[74692]:     <video>
Nov 18 18:29:04 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:04 user nova-compute[74692]:     </video>
Nov 18 18:29:04 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:29:04 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:29:04 user nova-compute[74692]:     </rng>
Nov 18 18:29:04 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:29:04 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:29:04 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:29:04 user nova-compute[74692]:     </memballoon>
Nov 18 18:29:04 user nova-compute[74692]:   </devices>
Nov 18 18:29:04 user nova-compute[74692]: </domain>
Nov 18 18:29:04 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-610115112',display_name='tempest-VolumesActionsTest-instance-610115112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-610115112',id=8,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c49de78bbe48494ca84537a8c3203c03',ramdisk_id='',reservation_id='r-1zfanp70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-948228922',owner_user_name='tempest-VolumesActionsTest-948228922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:00Z,user_data=None,user_id='5fbcfd5f1f8949aea3a12d1cdad4fadd',uuid=765c948c-4ad7-4e98-9fb7-ec3a9f194a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "address": "fa:16:3e:74:6f:59", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f0de0-f5", "ovs_interfaceid": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Converting VIF {"id": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "address": "fa:16:3e:74:6f:59", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f0de0-f5", "ovs_interfaceid": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=d62f0de0-f5fb-4c9b-abc0-962c4442e25a,network=Network(77ac5902-ef13-4b4f-b0b3-7c130c82a723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62f0de0-f5') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG os_vif [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=d62f0de0-f5fb-4c9b-abc0-962c4442e25a,network=Network(77ac5902-ef13-4b4f-b0b3-7c130c82a723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62f0de0-f5') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9c74b59-042e-533e-a60d-e18b058b8147', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd62f0de0-f5, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd62f0de0-f5, col_values=(('qos', UUID('202f705c-950b-4964-878d-7a8619a1daaa')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd62f0de0-f5, col_values=(('external_ids', {'iface-id': 'd62f0de0-f5fb-4c9b-abc0-962c4442e25a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:6f:59', 'vm-uuid': '765c948c-4ad7-4e98-9fb7-ec3a9f194a05'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:04 user nova-compute[74692]: INFO os_vif [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=d62f0de0-f5fb-4c9b-abc0-962c4442e25a,network=Network(77ac5902-ef13-4b4f-b0b3-7c130c82a723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62f0de0-f5')
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] No VIF found with MAC fa:16:3e:74:6f:59, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:29:04 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:29:05 user nova-compute[74692]: INFO nova.compute.claims [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Claim successful on node user
Nov 18 18:29:05 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-07d70cfd-e0b8-4211-80fe-19b432782174 req-cafe887d-529a-4c66-8667-e115836168ce service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Received event network-changed-d62f0de0-f5fb-4c9b-abc0-962c4442e25a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-07d70cfd-e0b8-4211-80fe-19b432782174 req-cafe887d-529a-4c66-8667-e115836168ce service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Refreshing instance network info cache due to event network-changed-d62f0de0-f5fb-4c9b-abc0-962c4442e25a. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-07d70cfd-e0b8-4211-80fe-19b432782174 req-cafe887d-529a-4c66-8667-e115836168ce service nova] Acquiring lock "refresh_cache-765c948c-4ad7-4e98-9fb7-ec3a9f194a05" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-07d70cfd-e0b8-4211-80fe-19b432782174 req-cafe887d-529a-4c66-8667-e115836168ce service nova] Acquired lock "refresh_cache-765c948c-4ad7-4e98-9fb7-ec3a9f194a05" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG nova.network.neutron [req-07d70cfd-e0b8-4211-80fe-19b432782174 req-cafe887d-529a-4c66-8667-e115836168ce service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Refreshing network info cache for port d62f0de0-f5fb-4c9b-abc0-962c4442e25a {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.690s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:29:05 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:29:05 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:29:06 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG nova.policy [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68365438753241d3964290162350e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3d9f86d2ba49ecbb73e8128900d73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG nova.network.neutron [req-07d70cfd-e0b8-4211-80fe-19b432782174 req-cafe887d-529a-4c66-8667-e115836168ce service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Updated VIF entry in instance network info cache for port d62f0de0-f5fb-4c9b-abc0-962c4442e25a. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG nova.network.neutron [req-07d70cfd-e0b8-4211-80fe-19b432782174 req-cafe887d-529a-4c66-8667-e115836168ce service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Updating instance_info_cache with network_info: [{"id": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "address": "fa:16:3e:74:6f:59", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f0de0-f5", "ovs_interfaceid": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-07d70cfd-e0b8-4211-80fe-19b432782174 req-cafe887d-529a-4c66-8667-e115836168ce service nova] Releasing lock "refresh_cache-765c948c-4ad7-4e98-9fb7-ec3a9f194a05" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-07d70cfd-e0b8-4211-80fe-19b432782174 req-cafe887d-529a-4c66-8667-e115836168ce service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received event network-vif-plugged-9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-07d70cfd-e0b8-4211-80fe-19b432782174 req-cafe887d-529a-4c66-8667-e115836168ce service nova] Acquiring lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-07d70cfd-e0b8-4211-80fe-19b432782174 req-cafe887d-529a-4c66-8667-e115836168ce service nova] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-07d70cfd-e0b8-4211-80fe-19b432782174 req-cafe887d-529a-4c66-8667-e115836168ce service nova] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-07d70cfd-e0b8-4211-80fe-19b432782174 req-cafe887d-529a-4c66-8667-e115836168ce service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] No waiting events found dispatching network-vif-plugged-9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:06 user nova-compute[74692]: WARNING nova.compute.manager [req-07d70cfd-e0b8-4211-80fe-19b432782174 req-cafe887d-529a-4c66-8667-e115836168ce service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received unexpected event network-vif-plugged-9ba43cb0-30b9-43ae-8f81-3df420497fff for instance with vm_state active and task_state None.
Nov 18 18:29:06 user nova-compute[74692]: INFO nova.virt.block_device [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Booting with volume ab8ee283-42a6-4087-b21b-7a12bcd8687e at /dev/vda
Nov 18 18:29:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG os_brick.utils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.042s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5493f87e-1de8-43f4-8341-0dd0dbf9902e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.051s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8e1edb-48fe-42a5-a4b5-6c2c49d808fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fa5cc1-5faf-4d82-a3b9-be73d0f1e564]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9898d73-7d41-49e1-8fc7-92ea836fd340]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:29:06 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:29:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfaef04-b4e6-4752-befb-d565e2f17b87]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG os_brick.utils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] <== get_connector_properties: return (259ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating existing volume attachment record: 52f2a00b-c3bd-4cc6-88d6-89503be7cb08 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:29:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:07 user nova-compute[74692]: DEBUG nova.compute.manager [req-6c94d778-a0c3-4f4e-85f0-b156644cd23e req-eadaf987-57b0-49da-b014-85132b28702e service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Received event network-vif-plugged-d62f0de0-f5fb-4c9b-abc0-962c4442e25a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6c94d778-a0c3-4f4e-85f0-b156644cd23e req-eadaf987-57b0-49da-b014-85132b28702e service nova] Acquiring lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6c94d778-a0c3-4f4e-85f0-b156644cd23e req-eadaf987-57b0-49da-b014-85132b28702e service nova] Lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6c94d778-a0c3-4f4e-85f0-b156644cd23e req-eadaf987-57b0-49da-b014-85132b28702e service nova] Lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:07 user nova-compute[74692]: DEBUG nova.compute.manager [req-6c94d778-a0c3-4f4e-85f0-b156644cd23e req-eadaf987-57b0-49da-b014-85132b28702e service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] No waiting events found dispatching network-vif-plugged-d62f0de0-f5fb-4c9b-abc0-962c4442e25a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:07 user nova-compute[74692]: WARNING nova.compute.manager [req-6c94d778-a0c3-4f4e-85f0-b156644cd23e req-eadaf987-57b0-49da-b014-85132b28702e service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Received unexpected event network-vif-plugged-d62f0de0-f5fb-4c9b-abc0-962c4442e25a for instance with vm_state building and task_state spawning.
Nov 18 18:29:07 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Successfully created port: d3d79063-efeb-4014-acb1-ddcfc7c57309 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:29:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "40481706-78c9-402d-9d19-d2d00d812095" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:08 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:29:08 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Successfully created port: 820a0454-d628-4849-956e-e219a7c77f71 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:29:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:08 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:29:08 user nova-compute[74692]: INFO nova.compute.claims [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Claim successful on node user
Nov 18 18:29:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-edbd4fcf-1c87-4c82-9183-84f4d7903fd5 req-04bcd9a6-4e6c-4316-b3fb-0bc7e25354aa service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Received event network-vif-plugged-d62f0de0-f5fb-4c9b-abc0-962c4442e25a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-edbd4fcf-1c87-4c82-9183-84f4d7903fd5 req-04bcd9a6-4e6c-4316-b3fb-0bc7e25354aa service nova] Acquiring lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-edbd4fcf-1c87-4c82-9183-84f4d7903fd5 req-04bcd9a6-4e6c-4316-b3fb-0bc7e25354aa service nova] Lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-edbd4fcf-1c87-4c82-9183-84f4d7903fd5 req-04bcd9a6-4e6c-4316-b3fb-0bc7e25354aa service nova] Lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-edbd4fcf-1c87-4c82-9183-84f4d7903fd5 req-04bcd9a6-4e6c-4316-b3fb-0bc7e25354aa service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] No waiting events found dispatching network-vif-plugged-d62f0de0-f5fb-4c9b-abc0-962c4442e25a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:09 user nova-compute[74692]: WARNING nova.compute.manager [req-edbd4fcf-1c87-4c82-9183-84f4d7903fd5 req-04bcd9a6-4e6c-4316-b3fb-0bc7e25354aa service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Received unexpected event network-vif-plugged-d62f0de0-f5fb-4c9b-abc0-962c4442e25a for instance with vm_state building and task_state spawning.
Nov 18 18:29:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Successfully created port: 14e00c18-ad6b-4481-852d-e336bee32648 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.995s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.compute.manager [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:29:09 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Instance spawned successfully.
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:09 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:10 user nova-compute[74692]: INFO nova.compute.manager [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Took 9.98 seconds to spawn the instance on the hypervisor.
Nov 18 18:29:10 user nova-compute[74692]: DEBUG nova.compute.manager [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:29:10 user nova-compute[74692]: INFO nova.virt.block_device [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Booting with volume 0c599e24-bfc8-42cb-8129-6ba1be0c7593 at /dev/vda
Nov 18 18:29:10 user nova-compute[74692]: DEBUG nova.policy [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc7bea88537f498f9a57f044cdede728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a88be034ffb4322ad1a9d2aebef7e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG os_brick.utils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c74b04e-ec94-47ae-a3a8-546ca23da533]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:10 user nova-compute[74692]: INFO nova.compute.manager [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Took 11.61 seconds to build instance.
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d852fc-bee7-433f-bceb-457dbe9299f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-412f4661-79e0-4f02-9ec8-91c13fcda497 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.789s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Successfully created port: 26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e02bc7-7cd6-4be1-89cb-25a47930fa49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf194e8-fb9c-4066-ad5e-63d5766e2657]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:29:10 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a8277d-4190-4512-9ff5-36d075922a2a]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG os_brick.utils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] <== get_connector_properties: return (256ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updating existing volume attachment record: 9e3acb15-cb60-4d99-a648-c418974e4e62 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:11 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Successfully created port: 050fa40f-fc29-49bd-b29d-c7954818aa63 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:29:11 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Successfully created port: a4b46c64-5441-46a3-8da4-529a1d32046e {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:29:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:11 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:29:11 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:29:11 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7801MB free_disk=25.66425323486328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:29:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:11 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Successfully updated port: d3d79063-efeb-4014-acb1-ddcfc7c57309 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.compute.manager [req-fc017408-b388-4cb4-8cf8-9938fce9fb3b req-dfd69911-1c1a-4764-a2a5-7391f4092a1f service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-changed-d3d79063-efeb-4014-acb1-ddcfc7c57309 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.compute.manager [req-fc017408-b388-4cb4-8cf8-9938fce9fb3b req-dfd69911-1c1a-4764-a2a5-7391f4092a1f service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing instance network info cache due to event network-changed-d3d79063-efeb-4014-acb1-ddcfc7c57309. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fc017408-b388-4cb4-8cf8-9938fce9fb3b req-dfd69911-1c1a-4764-a2a5-7391f4092a1f service nova] Acquiring lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fc017408-b388-4cb4-8cf8-9938fce9fb3b req-dfd69911-1c1a-4764-a2a5-7391f4092a1f service nova] Acquired lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.network.neutron [req-fc017408-b388-4cb4-8cf8-9938fce9fb3b req-dfd69911-1c1a-4764-a2a5-7391f4092a1f service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing network info cache for port d3d79063-efeb-4014-acb1-ddcfc7c57309 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.network.neutron [req-fc017408-b388-4cb4-8cf8-9938fce9fb3b req-dfd69911-1c1a-4764-a2a5-7391f4092a1f service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Successfully created port: dd929622-57d9-4e8c-9012-6340cc9d39ff {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance afe4e445-5419-4a79-ae32-294e0ac0a7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance bebb6344-183e-4367-bb0b-b575b70adfbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17447e1-2e91-4d25-bf3a-3705927ec122 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 76506747-4a6b-40bd-b812-bf114be5e8b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d40a1c6a-a5c1-46ff-ae2f-70819a1903b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 765c948c-4ad7-4e98-9fb7-ec3a9f194a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance e1603038-3a10-4efb-b5f7-15495ccd3717 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 40481706-78c9-402d-9d19-d2d00d812095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing inventories for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating ProviderTree inventory for provider 582be55c-ee9f-496e-b354-5900b8401d2c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating inventory in ProviderTree for provider 582be55c-ee9f-496e-b354-5900b8401d2c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing aggregate associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, aggregates: None {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing trait associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG nova.network.neutron [req-fc017408-b388-4cb4-8cf8-9938fce9fb3b req-dfd69911-1c1a-4764-a2a5-7391f4092a1f service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fc017408-b388-4cb4-8cf8-9938fce9fb3b req-dfd69911-1c1a-4764-a2a5-7391f4092a1f service nova] Releasing lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:13 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Successfully created port: 11839468-beda-436e-9437-715fdaa17168 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:29:13 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:29:13 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:29:13 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Successfully updated port: 81eda6a3-90f4-42dc-8462-171ec3afbf2f {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:13 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:29:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.273s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:13 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Successfully created port: dbab20d9-2bd4-480c-a971-c213fcfa03a8 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:29:13 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Successfully updated port: a955bfd0-166d-4030-bb78-6402891c7af3 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-changed-81eda6a3-90f4-42dc-8462-171ec3afbf2f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing instance network info cache due to event network-changed-81eda6a3-90f4-42dc-8462-171ec3afbf2f. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] Acquiring lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] Acquired lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG nova.network.neutron [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing network info cache for port 81eda6a3-90f4-42dc-8462-171ec3afbf2f {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG nova.network.neutron [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Successfully created port: 15f12897-9a5b-4c7a-b80e-4889ce96f780 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG nova.network.neutron [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] Releasing lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-changed-a955bfd0-166d-4030-bb78-6402891c7af3 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing instance network info cache due to event network-changed-a955bfd0-166d-4030-bb78-6402891c7af3. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] Acquiring lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] Acquired lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG nova.network.neutron [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing network info cache for port a955bfd0-166d-4030-bb78-6402891c7af3 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:14 user nova-compute[74692]: INFO nova.virt.block_device [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Booting with volume c77d7f8c-d05c-45f4-b339-5f63fe0064cf at /dev/vdb
Nov 18 18:29:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG os_brick.utils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8f6b3e-f8e8-48cb-b005-99d3761e8b8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1976f150-3f42-4649-859c-b84c1b4cc8e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23dd516-8151-48fc-a47a-dbb7dbe2cbc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec32238e-074a-4931-a065-1b0b33fcf821]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Successfully updated port: 820a0454-d628-4849-956e-e219a7c77f71 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:29:14 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:29:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8600385-842a-42a5-aa5c-a1650539fcef]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG os_brick.utils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:29:14 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating existing volume attachment record: 92eba9d8-09f7-44ef-a18c-963ac50ad9f6 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Successfully updated port: a4b46c64-5441-46a3-8da4-529a1d32046e {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Skipping network cache update for instance because it is Building. {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Skipping network cache update for instance because it is Building. {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG nova.compute.manager [req-6b8fe051-222b-4d69-92e1-4bfe30950629 req-ebdb6dfe-782a-4d84-97cb-cfe15a69cf25 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-changed-a4b46c64-5441-46a3-8da4-529a1d32046e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG nova.compute.manager [req-6b8fe051-222b-4d69-92e1-4bfe30950629 req-ebdb6dfe-782a-4d84-97cb-cfe15a69cf25 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing instance network info cache due to event network-changed-a4b46c64-5441-46a3-8da4-529a1d32046e. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6b8fe051-222b-4d69-92e1-4bfe30950629 req-ebdb6dfe-782a-4d84-97cb-cfe15a69cf25 service nova] Acquiring lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6b8fe051-222b-4d69-92e1-4bfe30950629 req-ebdb6dfe-782a-4d84-97cb-cfe15a69cf25 service nova] Acquired lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG nova.network.neutron [req-6b8fe051-222b-4d69-92e1-4bfe30950629 req-ebdb6dfe-782a-4d84-97cb-cfe15a69cf25 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing network info cache for port a4b46c64-5441-46a3-8da4-529a1d32046e {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG nova.network.neutron [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG nova.network.neutron [req-6b8fe051-222b-4d69-92e1-4bfe30950629 req-ebdb6dfe-782a-4d84-97cb-cfe15a69cf25 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-afe4e445-5419-4a79-ae32-294e0ac0a7c0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-afe4e445-5419-4a79-ae32-294e0ac0a7c0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid afe4e445-5419-4a79-ae32-294e0ac0a7c0 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG nova.network.neutron [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f9cb198b-e3db-4c6a-a67e-ca1d2e6b20c1 req-9469b578-df39-4953-938a-4b7b8820de62 service nova] Releasing lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Successfully updated port: 14e00c18-ad6b-4481-852d-e336bee32648 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG nova.network.neutron [req-6b8fe051-222b-4d69-92e1-4bfe30950629 req-ebdb6dfe-782a-4d84-97cb-cfe15a69cf25 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6b8fe051-222b-4d69-92e1-4bfe30950629 req-ebdb6dfe-782a-4d84-97cb-cfe15a69cf25 service nova] Releasing lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Updating instance_info_cache with network_info: [{"id": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "address": "fa:16:3e:67:61:1d", "network": {"id": "58efb65a-1cab-4ed5-a03e-808fa70f9179", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747026108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0706238908747f1a06bc4ea7750dfdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f17b65c-54", "ovs_interfaceid": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-afe4e445-5419-4a79-ae32-294e0ac0a7c0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-changed-820a0454-d628-4849-956e-e219a7c77f71 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing instance network info cache due to event network-changed-820a0454-d628-4849-956e-e219a7c77f71. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] Acquiring lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] Acquired lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG nova.network.neutron [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing network info cache for port 820a0454-d628-4849-956e-e219a7c77f71 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG nova.network.neutron [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Successfully updated port: bd5d1c9a-bf27-47ce-9047-72844816accd {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Successfully updated port: 26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG nova.network.neutron [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] Releasing lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-changed-14e00c18-ad6b-4481-852d-e336bee32648 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing instance network info cache due to event network-changed-14e00c18-ad6b-4481-852d-e336bee32648. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] Acquiring lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] Acquired lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG nova.network.neutron [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing network info cache for port 14e00c18-ad6b-4481-852d-e336bee32648 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG nova.network.neutron [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:29:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG nova.network.neutron [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-28cb4355-0b72-4e7a-a57b-aca82e801f84 req-2cd45785-d309-4b50-b8ea-53c33a068aa6 service nova] Releasing lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Successfully updated port: 8c2a0340-808f-4987-a0dd-38d3d9548b4d {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG nova.compute.manager [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-changed-bd5d1c9a-bf27-47ce-9047-72844816accd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG nova.compute.manager [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing instance network info cache due to event network-changed-bd5d1c9a-bf27-47ce-9047-72844816accd. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] Acquiring lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] Acquired lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG nova.network.neutron [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing network info cache for port bd5d1c9a-bf27-47ce-9047-72844816accd {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Successfully updated port: 050fa40f-fc29-49bd-b29d-c7954818aa63 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquired lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG nova.network.neutron [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:29:17 user nova-compute[74692]: INFO nova.virt.block_device [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Booting with volume 3b8693b0-604a-41d5-a99a-dca528178e16 at /dev/vdb
Nov 18 18:29:17 user nova-compute[74692]: DEBUG os_brick.utils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG nova.network.neutron [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[220f5e98-3935-4fe9-b87f-cdd487b956ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adf5d4c-c71b-41bd-a740-1cf1f3705ff8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] Releasing lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG nova.compute.manager [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-changed-8c2a0340-808f-4987-a0dd-38d3d9548b4d {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG nova.compute.manager [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing instance network info cache due to event network-changed-8c2a0340-808f-4987-a0dd-38d3d9548b4d. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] Acquiring lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] Acquired lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:17 user nova-compute[74692]: DEBUG nova.network.neutron [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing network info cache for port 8c2a0340-808f-4987-a0dd-38d3d9548b4d {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.050s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[753e89fa-f813-40ce-9964-886663f2a5e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da41c21-b5f8-4e8c-ab6a-a05a44be4e25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:29:18 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:29:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9525cb6f-ec4e-4c1a-9915-5dc709136f25]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG os_brick.utils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updating existing volume attachment record: 3fbea96c-abf5-4e0f-8b7e-b508f60dd44d {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG nova.network.neutron [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Successfully updated port: dd929622-57d9-4e8c-9012-6340cc9d39ff {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-changed-26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing instance network info cache due to event network-changed-26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] Acquiring lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG nova.network.neutron [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4e0113b5-3187-461c-8a1a-7110f0daa9b9 req-2c561622-fc6c-46d8-8c92-be881c2cf1ea service nova] Releasing lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:19 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Successfully updated port: 11839468-beda-436e-9437-715fdaa17168 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-changed-dd929622-57d9-4e8c-9012-6340cc9d39ff {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing instance network info cache due to event network-changed-dd929622-57d9-4e8c-9012-6340cc9d39ff. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] Acquiring lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] Acquired lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:19 user nova-compute[74692]: DEBUG nova.network.neutron [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing network info cache for port dd929622-57d9-4e8c-9012-6340cc9d39ff {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:19 user nova-compute[74692]: DEBUG nova.network.neutron [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:29:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:19 user nova-compute[74692]: DEBUG nova.network.neutron [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] Releasing lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-changed-11839468-beda-436e-9437-715fdaa17168 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing instance network info cache due to event network-changed-11839468-beda-436e-9437-715fdaa17168. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] Acquiring lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] Acquired lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:19 user nova-compute[74692]: DEBUG nova.network.neutron [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing network info cache for port 11839468-beda-436e-9437-715fdaa17168 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating instance_info_cache with network_info: [{"id": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "address": "fa:16:3e:fb:50:e4", "network": {"id": "27774fe7-2099-4253-8194-b6d160291ece", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-210587587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d79063-ef", "ovs_interfaceid": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14e00c18-ad6b-4481-852d-e336bee32648", "address": "fa:16:3e:6a:7c:8a", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e00c18-ad", "ovs_interfaceid": "14e00c18-ad6b-4481-852d-e336bee32648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "address": "fa:16:3e:2f:01:4c", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26cb4ab6-5d", "ovs_interfaceid": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "050fa40f-fc29-49bd-b29d-c7954818aa63", "address": "fa:16:3e:32:3f:b3", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050fa40f-fc", "ovs_interfaceid": "050fa40f-fc29-49bd-b29d-c7954818aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Releasing lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Instance network_info: |[{"id": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "address": "fa:16:3e:fb:50:e4", "network": {"id": "27774fe7-2099-4253-8194-b6d160291ece", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-210587587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d79063-ef", "ovs_interfaceid": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14e00c18-ad6b-4481-852d-e336bee32648", "address": "fa:16:3e:6a:7c:8a", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e00c18-ad", "ovs_interfaceid": "14e00c18-ad6b-4481-852d-e336bee32648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "address": "fa:16:3e:2f:01:4c", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26cb4ab6-5d", "ovs_interfaceid": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "050fa40f-fc29-49bd-b29d-c7954818aa63", "address": "fa:16:3e:32:3f:b3", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050fa40f-fc", "ovs_interfaceid": "050fa40f-fc29-49bd-b29d-c7954818aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] Acquired lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing network info cache for port 26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-56103ec7-1a8c-4e5d-8605-3dbe7f321f8c req-dec975f9-c741-4247-92b6-9465ce86d78c service nova] Releasing lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Successfully updated port: dbab20d9-2bd4-480c-a971-c213fcfa03a8 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updated VIF entry in instance network info cache for port 26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating instance_info_cache with network_info: [{"id": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "address": "fa:16:3e:fb:50:e4", "network": {"id": "27774fe7-2099-4253-8194-b6d160291ece", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-210587587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d79063-ef", "ovs_interfaceid": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14e00c18-ad6b-4481-852d-e336bee32648", "address": "fa:16:3e:6a:7c:8a", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e00c18-ad", "ovs_interfaceid": "14e00c18-ad6b-4481-852d-e336bee32648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "address": "fa:16:3e:2f:01:4c", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26cb4ab6-5d", "ovs_interfaceid": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "050fa40f-fc29-49bd-b29d-c7954818aa63", "address": "fa:16:3e:32:3f:b3", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050fa40f-fc", "ovs_interfaceid": "050fa40f-fc29-49bd-b29d-c7954818aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] Releasing lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-changed-050fa40f-fc29-49bd-b29d-c7954818aa63 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing instance network info cache due to event network-changed-050fa40f-fc29-49bd-b29d-c7954818aa63. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] Acquiring lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] Acquired lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing network info cache for port 050fa40f-fc29-49bd-b29d-c7954818aa63 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:21 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Successfully updated port: 15f12897-9a5b-4c7a-b80e-4889ce96f780 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquired lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:21 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:29:21 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:29:21 user nova-compute[74692]: DEBUG nova.network.neutron [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updated VIF entry in instance network info cache for port 050fa40f-fc29-49bd-b29d-c7954818aa63. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:29:21 user nova-compute[74692]: DEBUG nova.network.neutron [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating instance_info_cache with network_info: [{"id": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "address": "fa:16:3e:fb:50:e4", "network": {"id": "27774fe7-2099-4253-8194-b6d160291ece", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-210587587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d79063-ef", "ovs_interfaceid": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14e00c18-ad6b-4481-852d-e336bee32648", "address": "fa:16:3e:6a:7c:8a", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e00c18-ad", "ovs_interfaceid": "14e00c18-ad6b-4481-852d-e336bee32648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "address": "fa:16:3e:2f:01:4c", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26cb4ab6-5d", "ovs_interfaceid": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "050fa40f-fc29-49bd-b29d-c7954818aa63", "address": "fa:16:3e:32:3f:b3", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050fa40f-fc", "ovs_interfaceid": "050fa40f-fc29-49bd-b29d-c7954818aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-89c6246e-92c9-4aab-8200-0a6fd415f6ca req-5936f2d4-4405-4d62-9ecf-931847e60f48 service nova] Releasing lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:21 user nova-compute[74692]: DEBUG nova.compute.manager [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-changed-dbab20d9-2bd4-480c-a971-c213fcfa03a8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:21 user nova-compute[74692]: DEBUG nova.compute.manager [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing instance network info cache due to event network-changed-dbab20d9-2bd4-480c-a971-c213fcfa03a8. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] Acquiring lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:22 user nova-compute[74692]: INFO nova.virt.block_device [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Booting with volume 16a4a768-c177-444c-bed8-eaa5a3fa1f87 at /dev/vdc
Nov 18 18:29:23 user nova-compute[74692]: DEBUG os_brick.utils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[50441cec-1445-4e36-ad94-bacf1139012d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[44762a0a-06d1-43d4-b3ac-1d8f154f1fbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updating instance_info_cache with network_info: [{"id": "a4b46c64-5441-46a3-8da4-529a1d32046e", "address": "fa:16:3e:04:37:ca", "network": {"id": "a4f639ab-5d23-44cf-9586-1df19a47170c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1273332395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b46c64-54", "ovs_interfaceid": "a4b46c64-5441-46a3-8da4-529a1d32046e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd5d1c9a-bf27-47ce-9047-72844816accd", "address": "fa:16:3e:c1:a9:96", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5d1c9a-bf", "ovs_interfaceid": "bd5d1c9a-bf27-47ce-9047-72844816accd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "address": "fa:16:3e:87:4c:60", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2a0340-80", "ovs_interfaceid": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "address": "fa:16:3e:e9:84:44", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd929622-57", "ovs_interfaceid": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11839468-beda-436e-9437-715fdaa17168", "address": "fa:16:3e:94:77:bc", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11839468-be", "ovs_interfaceid": "11839468-beda-436e-9437-715fdaa17168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "address": "fa:16:3e:e4:17:89", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbab20d9-2b", "ovs_interfaceid": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "address": "fa:16:3e:4c:4a:a6", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f12897-9a", "ovs_interfaceid": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1356e477-a8ce-4bf8-84b1-5adc84e3fcc0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9e519c-9a2d-4666-b732-9cccf5f64de8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Releasing lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Instance network_info: |[{"id": "a4b46c64-5441-46a3-8da4-529a1d32046e", "address": "fa:16:3e:04:37:ca", "network": {"id": "a4f639ab-5d23-44cf-9586-1df19a47170c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1273332395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b46c64-54", "ovs_interfaceid": "a4b46c64-5441-46a3-8da4-529a1d32046e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd5d1c9a-bf27-47ce-9047-72844816accd", "address": "fa:16:3e:c1:a9:96", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5d1c9a-bf", "ovs_interfaceid": "bd5d1c9a-bf27-47ce-9047-72844816accd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "address": "fa:16:3e:87:4c:60", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2a0340-80", "ovs_interfaceid": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "address": "fa:16:3e:e9:84:44", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd929622-57", "ovs_interfaceid": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11839468-beda-436e-9437-715fdaa17168", "address": "fa:16:3e:94:77:bc", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11839468-be", "ovs_interfaceid": "11839468-beda-436e-9437-715fdaa17168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "address": "fa:16:3e:e4:17:89", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbab20d9-2b", "ovs_interfaceid": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "address": "fa:16:3e:4c:4a:a6", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f12897-9a", "ovs_interfaceid": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] Acquired lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG nova.network.neutron [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing network info cache for port dbab20d9-2bd4-480c-a971-c213fcfa03a8 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:29:23 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aec56ef-95b2-4d68-8672-891bb78b8032]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG os_brick.utils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating existing volume attachment record: 5f2d6081-8699-48f8-a28f-30f2b01f29ac {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG nova.network.neutron [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updated VIF entry in instance network info cache for port dbab20d9-2bd4-480c-a971-c213fcfa03a8. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG nova.network.neutron [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updating instance_info_cache with network_info: [{"id": "a4b46c64-5441-46a3-8da4-529a1d32046e", "address": "fa:16:3e:04:37:ca", "network": {"id": "a4f639ab-5d23-44cf-9586-1df19a47170c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1273332395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b46c64-54", "ovs_interfaceid": "a4b46c64-5441-46a3-8da4-529a1d32046e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd5d1c9a-bf27-47ce-9047-72844816accd", "address": "fa:16:3e:c1:a9:96", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5d1c9a-bf", "ovs_interfaceid": "bd5d1c9a-bf27-47ce-9047-72844816accd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "address": "fa:16:3e:87:4c:60", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2a0340-80", "ovs_interfaceid": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "address": "fa:16:3e:e9:84:44", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd929622-57", "ovs_interfaceid": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11839468-beda-436e-9437-715fdaa17168", "address": "fa:16:3e:94:77:bc", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11839468-be", "ovs_interfaceid": "11839468-beda-436e-9437-715fdaa17168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "address": "fa:16:3e:e4:17:89", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbab20d9-2b", "ovs_interfaceid": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "address": "fa:16:3e:4c:4a:a6", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f12897-9a", "ovs_interfaceid": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] Releasing lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG nova.compute.manager [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-changed-15f12897-9a5b-4c7a-b80e-4889ce96f780 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG nova.compute.manager [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing instance network info cache due to event network-changed-15f12897-9a5b-4c7a-b80e-4889ce96f780. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] Acquiring lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] Acquired lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:23 user nova-compute[74692]: DEBUG nova.network.neutron [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing network info cache for port 15f12897-9a5b-4c7a-b80e-4889ce96f780 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG nova.network.neutron [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updated VIF entry in instance network info cache for port 15f12897-9a5b-4c7a-b80e-4889ce96f780. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG nova.network.neutron [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updating instance_info_cache with network_info: [{"id": "a4b46c64-5441-46a3-8da4-529a1d32046e", "address": "fa:16:3e:04:37:ca", "network": {"id": "a4f639ab-5d23-44cf-9586-1df19a47170c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1273332395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b46c64-54", "ovs_interfaceid": "a4b46c64-5441-46a3-8da4-529a1d32046e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd5d1c9a-bf27-47ce-9047-72844816accd", "address": "fa:16:3e:c1:a9:96", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5d1c9a-bf", "ovs_interfaceid": "bd5d1c9a-bf27-47ce-9047-72844816accd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "address": "fa:16:3e:87:4c:60", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2a0340-80", "ovs_interfaceid": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "address": "fa:16:3e:e9:84:44", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd929622-57", "ovs_interfaceid": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11839468-beda-436e-9437-715fdaa17168", "address": "fa:16:3e:94:77:bc", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11839468-be", "ovs_interfaceid": "11839468-beda-436e-9437-715fdaa17168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "address": "fa:16:3e:e4:17:89", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbab20d9-2b", "ovs_interfaceid": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "address": "fa:16:3e:4c:4a:a6", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f12897-9a", "ovs_interfaceid": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-858beb66-0ed0-4f57-bf17-3145cdc63598 req-019446b9-b1a3-4d82-ba5b-744bde1a9619 service nova] Releasing lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:24 user nova-compute[74692]: INFO nova.virt.block_device [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Booting with volume 909eed5b-357b-447f-8a30-de499ef54b1a at /dev/vdc
Nov 18 18:29:24 user nova-compute[74692]: DEBUG os_brick.utils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4493a149-1d2d-4ba2-b13a-0c71e25efb8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dfa756-8b8e-4011-88ad-6144b8dd9930]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f93e28-0a83-4051-88d6-9d5877b0fd27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7350af27-22b1-4b27-a074-a73de02a2552]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:29:24 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:29:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[800bd455-2207-427a-a784-f1e37ceced96]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG os_brick.utils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:29:24 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updating existing volume attachment record: d79d8d17-f32b-4b1a-b71b-aa1fc9b7c4f5 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:29:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:29:29 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Creating image(s)
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Ensure instance console log exists: /opt/stack/data/nova/instances/e1603038-3a10-4efb-b5f7-15495ccd3717/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Start _get_guest_xml network_info=[{"id": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "address": "fa:16:3e:fb:50:e4", "network": {"id": "27774fe7-2099-4253-8194-b6d160291ece", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-210587587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d79063-ef", "ovs_interfaceid": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14e00c18-ad6b-4481-852d-e336bee32648", "address": "fa:16:3e:6a:7c:8a", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e00c18-ad", "ovs_interfaceid": "14e00c18-ad6b-4481-852d-e336bee32648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "address": "fa:16:3e:2f:01:4c", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26cb4ab6-5d", "ovs_interfaceid": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "050fa40f-fc29-49bd-b29d-c7954818aa63", "address": "fa:16:3e:32:3f:b3", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050fa40f-fc", "ovs_interfaceid": "050fa40f-fc29-49bd-b29d-c7954818aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYKWNbIB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1603038-3a10-4efb-b5f7-15495ccd3717', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab8ee283-42a6-4087-b21b-7a12bcd8687e', 'serial': 'ab8ee283-42a6-4087-b21b-7a12bcd8687e'}, 'attachment_id': '52f2a00b-c3bd-4cc6-88d6-89503be7cb08', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjIXCMAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1603038-3a10-4efb-b5f7-15495ccd3717', 'attached_at': '', 'detached_at': '', 'volume_id': 'c77d7f8c-d05c-45f4-b339-5f63fe0064cf', 'serial': 'c77d7f8c-d05c-45f4-b339-5f63fe0064cf'}, 'attachment_id': '92eba9d8-09f7-44ef-a18c-963ac50ad9f6', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyNpVbYx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1603038-3a10-4efb-b5f7-15495ccd3717', 'attached_at': '', 'detached_at': '', 'volume_id': '16a4a768-c177-444c-bed8-eaa5a3fa1f87', 'serial': '16a4a768-c177-444c-bed8-eaa5a3fa1f87'}, 'attachment_id': '5f2d6081-8699-48f8-a28f-30f2b01f29ac', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:29:29 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:29:29 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYKWNbIB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:29:29 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:29:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:29:29 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:29:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:29:29 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e631cef-b7b8-4b02-9dd9-ac23b5242401]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:29:29 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[894eab22-6f28-4e87-bbc5-7ce22918553a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e] added
Nov 18 18:29:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c1913e-14b6-4f33-8821-71f61a6f60f9]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c46fb5a-ca96-4a58-82d5-8c6728da9b0d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYKWNbIB {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYKWNbIB" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d05f02-07fb-4205-9d68-1a2da959ee03]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vYKWNbIB'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[960f3104-93e0-4b64-8757-20cd9f21a4cd]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b4dcc0-cdab-4e3e-8b09-f2dc1e652329]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:30 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:30 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0457e6a1-2ddc-4ecb-9dce-a113e06dc233]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e, portal: 172.16.0.220,3260]
Nov 18 18:29:30 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e, portal: 172.16.0.220,3260] successful.
Nov 18 18:29:30 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f98407-ae40-47dc-a5bd-b046776b6212]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e648a30f-620b-4b12-8f18-789ec6c43f4c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:30 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:30 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:30 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:30 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[250dc40a-74c8-48d3-82fd-39c1dece6a21]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:29:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYKWNbIB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23631656133623765', 'path': '/dev/sdc'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631656133623765', 'path': '/dev/sdc'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjIXCMAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:29:31 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:29:31 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:29:31 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d432f6d7-ce28-4d95-82c4-5aa32ec75134]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:29:31 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[864e7f6d-e014-4f98-9722-dbe67ce83c4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf] added
Nov 18 18:29:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[430d6893-92d8-4ba6-898f-62ee759a5e98]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0917fec1-83a0-4a92-ab61-05a36caf0af3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gjIXCMAW {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gjIXCMAW" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efec070-6115-456b-bc85-1126a858047f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gjIXCMAW'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:29:31 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Creating image(s)
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Ensure instance console log exists: /opt/stack/data/nova/instances/40481706-78c9-402d-9d19-d2d00d812095/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Start _get_guest_xml network_info=[{"id": "a4b46c64-5441-46a3-8da4-529a1d32046e", "address": "fa:16:3e:04:37:ca", "network": {"id": "a4f639ab-5d23-44cf-9586-1df19a47170c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1273332395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b46c64-54", "ovs_interfaceid": "a4b46c64-5441-46a3-8da4-529a1d32046e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd5d1c9a-bf27-47ce-9047-72844816accd", "address": "fa:16:3e:c1:a9:96", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5d1c9a-bf", "ovs_interfaceid": "bd5d1c9a-bf27-47ce-9047-72844816accd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "address": "fa:16:3e:87:4c:60", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2a0340-80", "ovs_interfaceid": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "address": "fa:16:3e:e9:84:44", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd929622-57", "ovs_interfaceid": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11839468-beda-436e-9437-715fdaa17168", "address": "fa:16:3e:94:77:bc", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11839468-be", "ovs_interfaceid": "11839468-beda-436e-9437-715fdaa17168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "address": "fa:16:3e:e4:17:89", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbab20d9-2b", "ovs_interfaceid": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "address": "fa:16:3e:4c:4a:a6", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f12897-9a", "ovs_interfaceid": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZOkQCzN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '40481706-78c9-402d-9d19-d2d00d812095', 'attached_at': '', 'detached_at': '', 'volume_id': '0c599e24-bfc8-42cb-8129-6ba1be0c7593', 'serial': '0c599e24-bfc8-42cb-8129-6ba1be0c7593'}, 'attachment_id': '9e3acb15-cb60-4d99-a648-c418974e4e62', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLuyjFXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '40481706-78c9-402d-9d19-d2d00d812095', 'attached_at': '', 'detached_at': '', 'volume_id': '3b8693b0-604a-41d5-a99a-dca528178e16', 'serial': '3b8693b0-604a-41d5-a99a-dca528178e16'}, 'attachment_id': '3fbea96c-abf5-4e0f-8b7e-b508f60dd44d', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOnIcsPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '40481706-78c9-402d-9d19-d2d00d812095', 'attached_at': '', 'detached_at': '', 'volume_id': '909eed5b-357b-447f-8a30-de499ef54b1a', 'serial': '909eed5b-357b-447f-8a30-de499ef54b1a'}, 'attachment_id': 'd79d8d17-f32b-4b1a-b71b-aa1fc9b7c4f5', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:31 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:29:31 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e54d06a-ebfc-4cc9-9559-c99bff109da6]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZOkQCzN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:29:31 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63a51a2-008c-43f3-bee7-bad83f1344cb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:31 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:31 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1d1c0e-d290-498f-abd6-a14744786342]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf, portal: 172.16.0.220,3260]
Nov 18 18:29:31 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf, portal: 172.16.0.220,3260] successful.
Nov 18 18:29:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb02ab7-8710-4c10-aa7d-d0b4dd171bb2]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fe90b4-cb7e-482f-a73a-3ad5e729d09a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:31 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:31 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:31 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:31 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e03240d-e504-4635-9aad-9653b0c95d39]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:29:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjIXCMAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23831326562663031', 'path': '/dev/sdd'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831326562663031', 'path': '/dev/sdd'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.145s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:29:32 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:29:32 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ea720c-90b3-4aa4-bcd1-55e59eb155cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:29:32 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyNpVbYx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:29:32 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[420f5f1e-a5a1-4a3d-ad82-fecc9286dd7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593] added
Nov 18 18:29:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4e5cfe-4483-4705-b003-5a8b708ec727]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fca150f-35f4-48ad-9403-215bf48b3e11]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XZOkQCzN {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XZOkQCzN" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c96f984-cebd-4a5f-99a4-6db3da8ddf80]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XZOkQCzN'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ef89ca-56f1-4731-bfdc-5fd788096af4]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d5c65d-c120-4a52-b17e-a65d135e4997]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:32 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:32 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:32 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:32 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0701ca7c-4212-4464-8943-8e7ae8946b6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593, portal: 172.16.0.220,3260]
Nov 18 18:29:32 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593, portal: 172.16.0.220,3260] successful.
Nov 18 18:29:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f393d5-23b1-4aa8-b37d-ca22933db160]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d475d662-b867-446c-840f-aac76ee7c1de]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:32 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:32 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:32 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:32 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:32 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:32 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:29:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a089b21-72fd-4701-8662-05247f4f809c]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:33 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZOkQCzN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] <== connect_volume: return (2607ms) {'type': 'block', 'scsi_wwn': '23738356134336435', 'path': '/dev/sde'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738356134336435', 'path': '/dev/sde'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.410s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:29:34 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:29:34 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLuyjFXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:29:34 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc65b38-1b81-4a19-a007-54ed247ab712]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:29:34 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba983e5-f818-40e7-ad44-79e46ca8c5d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87] added
Nov 18 18:29:34 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[51240064-6453-4e5d-9793-7af96b728da3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b6bda0-d223-4862-9f44-7c0840ea5548]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HyNpVbYx {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HyNpVbYx" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[630788fd-2bb5-4d4d-a117-85e1ce99cecd]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HyNpVbYx'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[750a936e-6e20-4915-b749-6ad03351a40c]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c323b1fd-de3c-4c66-b55e-8b4617626e0d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:34 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:34 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:34 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:34 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:34 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:34 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:34 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:34 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b613be-40af-47e8-a601-45016cfd0594]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87, portal: 172.16.0.220,3260]
Nov 18 18:29:34 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87, portal: 172.16.0.220,3260] successful.
Nov 18 18:29:34 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7e05e9-5139-4b55-b40b-8c5a487823d3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d0c308-675c-4383-8a3f-a955924f499b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:34 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:34 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:34 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:34 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:29:34 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:34 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:34 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:34 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:34 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:29:34 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bc28f8-a75e-47e3-a021-a340e0b975ab]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyNpVbYx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:29:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] <== connect_volume: return (2755ms) {'type': 'block', 'scsi_wwn': '26332393365366230', 'path': '/dev/sdf'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332393365366230', 'path': '/dev/sdf'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.318s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:29:35 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:29:35 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "address": "fa:16:3e:fb:50:e4", "network": {"id": "27774fe7-2099-4253-8194-b6d160291ece", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-210587587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d79063-ef", "ovs_interfaceid": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "address": "fa:16:3e:fb:50:e4", "network": {"id": "27774fe7-2099-4253-8194-b6d160291ece", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-210587587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d79063-ef", "ovs_interfaceid": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:50:e4,bridge_name='br-int',has_traffic_filtering=True,id=d3d79063-efeb-4014-acb1-ddcfc7c57309,network=Network(27774fe7-2099-4253-8194-b6d160291ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d79063-ef') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ab:b4,bridge_name='br-int',has_traffic_filtering=True,id=81eda6a3-90f4-42dc-8462-171ec3afbf2f,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81eda6a3-90') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a7:62,bridge_name='br-int',has_traffic_filtering=True,id=a955bfd0-166d-4030-bb78-6402891c7af3,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa955bfd0-16') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:79:03,bridge_name='br-int',has_traffic_filtering=True,id=820a0454-d628-4849-956e-e219a7c77f71,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820a0454-d6') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14e00c18-ad6b-4481-852d-e336bee32648", "address": "fa:16:3e:6a:7c:8a", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e00c18-ad", "ovs_interfaceid": "14e00c18-ad6b-4481-852d-e336bee32648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "14e00c18-ad6b-4481-852d-e336bee32648", "address": "fa:16:3e:6a:7c:8a", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e00c18-ad", "ovs_interfaceid": "14e00c18-ad6b-4481-852d-e336bee32648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7c:8a,bridge_name='br-int',has_traffic_filtering=True,id=14e00c18-ad6b-4481-852d-e336bee32648,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e00c18-ad') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "address": "fa:16:3e:2f:01:4c", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26cb4ab6-5d", "ovs_interfaceid": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "address": "fa:16:3e:2f:01:4c", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26cb4ab6-5d", "ovs_interfaceid": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:01:4c,bridge_name='br-int',has_traffic_filtering=True,id=26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe,network=Network(404ec382-2e6d-4924-bf12-3e796e02e1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26cb4ab6-5d') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "050fa40f-fc29-49bd-b29d-c7954818aa63", "address": "fa:16:3e:32:3f:b3", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050fa40f-fc", "ovs_interfaceid": "050fa40f-fc29-49bd-b29d-c7954818aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "050fa40f-fc29-49bd-b29d-c7954818aa63", "address": "fa:16:3e:32:3f:b3", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050fa40f-fc", "ovs_interfaceid": "050fa40f-fc29-49bd-b29d-c7954818aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:3f:b3,bridge_name='br-int',has_traffic_filtering=True,id=050fa40f-fc29-49bd-b29d-c7954818aa63,network=Network(404ec382-2e6d-4924-bf12-3e796e02e1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap050fa40f-fc') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.objects.instance [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lazy-loading 'pci_devices' on Instance uuid e1603038-3a10-4efb-b5f7-15495ccd3717 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc01598-d1a4-44cc-80ec-cd8627c05a0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:29:35 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:29:35 user nova-compute[74692]:   <uuid>e1603038-3a10-4efb-b5f7-15495ccd3717</uuid>
Nov 18 18:29:35 user nova-compute[74692]:   <name>instance-00000009</name>
Nov 18 18:29:35 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:29:35 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:29:35 user nova-compute[74692]:   <metadata>
Nov 18 18:29:35 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:29:35 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:29:35 user nova-compute[74692]:       <nova:name>tempest-device-tagging-server-1448869874</nova:name>
Nov 18 18:29:35 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:29:29</nova:creationTime>
Nov 18 18:29:35 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:29:35 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:29:35 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:29:35 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:29:35 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:29:35 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:29:35 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:29:35 user nova-compute[74692]:       <nova:owner>
Nov 18 18:29:35 user nova-compute[74692]:         <nova:user uuid="68365438753241d3964290162350e225">tempest-TaggedBootDevicesTest-1827349967-project-member</nova:user>
Nov 18 18:29:35 user nova-compute[74692]:         <nova:project uuid="4e3d9f86d2ba49ecbb73e8128900d73b">tempest-TaggedBootDevicesTest-1827349967</nova:project>
Nov 18 18:29:35 user nova-compute[74692]:       </nova:owner>
Nov 18 18:29:35 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:29:35 user nova-compute[74692]:       <nova:ports>
Nov 18 18:29:35 user nova-compute[74692]:         <nova:port uuid="d3d79063-efeb-4014-acb1-ddcfc7c57309">
Nov 18 18:29:35 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 18 18:29:35 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:35 user nova-compute[74692]:         <nova:port uuid="81eda6a3-90f4-42dc-8462-171ec3afbf2f">
Nov 18 18:29:35 user nova-compute[74692]:           <nova:ip type="fixed" address="10.1.1.126" ipVersion="4"/>
Nov 18 18:29:35 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:35 user nova-compute[74692]:         <nova:port uuid="a955bfd0-166d-4030-bb78-6402891c7af3">
Nov 18 18:29:35 user nova-compute[74692]:           <nova:ip type="fixed" address="10.1.1.197" ipVersion="4"/>
Nov 18 18:29:35 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:35 user nova-compute[74692]:         <nova:port uuid="820a0454-d628-4849-956e-e219a7c77f71">
Nov 18 18:29:35 user nova-compute[74692]:           <nova:ip type="fixed" address="10.1.1.112" ipVersion="4"/>
Nov 18 18:29:35 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:35 user nova-compute[74692]:         <nova:port uuid="14e00c18-ad6b-4481-852d-e336bee32648">
Nov 18 18:29:35 user nova-compute[74692]:           <nova:ip type="fixed" address="10.1.1.117" ipVersion="4"/>
Nov 18 18:29:35 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:35 user nova-compute[74692]:         <nova:port uuid="26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe">
Nov 18 18:29:35 user nova-compute[74692]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 18 18:29:35 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:35 user nova-compute[74692]:         <nova:port uuid="050fa40f-fc29-49bd-b29d-c7954818aa63">
Nov 18 18:29:35 user nova-compute[74692]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 18 18:29:35 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:35 user nova-compute[74692]:       </nova:ports>
Nov 18 18:29:35 user nova-compute[74692]:     </nova:instance>
Nov 18 18:29:35 user nova-compute[74692]:   </metadata>
Nov 18 18:29:35 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:29:35 user nova-compute[74692]:     <system>
Nov 18 18:29:35 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:29:35 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:29:35 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:29:35 user nova-compute[74692]:       <entry name="serial">e1603038-3a10-4efb-b5f7-15495ccd3717</entry>
Nov 18 18:29:35 user nova-compute[74692]:       <entry name="uuid">e1603038-3a10-4efb-b5f7-15495ccd3717</entry>
Nov 18 18:29:35 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:29:35 user nova-compute[74692]:     </system>
Nov 18 18:29:35 user nova-compute[74692]:   </sysinfo>
Nov 18 18:29:35 user nova-compute[74692]:   <os>
Nov 18 18:29:35 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:29:35 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:29:35 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:29:35 user nova-compute[74692]:   </os>
Nov 18 18:29:35 user nova-compute[74692]:   <features>
Nov 18 18:29:35 user nova-compute[74692]:     <acpi/>
Nov 18 18:29:35 user nova-compute[74692]:     <apic/>
Nov 18 18:29:35 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:29:35 user nova-compute[74692]:   </features>
Nov 18 18:29:35 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:29:35 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:29:35 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:29:35 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:29:35 user nova-compute[74692]:   </clock>
Nov 18 18:29:35 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:29:35 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:29:35 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:29:35 user nova-compute[74692]:   </cpu>
Nov 18 18:29:35 user nova-compute[74692]:   <devices>
Nov 18 18:29:35 user nova-compute[74692]:     <disk type="file" device="cdrom">
Nov 18 18:29:35 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none"/>
Nov 18 18:29:35 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/e1603038-3a10-4efb-b5f7-15495ccd3717/disk.config"/>
Nov 18 18:29:35 user nova-compute[74692]:       <target dev="hda" bus="ide"/>
Nov 18 18:29:35 user nova-compute[74692]:     </disk>
Nov 18 18:29:35 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:29:35 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:29:35 user nova-compute[74692]:       <source dev="/dev/sdc"/>
Nov 18 18:29:35 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:29:35 user nova-compute[74692]:       <serial>ab8ee283-42a6-4087-b21b-7a12bcd8687e</serial>
Nov 18 18:29:35 user nova-compute[74692]:     </disk>
Nov 18 18:29:35 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:29:35 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:29:35 user nova-compute[74692]:       <source dev="/dev/sdd"/>
Nov 18 18:29:35 user nova-compute[74692]:       <target dev="vdb" bus="virtio"/>
Nov 18 18:29:35 user nova-compute[74692]:       <serial>c77d7f8c-d05c-45f4-b339-5f63fe0064cf</serial>
Nov 18 18:29:35 user nova-compute[74692]:     </disk>
Nov 18 18:29:35 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:29:35 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:29:35 user nova-compute[74692]:       <source dev="/dev/sdf"/>
Nov 18 18:29:35 user nova-compute[74692]:       <target dev="vdc" bus="virtio"/>
Nov 18 18:29:35 user nova-compute[74692]:       <serial>16a4a768-c177-444c-bed8-eaa5a3fa1f87</serial>
Nov 18 18:29:35 user nova-compute[74692]:     </disk>
Nov 18 18:29:35 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:35 user nova-compute[74692]:       <mac address="fa:16:3e:fb:50:e4"/>
Nov 18 18:29:35 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:35 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:35 user nova-compute[74692]:       <target dev="tapd3d79063-ef"/>
Nov 18 18:29:35 user nova-compute[74692]:     </interface>
Nov 18 18:29:35 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:35 user nova-compute[74692]:       <mac address="fa:16:3e:4c:ab:b4"/>
Nov 18 18:29:35 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:35 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:35 user nova-compute[74692]:       <target dev="tap81eda6a3-90"/>
Nov 18 18:29:35 user nova-compute[74692]:     </interface>
Nov 18 18:29:35 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:35 user nova-compute[74692]:       <mac address="fa:16:3e:fd:a7:62"/>
Nov 18 18:29:35 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:35 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:35 user nova-compute[74692]:       <target dev="tapa955bfd0-16"/>
Nov 18 18:29:35 user nova-compute[74692]:     </interface>
Nov 18 18:29:35 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:35 user nova-compute[74692]:       <mac address="fa:16:3e:f0:79:03"/>
Nov 18 18:29:35 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:35 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:35 user nova-compute[74692]:       <target dev="tap820a0454-d6"/>
Nov 18 18:29:35 user nova-compute[74692]:     </interface>
Nov 18 18:29:35 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:35 user nova-compute[74692]:       <mac address="fa:16:3e:6a:7c:8a"/>
Nov 18 18:29:35 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:35 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:35 user nova-compute[74692]:       <target dev="tap14e00c18-ad"/>
Nov 18 18:29:35 user nova-compute[74692]:     </interface>
Nov 18 18:29:35 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:35 user nova-compute[74692]:       <mac address="fa:16:3e:2f:01:4c"/>
Nov 18 18:29:35 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:35 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:35 user nova-compute[74692]:       <target dev="tap26cb4ab6-5d"/>
Nov 18 18:29:35 user nova-compute[74692]:     </interface>
Nov 18 18:29:35 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:35 user nova-compute[74692]:       <mac address="fa:16:3e:32:3f:b3"/>
Nov 18 18:29:35 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:35 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:35 user nova-compute[74692]:       <target dev="tap050fa40f-fc"/>
Nov 18 18:29:35 user nova-compute[74692]:     </interface>
Nov 18 18:29:35 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:29:35 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/e1603038-3a10-4efb-b5f7-15495ccd3717/console.log" append="off"/>
Nov 18 18:29:35 user nova-compute[74692]:     </serial>
Nov 18 18:29:35 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:29:35 user nova-compute[74692]:     <video>
Nov 18 18:29:35 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:35 user nova-compute[74692]:     </video>
Nov 18 18:29:35 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:29:35 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:29:35 user nova-compute[74692]:     </rng>
Nov 18 18:29:35 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:29:35 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:29:35 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:29:35 user nova-compute[74692]:     </memballoon>
Nov 18 18:29:35 user nova-compute[74692]:   </devices>
Nov 18 18:29:35 user nova-compute[74692]: </domain>
Nov 18 18:29:35 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "address": "fa:16:3e:fb:50:e4", "network": {"id": "27774fe7-2099-4253-8194-b6d160291ece", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-210587587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d79063-ef", "ovs_interfaceid": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "address": "fa:16:3e:fb:50:e4", "network": {"id": "27774fe7-2099-4253-8194-b6d160291ece", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-210587587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d79063-ef", "ovs_interfaceid": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:50:e4,bridge_name='br-int',has_traffic_filtering=True,id=d3d79063-efeb-4014-acb1-ddcfc7c57309,network=Network(27774fe7-2099-4253-8194-b6d160291ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d79063-ef') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:50:e4,bridge_name='br-int',has_traffic_filtering=True,id=d3d79063-efeb-4014-acb1-ddcfc7c57309,network=Network(27774fe7-2099-4253-8194-b6d160291ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d79063-ef') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfe7331-0a62-426f-bba8-bcd78ac22231]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85701501-fcbe-5465-a6c9-a0320ce4d1b7', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16] added
Nov 18 18:29:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3d79063-ef, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3d79063-ef, col_values=(('qos', UUID('818f926f-294c-49a5-bd4e-dd435ed78b6c')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3d79063-ef, col_values=(('external_ids', {'iface-id': 'd3d79063-efeb-4014-acb1-ddcfc7c57309', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:50:e4', 'vm-uuid': 'e1603038-3a10-4efb-b5f7-15495ccd3717'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: INFO os_vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:50:e4,bridge_name='br-int',has_traffic_filtering=True,id=d3d79063-efeb-4014-acb1-ddcfc7c57309,network=Network(27774fe7-2099-4253-8194-b6d160291ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d79063-ef')
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ab:b4,bridge_name='br-int',has_traffic_filtering=True,id=81eda6a3-90f4-42dc-8462-171ec3afbf2f,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81eda6a3-90') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ab:b4,bridge_name='br-int',has_traffic_filtering=True,id=81eda6a3-90f4-42dc-8462-171ec3afbf2f,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81eda6a3-90') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b09894-b444-4360-8ee9-5ec48f4f5a78]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '871bfb7d-b3bf-5c99-94ee-c2640749141a', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81eda6a3-90, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81eda6a3-90, col_values=(('qos', UUID('d3e4aeeb-3815-4976-bed2-fcdc2bcb850a')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81eda6a3-90, col_values=(('external_ids', {'iface-id': '81eda6a3-90f4-42dc-8462-171ec3afbf2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:ab:b4', 'vm-uuid': 'e1603038-3a10-4efb-b5f7-15495ccd3717'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[802bf2ca-7c40-47f2-ba7b-860eb02a998a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sLuyjFXw {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: INFO os_vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ab:b4,bridge_name='br-int',has_traffic_filtering=True,id=81eda6a3-90f4-42dc-8462-171ec3afbf2f,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81eda6a3-90')
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a7:62,bridge_name='br-int',has_traffic_filtering=True,id=a955bfd0-166d-4030-bb78-6402891c7af3,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa955bfd0-16') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a7:62,bridge_name='br-int',has_traffic_filtering=True,id=a955bfd0-166d-4030-bb78-6402891c7af3,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa955bfd0-16') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c427559-a394-5cc7-b163-602c6aaaa3de', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sLuyjFXw" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[da03f20e-82ea-4bef-be41-594030818aa2]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sLuyjFXw'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa955bfd0-16, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa955bfd0-16, col_values=(('qos', UUID('9246445f-0570-4284-892a-14900fdb7be7')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa955bfd0-16, col_values=(('external_ids', {'iface-id': 'a955bfd0-166d-4030-bb78-6402891c7af3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:a7:62', 'vm-uuid': 'e1603038-3a10-4efb-b5f7-15495ccd3717'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee9fb08-477a-4d2f-9edd-6a3c3c3ee0e5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: INFO os_vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a7:62,bridge_name='br-int',has_traffic_filtering=True,id=a955bfd0-166d-4030-bb78-6402891c7af3,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa955bfd0-16')
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:79:03,bridge_name='br-int',has_traffic_filtering=True,id=820a0454-d628-4849-956e-e219a7c77f71,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820a0454-d6') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:79:03,bridge_name='br-int',has_traffic_filtering=True,id=820a0454-d628-4849-956e-e219a7c77f71,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820a0454-d6') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f7a7dec-256a-569b-bc06-669d8ea5e785', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a45f6d-69ea-46b2-a5a3-464550681bb5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:29:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:29:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap820a0454-d6, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap820a0454-d6, col_values=(('qos', UUID('7b1b9476-3aa9-4cff-be44-4a2049f7f635')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap820a0454-d6, col_values=(('external_ids', {'iface-id': '820a0454-d628-4849-956e-e219a7c77f71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:79:03', 'vm-uuid': 'e1603038-3a10-4efb-b5f7-15495ccd3717'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d55f07-5b35-49f2-807b-7923c6bb44e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16, portal: 172.16.0.220,3260]
Nov 18 18:29:35 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16, portal: 172.16.0.220,3260] successful.
Nov 18 18:29:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: INFO os_vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:79:03,bridge_name='br-int',has_traffic_filtering=True,id=820a0454-d628-4849-956e-e219a7c77f71,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820a0454-d6')
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14e00c18-ad6b-4481-852d-e336bee32648", "address": "fa:16:3e:6a:7c:8a", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e00c18-ad", "ovs_interfaceid": "14e00c18-ad6b-4481-852d-e336bee32648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "14e00c18-ad6b-4481-852d-e336bee32648", "address": "fa:16:3e:6a:7c:8a", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e00c18-ad", "ovs_interfaceid": "14e00c18-ad6b-4481-852d-e336bee32648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7c:8a,bridge_name='br-int',has_traffic_filtering=True,id=14e00c18-ad6b-4481-852d-e336bee32648,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e00c18-ad') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7c:8a,bridge_name='br-int',has_traffic_filtering=True,id=14e00c18-ad6b-4481-852d-e336bee32648,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e00c18-ad') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd8ce007-ff78-5c16-af7d-8bebfdc71b26', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f828163-a423-47a7-881f-7cc075cc5d53]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14e00c18-ad, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14e00c18-ad, col_values=(('qos', UUID('a7767406-5dfa-42a8-a9e8-08d96c55abee')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14e00c18-ad, col_values=(('external_ids', {'iface-id': '14e00c18-ad6b-4481-852d-e336bee32648', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:7c:8a', 'vm-uuid': 'e1603038-3a10-4efb-b5f7-15495ccd3717'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9274216e-74cb-4161-aa5b-b540713c8162]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:29:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:29:35 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:29:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfefbc7f-c6e9-4d57-9a58-7506ac8f096d]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLuyjFXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: INFO os_vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7c:8a,bridge_name='br-int',has_traffic_filtering=True,id=14e00c18-ad6b-4481-852d-e336bee32648,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e00c18-ad')
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "address": "fa:16:3e:2f:01:4c", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26cb4ab6-5d", "ovs_interfaceid": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "address": "fa:16:3e:2f:01:4c", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26cb4ab6-5d", "ovs_interfaceid": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:01:4c,bridge_name='br-int',has_traffic_filtering=True,id=26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe,network=Network(404ec382-2e6d-4924-bf12-3e796e02e1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26cb4ab6-5d') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:01:4c,bridge_name='br-int',has_traffic_filtering=True,id=26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe,network=Network(404ec382-2e6d-4924-bf12-3e796e02e1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26cb4ab6-5d') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5fb20d81-289c-5bb4-96c4-e7c675bfc2e2', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26cb4ab6-5d, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26cb4ab6-5d, col_values=(('qos', UUID('db77f127-ba2a-4a23-8b16-063287d6d749')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26cb4ab6-5d, col_values=(('external_ids', {'iface-id': '26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:01:4c', 'vm-uuid': 'e1603038-3a10-4efb-b5f7-15495ccd3717'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: INFO os_vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:01:4c,bridge_name='br-int',has_traffic_filtering=True,id=26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe,network=Network(404ec382-2e6d-4924-bf12-3e796e02e1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26cb4ab6-5d')
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "050fa40f-fc29-49bd-b29d-c7954818aa63", "address": "fa:16:3e:32:3f:b3", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050fa40f-fc", "ovs_interfaceid": "050fa40f-fc29-49bd-b29d-c7954818aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "050fa40f-fc29-49bd-b29d-c7954818aa63", "address": "fa:16:3e:32:3f:b3", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050fa40f-fc", "ovs_interfaceid": "050fa40f-fc29-49bd-b29d-c7954818aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:3f:b3,bridge_name='br-int',has_traffic_filtering=True,id=050fa40f-fc29-49bd-b29d-c7954818aa63,network=Network(404ec382-2e6d-4924-bf12-3e796e02e1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap050fa40f-fc') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG os_vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:3f:b3,bridge_name='br-int',has_traffic_filtering=True,id=050fa40f-fc29-49bd-b29d-c7954818aa63,network=Network(404ec382-2e6d-4924-bf12-3e796e02e1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap050fa40f-fc') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '178eea4f-b265-518e-be2a-a30c5c481461', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap050fa40f-fc, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap050fa40f-fc, col_values=(('qos', UUID('1eda4a44-cb06-4dee-80a2-43e85539b055')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap050fa40f-fc, col_values=(('external_ids', {'iface-id': '050fa40f-fc29-49bd-b29d-c7954818aa63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:3f:b3', 'vm-uuid': 'e1603038-3a10-4efb-b5f7-15495ccd3717'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:36 user nova-compute[74692]: INFO os_vif [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:3f:b3,bridge_name='br-int',has_traffic_filtering=True,id=050fa40f-fc29-49bd-b29d-c7954818aa63,network=Network(404ec382-2e6d-4924-bf12-3e796e02e1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap050fa40f-fc')
Nov 18 18:29:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] No BDM found with device name hda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] No VIF found with MAC fa:16:3e:fb:50:e4, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] No VIF found with MAC fa:16:3e:6a:7c:8a, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:29:36 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Using config drive
Nov 18 18:29:36 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Creating config drive at /opt/stack/data/nova/instances/e1603038-3a10-4efb-b5f7-15495ccd3717/disk.config
Nov 18 18:29:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e1603038-3a10-4efb-b5f7-15495ccd3717/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvz8s68k3 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e1603038-3a10-4efb-b5f7-15495ccd3717/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvz8s68k3" returned: 0 in 0.051s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] <== connect_volume: return (2768ms) {'type': 'block', 'scsi_wwn': '26537613237626237', 'path': '/dev/sdg'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537613237626237', 'path': '/dev/sdg'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOnIcsPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:29:36 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:29:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:29:36 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:29:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:29:36 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:29:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69e1c4b-628c-4445-bb7a-f72fe465727a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:29:36 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c53e92-3524-4674-a797-613906edba98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a] added
Nov 18 18:29:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a556475-7dc9-4af8-b56f-4716b1734c4f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.120s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1166fa20-7bc5-4b7b-891f-240ef01d9be1]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bOnIcsPu {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bOnIcsPu" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[229067e2-0ba6-48ff-88ac-4d62d6c6c940]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bOnIcsPu'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd13f27a-4e3c-4e42-ac7d-02e3d74c6a76]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[79448d93-dcf0-4186-b1b6-7c5c833156fb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72276e1-3eb8-43b9-b38f-d6a7ced5be7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a, portal: 172.16.0.220,3260]
Nov 18 18:29:37 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a, portal: 172.16.0.220,3260] successful.
Nov 18 18:29:37 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fe866a-9e59-4579-9ea4-917947f2ed08]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a6146f-76a6-4ae8-8b44-0f677d3fe2ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:29:37 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:29:37 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:29:37 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e269c8ca-e097-41c3-9352-926a1f2e05d5]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOnIcsPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-ccbbe830-a588-4efa-b150-2be71bc88f2b req-b3e81bf9-d364-4993-9b93-dfbbe2e1e8e4 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-d3d79063-efeb-4014-acb1-ddcfc7c57309 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ccbbe830-a588-4efa-b150-2be71bc88f2b req-b3e81bf9-d364-4993-9b93-dfbbe2e1e8e4 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ccbbe830-a588-4efa-b150-2be71bc88f2b req-b3e81bf9-d364-4993-9b93-dfbbe2e1e8e4 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ccbbe830-a588-4efa-b150-2be71bc88f2b req-b3e81bf9-d364-4993-9b93-dfbbe2e1e8e4 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-ccbbe830-a588-4efa-b150-2be71bc88f2b req-b3e81bf9-d364-4993-9b93-dfbbe2e1e8e4 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-d3d79063-efeb-4014-acb1-ddcfc7c57309 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:38 user nova-compute[74692]: WARNING nova.compute.manager [req-ccbbe830-a588-4efa-b150-2be71bc88f2b req-b3e81bf9-d364-4993-9b93-dfbbe2e1e8e4 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-d3d79063-efeb-4014-acb1-ddcfc7c57309 for instance with vm_state building and task_state spawning.
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.473s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] <== connect_volume: return (1475ms) {'type': 'block', 'scsi_wwn': '23037343435633565', 'path': '/dev/sdh'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037343435633565', 'path': '/dev/sdh'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4b46c64-5441-46a3-8da4-529a1d32046e", "address": "fa:16:3e:04:37:ca", "network": {"id": "a4f639ab-5d23-44cf-9586-1df19a47170c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1273332395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b46c64-54", "ovs_interfaceid": "a4b46c64-5441-46a3-8da4-529a1d32046e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "a4b46c64-5441-46a3-8da4-529a1d32046e", "address": "fa:16:3e:04:37:ca", "network": {"id": "a4f639ab-5d23-44cf-9586-1df19a47170c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1273332395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b46c64-54", "ovs_interfaceid": "a4b46c64-5441-46a3-8da4-529a1d32046e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:37:ca,bridge_name='br-int',has_traffic_filtering=True,id=a4b46c64-5441-46a3-8da4-529a1d32046e,network=Network(a4f639ab-5d23-44cf-9586-1df19a47170c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4b46c64-54') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd5d1c9a-bf27-47ce-9047-72844816accd", "address": "fa:16:3e:c1:a9:96", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5d1c9a-bf", "ovs_interfaceid": "bd5d1c9a-bf27-47ce-9047-72844816accd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "bd5d1c9a-bf27-47ce-9047-72844816accd", "address": "fa:16:3e:c1:a9:96", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5d1c9a-bf", "ovs_interfaceid": "bd5d1c9a-bf27-47ce-9047-72844816accd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a9:96,bridge_name='br-int',has_traffic_filtering=True,id=bd5d1c9a-bf27-47ce-9047-72844816accd,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd5d1c9a-bf') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "address": "fa:16:3e:87:4c:60", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2a0340-80", "ovs_interfaceid": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "address": "fa:16:3e:87:4c:60", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2a0340-80", "ovs_interfaceid": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4c:60,bridge_name='br-int',has_traffic_filtering=True,id=8c2a0340-808f-4987-a0dd-38d3d9548b4d,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c2a0340-80') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "address": "fa:16:3e:e9:84:44", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd929622-57", "ovs_interfaceid": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "address": "fa:16:3e:e9:84:44", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd929622-57", "ovs_interfaceid": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:84:44,bridge_name='br-int',has_traffic_filtering=True,id=dd929622-57d9-4e8c-9012-6340cc9d39ff,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd929622-57') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11839468-beda-436e-9437-715fdaa17168", "address": "fa:16:3e:94:77:bc", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11839468-be", "ovs_interfaceid": "11839468-beda-436e-9437-715fdaa17168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "11839468-beda-436e-9437-715fdaa17168", "address": "fa:16:3e:94:77:bc", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11839468-be", "ovs_interfaceid": "11839468-beda-436e-9437-715fdaa17168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:77:bc,bridge_name='br-int',has_traffic_filtering=True,id=11839468-beda-436e-9437-715fdaa17168,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11839468-be') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "address": "fa:16:3e:e4:17:89", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbab20d9-2b", "ovs_interfaceid": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "address": "fa:16:3e:e4:17:89", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbab20d9-2b", "ovs_interfaceid": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:17:89,bridge_name='br-int',has_traffic_filtering=True,id=dbab20d9-2bd4-480c-a971-c213fcfa03a8,network=Network(ee3f23fa-6cfb-4de2-a59a-3aa7e9501194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbab20d9-2b') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "address": "fa:16:3e:4c:4a:a6", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f12897-9a", "ovs_interfaceid": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "address": "fa:16:3e:4c:4a:a6", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f12897-9a", "ovs_interfaceid": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:4a:a6,bridge_name='br-int',has_traffic_filtering=True,id=15f12897-9a5b-4c7a-b80e-4889ce96f780,network=Network(ee3f23fa-6cfb-4de2-a59a-3aa7e9501194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f12897-9a') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.objects.instance [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lazy-loading 'pci_devices' on Instance uuid 40481706-78c9-402d-9d19-d2d00d812095 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:29:38 user nova-compute[74692]:   <uuid>40481706-78c9-402d-9d19-d2d00d812095</uuid>
Nov 18 18:29:38 user nova-compute[74692]:   <name>instance-0000000a</name>
Nov 18 18:29:38 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:29:38 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:29:38 user nova-compute[74692]:   <metadata>
Nov 18 18:29:38 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:29:38 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:29:38 user nova-compute[74692]:       <nova:name>tempest-device-tagging-server-1827640560</nova:name>
Nov 18 18:29:38 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:29:31</nova:creationTime>
Nov 18 18:29:38 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:29:38 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:29:38 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:29:38 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:29:38 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:29:38 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:29:38 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:29:38 user nova-compute[74692]:       <nova:owner>
Nov 18 18:29:38 user nova-compute[74692]:         <nova:user uuid="cc7bea88537f498f9a57f044cdede728">tempest-TaggedBootDevicesTest_v242-158402548-project-member</nova:user>
Nov 18 18:29:38 user nova-compute[74692]:         <nova:project uuid="2a88be034ffb4322ad1a9d2aebef7e59">tempest-TaggedBootDevicesTest_v242-158402548</nova:project>
Nov 18 18:29:38 user nova-compute[74692]:       </nova:owner>
Nov 18 18:29:38 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:29:38 user nova-compute[74692]:       <nova:ports>
Nov 18 18:29:38 user nova-compute[74692]:         <nova:port uuid="a4b46c64-5441-46a3-8da4-529a1d32046e">
Nov 18 18:29:38 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 18:29:38 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:38 user nova-compute[74692]:         <nova:port uuid="bd5d1c9a-bf27-47ce-9047-72844816accd">
Nov 18 18:29:38 user nova-compute[74692]:           <nova:ip type="fixed" address="10.1.1.217" ipVersion="4"/>
Nov 18 18:29:38 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:38 user nova-compute[74692]:         <nova:port uuid="8c2a0340-808f-4987-a0dd-38d3d9548b4d">
Nov 18 18:29:38 user nova-compute[74692]:           <nova:ip type="fixed" address="10.1.1.8" ipVersion="4"/>
Nov 18 18:29:38 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:38 user nova-compute[74692]:         <nova:port uuid="dd929622-57d9-4e8c-9012-6340cc9d39ff">
Nov 18 18:29:38 user nova-compute[74692]:           <nova:ip type="fixed" address="10.1.1.66" ipVersion="4"/>
Nov 18 18:29:38 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:38 user nova-compute[74692]:         <nova:port uuid="11839468-beda-436e-9437-715fdaa17168">
Nov 18 18:29:38 user nova-compute[74692]:           <nova:ip type="fixed" address="10.1.1.212" ipVersion="4"/>
Nov 18 18:29:38 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:38 user nova-compute[74692]:         <nova:port uuid="dbab20d9-2bd4-480c-a971-c213fcfa03a8">
Nov 18 18:29:38 user nova-compute[74692]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 18 18:29:38 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:38 user nova-compute[74692]:         <nova:port uuid="15f12897-9a5b-4c7a-b80e-4889ce96f780">
Nov 18 18:29:38 user nova-compute[74692]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 18 18:29:38 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:38 user nova-compute[74692]:       </nova:ports>
Nov 18 18:29:38 user nova-compute[74692]:     </nova:instance>
Nov 18 18:29:38 user nova-compute[74692]:   </metadata>
Nov 18 18:29:38 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:29:38 user nova-compute[74692]:     <system>
Nov 18 18:29:38 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:29:38 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:29:38 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:29:38 user nova-compute[74692]:       <entry name="serial">40481706-78c9-402d-9d19-d2d00d812095</entry>
Nov 18 18:29:38 user nova-compute[74692]:       <entry name="uuid">40481706-78c9-402d-9d19-d2d00d812095</entry>
Nov 18 18:29:38 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:29:38 user nova-compute[74692]:     </system>
Nov 18 18:29:38 user nova-compute[74692]:   </sysinfo>
Nov 18 18:29:38 user nova-compute[74692]:   <os>
Nov 18 18:29:38 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:29:38 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:29:38 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:29:38 user nova-compute[74692]:   </os>
Nov 18 18:29:38 user nova-compute[74692]:   <features>
Nov 18 18:29:38 user nova-compute[74692]:     <acpi/>
Nov 18 18:29:38 user nova-compute[74692]:     <apic/>
Nov 18 18:29:38 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:29:38 user nova-compute[74692]:   </features>
Nov 18 18:29:38 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:29:38 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:29:38 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:29:38 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:29:38 user nova-compute[74692]:   </clock>
Nov 18 18:29:38 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:29:38 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:29:38 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:29:38 user nova-compute[74692]:   </cpu>
Nov 18 18:29:38 user nova-compute[74692]:   <devices>
Nov 18 18:29:38 user nova-compute[74692]:     <disk type="file" device="cdrom">
Nov 18 18:29:38 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none"/>
Nov 18 18:29:38 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/40481706-78c9-402d-9d19-d2d00d812095/disk.config"/>
Nov 18 18:29:38 user nova-compute[74692]:       <target dev="hda" bus="ide"/>
Nov 18 18:29:38 user nova-compute[74692]:     </disk>
Nov 18 18:29:38 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:29:38 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:29:38 user nova-compute[74692]:       <source dev="/dev/sde"/>
Nov 18 18:29:38 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:29:38 user nova-compute[74692]:       <serial>0c599e24-bfc8-42cb-8129-6ba1be0c7593</serial>
Nov 18 18:29:38 user nova-compute[74692]:     </disk>
Nov 18 18:29:38 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:29:38 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:29:38 user nova-compute[74692]:       <source dev="/dev/sdg"/>
Nov 18 18:29:38 user nova-compute[74692]:       <target dev="vdb" bus="virtio"/>
Nov 18 18:29:38 user nova-compute[74692]:       <serial>3b8693b0-604a-41d5-a99a-dca528178e16</serial>
Nov 18 18:29:38 user nova-compute[74692]:     </disk>
Nov 18 18:29:38 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:29:38 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:29:38 user nova-compute[74692]:       <source dev="/dev/sdh"/>
Nov 18 18:29:38 user nova-compute[74692]:       <target dev="vdc" bus="virtio"/>
Nov 18 18:29:38 user nova-compute[74692]:       <serial>909eed5b-357b-447f-8a30-de499ef54b1a</serial>
Nov 18 18:29:38 user nova-compute[74692]:     </disk>
Nov 18 18:29:38 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:38 user nova-compute[74692]:       <mac address="fa:16:3e:04:37:ca"/>
Nov 18 18:29:38 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:38 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:38 user nova-compute[74692]:       <target dev="tapa4b46c64-54"/>
Nov 18 18:29:38 user nova-compute[74692]:     </interface>
Nov 18 18:29:38 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:38 user nova-compute[74692]:       <mac address="fa:16:3e:c1:a9:96"/>
Nov 18 18:29:38 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:38 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:38 user nova-compute[74692]:       <target dev="tapbd5d1c9a-bf"/>
Nov 18 18:29:38 user nova-compute[74692]:     </interface>
Nov 18 18:29:38 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:38 user nova-compute[74692]:       <mac address="fa:16:3e:87:4c:60"/>
Nov 18 18:29:38 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:38 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:38 user nova-compute[74692]:       <target dev="tap8c2a0340-80"/>
Nov 18 18:29:38 user nova-compute[74692]:     </interface>
Nov 18 18:29:38 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:38 user nova-compute[74692]:       <mac address="fa:16:3e:e9:84:44"/>
Nov 18 18:29:38 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:38 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:38 user nova-compute[74692]:       <target dev="tapdd929622-57"/>
Nov 18 18:29:38 user nova-compute[74692]:     </interface>
Nov 18 18:29:38 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:38 user nova-compute[74692]:       <mac address="fa:16:3e:94:77:bc"/>
Nov 18 18:29:38 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:38 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:38 user nova-compute[74692]:       <target dev="tap11839468-be"/>
Nov 18 18:29:38 user nova-compute[74692]:     </interface>
Nov 18 18:29:38 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:38 user nova-compute[74692]:       <mac address="fa:16:3e:e4:17:89"/>
Nov 18 18:29:38 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:38 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:38 user nova-compute[74692]:       <target dev="tapdbab20d9-2b"/>
Nov 18 18:29:38 user nova-compute[74692]:     </interface>
Nov 18 18:29:38 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:38 user nova-compute[74692]:       <mac address="fa:16:3e:4c:4a:a6"/>
Nov 18 18:29:38 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:38 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:38 user nova-compute[74692]:       <target dev="tap15f12897-9a"/>
Nov 18 18:29:38 user nova-compute[74692]:     </interface>
Nov 18 18:29:38 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:29:38 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/40481706-78c9-402d-9d19-d2d00d812095/console.log" append="off"/>
Nov 18 18:29:38 user nova-compute[74692]:     </serial>
Nov 18 18:29:38 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:29:38 user nova-compute[74692]:     <video>
Nov 18 18:29:38 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:38 user nova-compute[74692]:     </video>
Nov 18 18:29:38 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:29:38 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:29:38 user nova-compute[74692]:     </rng>
Nov 18 18:29:38 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:29:38 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:29:38 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:29:38 user nova-compute[74692]:     </memballoon>
Nov 18 18:29:38 user nova-compute[74692]:   </devices>
Nov 18 18:29:38 user nova-compute[74692]: </domain>
Nov 18 18:29:38 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4b46c64-5441-46a3-8da4-529a1d32046e", "address": "fa:16:3e:04:37:ca", "network": {"id": "a4f639ab-5d23-44cf-9586-1df19a47170c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1273332395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b46c64-54", "ovs_interfaceid": "a4b46c64-5441-46a3-8da4-529a1d32046e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "a4b46c64-5441-46a3-8da4-529a1d32046e", "address": "fa:16:3e:04:37:ca", "network": {"id": "a4f639ab-5d23-44cf-9586-1df19a47170c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1273332395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b46c64-54", "ovs_interfaceid": "a4b46c64-5441-46a3-8da4-529a1d32046e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:37:ca,bridge_name='br-int',has_traffic_filtering=True,id=a4b46c64-5441-46a3-8da4-529a1d32046e,network=Network(a4f639ab-5d23-44cf-9586-1df19a47170c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4b46c64-54') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG os_vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:37:ca,bridge_name='br-int',has_traffic_filtering=True,id=a4b46c64-5441-46a3-8da4-529a1d32046e,network=Network(a4f639ab-5d23-44cf-9586-1df19a47170c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4b46c64-54') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d4ff772-8947-59ef-b285-df6255b8a506', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4b46c64-54, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4b46c64-54, col_values=(('qos', UUID('c133c476-84a1-4318-8a65-0e1ab036284f')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4b46c64-54, col_values=(('external_ids', {'iface-id': 'a4b46c64-5441-46a3-8da4-529a1d32046e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:37:ca', 'vm-uuid': '40481706-78c9-402d-9d19-d2d00d812095'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: INFO os_vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:37:ca,bridge_name='br-int',has_traffic_filtering=True,id=a4b46c64-5441-46a3-8da4-529a1d32046e,network=Network(a4f639ab-5d23-44cf-9586-1df19a47170c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4b46c64-54')
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd5d1c9a-bf27-47ce-9047-72844816accd", "address": "fa:16:3e:c1:a9:96", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5d1c9a-bf", "ovs_interfaceid": "bd5d1c9a-bf27-47ce-9047-72844816accd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "bd5d1c9a-bf27-47ce-9047-72844816accd", "address": "fa:16:3e:c1:a9:96", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5d1c9a-bf", "ovs_interfaceid": "bd5d1c9a-bf27-47ce-9047-72844816accd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a9:96,bridge_name='br-int',has_traffic_filtering=True,id=bd5d1c9a-bf27-47ce-9047-72844816accd,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd5d1c9a-bf') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG os_vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a9:96,bridge_name='br-int',has_traffic_filtering=True,id=bd5d1c9a-bf27-47ce-9047-72844816accd,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd5d1c9a-bf') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9d57a88-c299-542b-82e3-84c71eafc4ae', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd5d1c9a-bf, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd5d1c9a-bf, col_values=(('qos', UUID('cd2421d1-4930-499a-aee3-b43248cd926f')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd5d1c9a-bf, col_values=(('external_ids', {'iface-id': 'bd5d1c9a-bf27-47ce-9047-72844816accd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:a9:96', 'vm-uuid': '40481706-78c9-402d-9d19-d2d00d812095'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: INFO os_vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a9:96,bridge_name='br-int',has_traffic_filtering=True,id=bd5d1c9a-bf27-47ce-9047-72844816accd,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd5d1c9a-bf')
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "address": "fa:16:3e:87:4c:60", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2a0340-80", "ovs_interfaceid": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "address": "fa:16:3e:87:4c:60", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2a0340-80", "ovs_interfaceid": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4c:60,bridge_name='br-int',has_traffic_filtering=True,id=8c2a0340-808f-4987-a0dd-38d3d9548b4d,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c2a0340-80') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG os_vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4c:60,bridge_name='br-int',has_traffic_filtering=True,id=8c2a0340-808f-4987-a0dd-38d3d9548b4d,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c2a0340-80') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4e19708-9d9d-57fa-a814-ee640abbeb44', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c2a0340-80, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c2a0340-80, col_values=(('qos', UUID('265ba0c3-e85c-4842-a48a-9a3f306e9d4b')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c2a0340-80, col_values=(('external_ids', {'iface-id': '8c2a0340-808f-4987-a0dd-38d3d9548b4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:4c:60', 'vm-uuid': '40481706-78c9-402d-9d19-d2d00d812095'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: INFO os_vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4c:60,bridge_name='br-int',has_traffic_filtering=True,id=8c2a0340-808f-4987-a0dd-38d3d9548b4d,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c2a0340-80')
Nov 18 18:29:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "address": "fa:16:3e:e9:84:44", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd929622-57", "ovs_interfaceid": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "address": "fa:16:3e:e9:84:44", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd929622-57", "ovs_interfaceid": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:84:44,bridge_name='br-int',has_traffic_filtering=True,id=dd929622-57d9-4e8c-9012-6340cc9d39ff,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd929622-57') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG os_vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:84:44,bridge_name='br-int',has_traffic_filtering=True,id=dd929622-57d9-4e8c-9012-6340cc9d39ff,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd929622-57') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af1f3bc4-a692-5d8c-950c-52cb3490bbb7', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd929622-57, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd929622-57, col_values=(('qos', UUID('11e513cd-0d09-4925-91f1-7b59a15e9902')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd929622-57, col_values=(('external_ids', {'iface-id': 'dd929622-57d9-4e8c-9012-6340cc9d39ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:84:44', 'vm-uuid': '40481706-78c9-402d-9d19-d2d00d812095'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-91fd321c-bffe-4815-a8c2-67a0253fc5ed req-3d2b6f6e-912b-46ca-94f3-89651b180683 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-820a0454-d628-4849-956e-e219a7c77f71 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91fd321c-bffe-4815-a8c2-67a0253fc5ed req-3d2b6f6e-912b-46ca-94f3-89651b180683 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91fd321c-bffe-4815-a8c2-67a0253fc5ed req-3d2b6f6e-912b-46ca-94f3-89651b180683 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91fd321c-bffe-4815-a8c2-67a0253fc5ed req-3d2b6f6e-912b-46ca-94f3-89651b180683 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-91fd321c-bffe-4815-a8c2-67a0253fc5ed req-3d2b6f6e-912b-46ca-94f3-89651b180683 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-820a0454-d628-4849-956e-e219a7c77f71 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:39 user nova-compute[74692]: WARNING nova.compute.manager [req-91fd321c-bffe-4815-a8c2-67a0253fc5ed req-3d2b6f6e-912b-46ca-94f3-89651b180683 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-820a0454-d628-4849-956e-e219a7c77f71 for instance with vm_state building and task_state spawning.
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: INFO os_vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:84:44,bridge_name='br-int',has_traffic_filtering=True,id=dd929622-57d9-4e8c-9012-6340cc9d39ff,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd929622-57')
Nov 18 18:29:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11839468-beda-436e-9437-715fdaa17168", "address": "fa:16:3e:94:77:bc", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11839468-be", "ovs_interfaceid": "11839468-beda-436e-9437-715fdaa17168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "11839468-beda-436e-9437-715fdaa17168", "address": "fa:16:3e:94:77:bc", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11839468-be", "ovs_interfaceid": "11839468-beda-436e-9437-715fdaa17168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:77:bc,bridge_name='br-int',has_traffic_filtering=True,id=11839468-beda-436e-9437-715fdaa17168,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11839468-be') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG os_vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:77:bc,bridge_name='br-int',has_traffic_filtering=True,id=11839468-beda-436e-9437-715fdaa17168,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11839468-be') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68c6b42b-5d45-550e-acb8-9e9f8e84996a', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11839468-be, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11839468-be, col_values=(('qos', UUID('e02c1e28-091b-48a3-85e0-ab0f94fa0d43')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11839468-be, col_values=(('external_ids', {'iface-id': '11839468-beda-436e-9437-715fdaa17168', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:77:bc', 'vm-uuid': '40481706-78c9-402d-9d19-d2d00d812095'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: INFO os_vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:77:bc,bridge_name='br-int',has_traffic_filtering=True,id=11839468-beda-436e-9437-715fdaa17168,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11839468-be')
Nov 18 18:29:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "address": "fa:16:3e:e4:17:89", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbab20d9-2b", "ovs_interfaceid": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "address": "fa:16:3e:e4:17:89", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbab20d9-2b", "ovs_interfaceid": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:17:89,bridge_name='br-int',has_traffic_filtering=True,id=dbab20d9-2bd4-480c-a971-c213fcfa03a8,network=Network(ee3f23fa-6cfb-4de2-a59a-3aa7e9501194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbab20d9-2b') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG os_vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:17:89,bridge_name='br-int',has_traffic_filtering=True,id=dbab20d9-2bd4-480c-a971-c213fcfa03a8,network=Network(ee3f23fa-6cfb-4de2-a59a-3aa7e9501194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbab20d9-2b') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e550eef6-fddb-57cd-84d4-a836846323a2', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbab20d9-2b, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbab20d9-2b, col_values=(('qos', UUID('26548baf-0ff2-4ea0-b14f-34028fe02e47')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbab20d9-2b, col_values=(('external_ids', {'iface-id': 'dbab20d9-2bd4-480c-a971-c213fcfa03a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:17:89', 'vm-uuid': '40481706-78c9-402d-9d19-d2d00d812095'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: INFO os_vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:17:89,bridge_name='br-int',has_traffic_filtering=True,id=dbab20d9-2bd4-480c-a971-c213fcfa03a8,network=Network(ee3f23fa-6cfb-4de2-a59a-3aa7e9501194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbab20d9-2b')
Nov 18 18:29:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "address": "fa:16:3e:4c:4a:a6", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f12897-9a", "ovs_interfaceid": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "address": "fa:16:3e:4c:4a:a6", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f12897-9a", "ovs_interfaceid": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:4a:a6,bridge_name='br-int',has_traffic_filtering=True,id=15f12897-9a5b-4c7a-b80e-4889ce96f780,network=Network(ee3f23fa-6cfb-4de2-a59a-3aa7e9501194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f12897-9a') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG os_vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:4a:a6,bridge_name='br-int',has_traffic_filtering=True,id=15f12897-9a5b-4c7a-b80e-4889ce96f780,network=Network(ee3f23fa-6cfb-4de2-a59a-3aa7e9501194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f12897-9a') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e24b0582-6a39-50ae-8c8d-2eca3869472e', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-d3d79063-efeb-4014-acb1-ddcfc7c57309 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.013s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-d3d79063-efeb-4014-acb1-ddcfc7c57309 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:40 user nova-compute[74692]: WARNING nova.compute.manager [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-d3d79063-efeb-4014-acb1-ddcfc7c57309 for instance with vm_state building and task_state spawning.
Nov 18 18:29:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-81eda6a3-90f4-42dc-8462-171ec3afbf2f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-81eda6a3-90f4-42dc-8462-171ec3afbf2f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:40 user nova-compute[74692]: WARNING nova.compute.manager [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-81eda6a3-90f4-42dc-8462-171ec3afbf2f for instance with vm_state building and task_state spawning.
Nov 18 18:29:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-81eda6a3-90f4-42dc-8462-171ec3afbf2f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-81eda6a3-90f4-42dc-8462-171ec3afbf2f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:40 user nova-compute[74692]: WARNING nova.compute.manager [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-81eda6a3-90f4-42dc-8462-171ec3afbf2f for instance with vm_state building and task_state spawning.
Nov 18 18:29:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-a955bfd0-166d-4030-bb78-6402891c7af3 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-a955bfd0-166d-4030-bb78-6402891c7af3 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:40 user nova-compute[74692]: WARNING nova.compute.manager [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-a955bfd0-166d-4030-bb78-6402891c7af3 for instance with vm_state building and task_state spawning.
Nov 18 18:29:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-a955bfd0-166d-4030-bb78-6402891c7af3 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-a955bfd0-166d-4030-bb78-6402891c7af3 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:40 user nova-compute[74692]: WARNING nova.compute.manager [req-65c6cc8f-ff67-4f73-a196-0e26859a940b req-c5e36c11-35e9-4fa5-8a54-ad4b2b174489 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-a955bfd0-166d-4030-bb78-6402891c7af3 for instance with vm_state building and task_state spawning.
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15f12897-9a, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15f12897-9a, col_values=(('qos', UUID('2022d968-8275-4321-a033-06708d81c3cc')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15f12897-9a, col_values=(('external_ids', {'iface-id': '15f12897-9a5b-4c7a-b80e-4889ce96f780', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:4a:a6', 'vm-uuid': '40481706-78c9-402d-9d19-d2d00d812095'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:40 user nova-compute[74692]: INFO os_vif [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:4a:a6,bridge_name='br-int',has_traffic_filtering=True,id=15f12897-9a5b-4c7a-b80e-4889ce96f780,network=Network(ee3f23fa-6cfb-4de2-a59a-3aa7e9501194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f12897-9a')
Nov 18 18:29:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] No BDM found with device name hda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] No VIF found with MAC fa:16:3e:04:37:ca, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] No VIF found with MAC fa:16:3e:94:77:bc, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:29:40 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Using config drive
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:40 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Creating config drive at /opt/stack/data/nova/instances/40481706-78c9-402d-9d19-d2d00d812095/disk.config
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/40481706-78c9-402d-9d19-d2d00d812095/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprd0p6gq0 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/40481706-78c9-402d-9d19-d2d00d812095/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprd0p6gq0" returned: 0 in 0.071s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-820a0454-d628-4849-956e-e219a7c77f71 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-820a0454-d628-4849-956e-e219a7c77f71 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:41 user nova-compute[74692]: WARNING nova.compute.manager [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-820a0454-d628-4849-956e-e219a7c77f71 for instance with vm_state building and task_state spawning.
Nov 18 18:29:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-050fa40f-fc29-49bd-b29d-c7954818aa63 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-050fa40f-fc29-49bd-b29d-c7954818aa63 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:41 user nova-compute[74692]: WARNING nova.compute.manager [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-050fa40f-fc29-49bd-b29d-c7954818aa63 for instance with vm_state building and task_state spawning.
Nov 18 18:29:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-050fa40f-fc29-49bd-b29d-c7954818aa63 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-050fa40f-fc29-49bd-b29d-c7954818aa63 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:41 user nova-compute[74692]: WARNING nova.compute.manager [req-60656b32-a876-423b-885b-e4d7ff449292 req-ffd007b8-b675-456e-830c-e28094109330 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-050fa40f-fc29-49bd-b29d-c7954818aa63 for instance with vm_state building and task_state spawning.
Nov 18 18:29:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-839e803b-586b-45d9-a878-7214ffe62558 req-d3a221bd-8498-450b-9d1b-e8fe2f66cdfc service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-14e00c18-ad6b-4481-852d-e336bee32648 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-839e803b-586b-45d9-a878-7214ffe62558 req-d3a221bd-8498-450b-9d1b-e8fe2f66cdfc service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-839e803b-586b-45d9-a878-7214ffe62558 req-d3a221bd-8498-450b-9d1b-e8fe2f66cdfc service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-839e803b-586b-45d9-a878-7214ffe62558 req-d3a221bd-8498-450b-9d1b-e8fe2f66cdfc service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-839e803b-586b-45d9-a878-7214ffe62558 req-d3a221bd-8498-450b-9d1b-e8fe2f66cdfc service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-14e00c18-ad6b-4481-852d-e336bee32648 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:41 user nova-compute[74692]: WARNING nova.compute.manager [req-839e803b-586b-45d9-a878-7214ffe62558 req-d3a221bd-8498-450b-9d1b-e8fe2f66cdfc service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-14e00c18-ad6b-4481-852d-e336bee32648 for instance with vm_state building and task_state spawning.
Nov 18 18:29:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-787179d9-1e61-4a20-9324-6630c736e886 req-4332fc07-e263-4872-951b-2838f4b88efe service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-787179d9-1e61-4a20-9324-6630c736e886 req-4332fc07-e263-4872-951b-2838f4b88efe service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-787179d9-1e61-4a20-9324-6630c736e886 req-4332fc07-e263-4872-951b-2838f4b88efe service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-787179d9-1e61-4a20-9324-6630c736e886 req-4332fc07-e263-4872-951b-2838f4b88efe service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-787179d9-1e61-4a20-9324-6630c736e886 req-4332fc07-e263-4872-951b-2838f4b88efe service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:42 user nova-compute[74692]: WARNING nova.compute.manager [req-787179d9-1e61-4a20-9324-6630c736e886 req-4332fc07-e263-4872-951b-2838f4b88efe service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe for instance with vm_state building and task_state spawning.
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-787179d9-1e61-4a20-9324-6630c736e886 req-4332fc07-e263-4872-951b-2838f4b88efe service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-787179d9-1e61-4a20-9324-6630c736e886 req-4332fc07-e263-4872-951b-2838f4b88efe service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-787179d9-1e61-4a20-9324-6630c736e886 req-4332fc07-e263-4872-951b-2838f4b88efe service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-787179d9-1e61-4a20-9324-6630c736e886 req-4332fc07-e263-4872-951b-2838f4b88efe service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-787179d9-1e61-4a20-9324-6630c736e886 req-4332fc07-e263-4872-951b-2838f4b88efe service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:42 user nova-compute[74692]: WARNING nova.compute.manager [req-787179d9-1e61-4a20-9324-6630c736e886 req-4332fc07-e263-4872-951b-2838f4b88efe service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe for instance with vm_state building and task_state spawning.
Nov 18 18:29:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "7960f76b-9176-4d98-8045-03678457add7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:29:42 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Instance spawned successfully.
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:42 user nova-compute[74692]: INFO nova.compute.manager [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Took 12.83 seconds to spawn the instance on the hypervisor.
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:29:42 user nova-compute[74692]: INFO nova.compute.claims [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Claim successful on node user
Nov 18 18:29:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:42 user nova-compute[74692]: INFO nova.compute.manager [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Took 37.75 seconds to build instance.
Nov 18 18:29:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cc240c47-5135-434d-8c30-3541c7fc6161 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.926s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.787s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG nova.compute.manager [req-fafc28fb-1ffa-4698-a343-2acb0b78c1c3 req-a6d58e29-55ab-47bc-a7ff-3c3f1ce9f037 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-14e00c18-ad6b-4481-852d-e336bee32648 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fafc28fb-1ffa-4698-a343-2acb0b78c1c3 req-a6d58e29-55ab-47bc-a7ff-3c3f1ce9f037 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fafc28fb-1ffa-4698-a343-2acb0b78c1c3 req-a6d58e29-55ab-47bc-a7ff-3c3f1ce9f037 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fafc28fb-1ffa-4698-a343-2acb0b78c1c3 req-a6d58e29-55ab-47bc-a7ff-3c3f1ce9f037 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG nova.compute.manager [req-fafc28fb-1ffa-4698-a343-2acb0b78c1c3 req-a6d58e29-55ab-47bc-a7ff-3c3f1ce9f037 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-14e00c18-ad6b-4481-852d-e336bee32648 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:43 user nova-compute[74692]: WARNING nova.compute.manager [req-fafc28fb-1ffa-4698-a343-2acb0b78c1c3 req-a6d58e29-55ab-47bc-a7ff-3c3f1ce9f037 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-14e00c18-ad6b-4481-852d-e336bee32648 for instance with vm_state active and task_state None.
Nov 18 18:29:43 user nova-compute[74692]: DEBUG nova.compute.manager [req-fafc28fb-1ffa-4698-a343-2acb0b78c1c3 req-a6d58e29-55ab-47bc-a7ff-3c3f1ce9f037 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-8c2a0340-808f-4987-a0dd-38d3d9548b4d {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fafc28fb-1ffa-4698-a343-2acb0b78c1c3 req-a6d58e29-55ab-47bc-a7ff-3c3f1ce9f037 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fafc28fb-1ffa-4698-a343-2acb0b78c1c3 req-a6d58e29-55ab-47bc-a7ff-3c3f1ce9f037 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fafc28fb-1ffa-4698-a343-2acb0b78c1c3 req-a6d58e29-55ab-47bc-a7ff-3c3f1ce9f037 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG nova.compute.manager [req-fafc28fb-1ffa-4698-a343-2acb0b78c1c3 req-a6d58e29-55ab-47bc-a7ff-3c3f1ce9f037 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-8c2a0340-808f-4987-a0dd-38d3d9548b4d {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:43 user nova-compute[74692]: WARNING nova.compute.manager [req-fafc28fb-1ffa-4698-a343-2acb0b78c1c3 req-a6d58e29-55ab-47bc-a7ff-3c3f1ce9f037 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-8c2a0340-808f-4987-a0dd-38d3d9548b4d for instance with vm_state building and task_state spawning.
Nov 18 18:29:43 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG nova.network.neutron [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:29:43 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:29:43 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:29:43 user nova-compute[74692]: INFO nova.virt.block_device [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Booting with volume 3eeda74a-6f86-4797-8c30-fb05c69e7bd6 at /dev/vda
Nov 18 18:29:43 user nova-compute[74692]: DEBUG nova.policy [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dce10cede81746b2bead51383a21b0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5425715d2457463b8464c69b99c63831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG os_brick.utils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.042s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a03435-a55a-40c0-9d61-29b0e329c759]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[381fa3ac-1b33-48ed-b9ad-f09569d03bb0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d86f58a-ffb6-4f21-b575-8dd0b5aa3518]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf06d725-c729-492f-a9a6-91db4b3b054b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:29:44 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[af86e5c9-200e-4efa-88ab-e78ba4533dbf]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG os_brick.utils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] <== get_connector_properties: return (217ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updating existing volume attachment record: 0a4088bc-1915-4732-bce9-c0ec72cea416 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-a4b46c64-5441-46a3-8da4-529a1d32046e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-a4b46c64-5441-46a3-8da4-529a1d32046e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:44 user nova-compute[74692]: WARNING nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-a4b46c64-5441-46a3-8da4-529a1d32046e for instance with vm_state building and task_state spawning.
Nov 18 18:29:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-a4b46c64-5441-46a3-8da4-529a1d32046e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-a4b46c64-5441-46a3-8da4-529a1d32046e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:44 user nova-compute[74692]: WARNING nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-a4b46c64-5441-46a3-8da4-529a1d32046e for instance with vm_state building and task_state spawning.
Nov 18 18:29:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-bd5d1c9a-bf27-47ce-9047-72844816accd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-bd5d1c9a-bf27-47ce-9047-72844816accd {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:44 user nova-compute[74692]: WARNING nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-bd5d1c9a-bf27-47ce-9047-72844816accd for instance with vm_state building and task_state spawning.
Nov 18 18:29:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-bd5d1c9a-bf27-47ce-9047-72844816accd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-bd5d1c9a-bf27-47ce-9047-72844816accd {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:44 user nova-compute[74692]: WARNING nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-bd5d1c9a-bf27-47ce-9047-72844816accd for instance with vm_state building and task_state spawning.
Nov 18 18:29:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-dd929622-57d9-4e8c-9012-6340cc9d39ff {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-dd929622-57d9-4e8c-9012-6340cc9d39ff {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:44 user nova-compute[74692]: WARNING nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-dd929622-57d9-4e8c-9012-6340cc9d39ff for instance with vm_state building and task_state spawning.
Nov 18 18:29:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-dd929622-57d9-4e8c-9012-6340cc9d39ff {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-dd929622-57d9-4e8c-9012-6340cc9d39ff {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:44 user nova-compute[74692]: WARNING nova.compute.manager [req-24852500-13fa-4895-b53d-412bfb198a36 req-d8746822-35e7-48c4-8b47-60b2067dab68 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-dd929622-57d9-4e8c-9012-6340cc9d39ff for instance with vm_state building and task_state spawning.
Nov 18 18:29:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-c610f38a-8abf-4d1c-b2c1-2e8f01a12583 req-ccd61f30-4090-465a-975c-af5aef1b9090 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-11839468-beda-436e-9437-715fdaa17168 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c610f38a-8abf-4d1c-b2c1-2e8f01a12583 req-ccd61f30-4090-465a-975c-af5aef1b9090 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c610f38a-8abf-4d1c-b2c1-2e8f01a12583 req-ccd61f30-4090-465a-975c-af5aef1b9090 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c610f38a-8abf-4d1c-b2c1-2e8f01a12583 req-ccd61f30-4090-465a-975c-af5aef1b9090 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-c610f38a-8abf-4d1c-b2c1-2e8f01a12583 req-ccd61f30-4090-465a-975c-af5aef1b9090 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-11839468-beda-436e-9437-715fdaa17168 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:44 user nova-compute[74692]: WARNING nova.compute.manager [req-c610f38a-8abf-4d1c-b2c1-2e8f01a12583 req-ccd61f30-4090-465a-975c-af5aef1b9090 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-11839468-beda-436e-9437-715fdaa17168 for instance with vm_state building and task_state spawning.
Nov 18 18:29:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:45 user nova-compute[74692]: DEBUG nova.compute.manager [req-47c7aed7-5843-4581-a56a-056a9bd701b4 req-d0125f78-aeeb-4b5a-b49d-6dee4c4bd875 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-8c2a0340-808f-4987-a0dd-38d3d9548b4d {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-47c7aed7-5843-4581-a56a-056a9bd701b4 req-d0125f78-aeeb-4b5a-b49d-6dee4c4bd875 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-47c7aed7-5843-4581-a56a-056a9bd701b4 req-d0125f78-aeeb-4b5a-b49d-6dee4c4bd875 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-47c7aed7-5843-4581-a56a-056a9bd701b4 req-d0125f78-aeeb-4b5a-b49d-6dee4c4bd875 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:45 user nova-compute[74692]: DEBUG nova.compute.manager [req-47c7aed7-5843-4581-a56a-056a9bd701b4 req-d0125f78-aeeb-4b5a-b49d-6dee4c4bd875 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-8c2a0340-808f-4987-a0dd-38d3d9548b4d {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:45 user nova-compute[74692]: WARNING nova.compute.manager [req-47c7aed7-5843-4581-a56a-056a9bd701b4 req-d0125f78-aeeb-4b5a-b49d-6dee4c4bd875 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-8c2a0340-808f-4987-a0dd-38d3d9548b4d for instance with vm_state building and task_state spawning.
Nov 18 18:29:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:45 user nova-compute[74692]: DEBUG nova.network.neutron [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Successfully created port: bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-a66a64ae-d89b-44fe-96e7-ac3aa585a93e req-b33df7cb-ad14-46df-ac1f-c390d4dc5257 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-15f12897-9a5b-4c7a-b80e-4889ce96f780 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a66a64ae-d89b-44fe-96e7-ac3aa585a93e req-b33df7cb-ad14-46df-ac1f-c390d4dc5257 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a66a64ae-d89b-44fe-96e7-ac3aa585a93e req-b33df7cb-ad14-46df-ac1f-c390d4dc5257 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a66a64ae-d89b-44fe-96e7-ac3aa585a93e req-b33df7cb-ad14-46df-ac1f-c390d4dc5257 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-a66a64ae-d89b-44fe-96e7-ac3aa585a93e req-b33df7cb-ad14-46df-ac1f-c390d4dc5257 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-15f12897-9a5b-4c7a-b80e-4889ce96f780 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:46 user nova-compute[74692]: WARNING nova.compute.manager [req-a66a64ae-d89b-44fe-96e7-ac3aa585a93e req-b33df7cb-ad14-46df-ac1f-c390d4dc5257 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-15f12897-9a5b-4c7a-b80e-4889ce96f780 for instance with vm_state building and task_state spawning.
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-a66a64ae-d89b-44fe-96e7-ac3aa585a93e req-b33df7cb-ad14-46df-ac1f-c390d4dc5257 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-15f12897-9a5b-4c7a-b80e-4889ce96f780 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a66a64ae-d89b-44fe-96e7-ac3aa585a93e req-b33df7cb-ad14-46df-ac1f-c390d4dc5257 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a66a64ae-d89b-44fe-96e7-ac3aa585a93e req-b33df7cb-ad14-46df-ac1f-c390d4dc5257 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a66a64ae-d89b-44fe-96e7-ac3aa585a93e req-b33df7cb-ad14-46df-ac1f-c390d4dc5257 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-a66a64ae-d89b-44fe-96e7-ac3aa585a93e req-b33df7cb-ad14-46df-ac1f-c390d4dc5257 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-15f12897-9a5b-4c7a-b80e-4889ce96f780 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:46 user nova-compute[74692]: WARNING nova.compute.manager [req-a66a64ae-d89b-44fe-96e7-ac3aa585a93e req-b33df7cb-ad14-46df-ac1f-c390d4dc5257 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-15f12897-9a5b-4c7a-b80e-4889ce96f780 for instance with vm_state building and task_state spawning.
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Successfully updated port: bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquired lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-11839468-beda-436e-9437-715fdaa17168 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-11839468-beda-436e-9437-715fdaa17168 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:46 user nova-compute[74692]: WARNING nova.compute.manager [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-11839468-beda-436e-9437-715fdaa17168 for instance with vm_state building and task_state spawning.
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-dbab20d9-2bd4-480c-a971-c213fcfa03a8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-dbab20d9-2bd4-480c-a971-c213fcfa03a8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:46 user nova-compute[74692]: WARNING nova.compute.manager [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-dbab20d9-2bd4-480c-a971-c213fcfa03a8 for instance with vm_state building and task_state spawning.
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-dbab20d9-2bd4-480c-a971-c213fcfa03a8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-dbab20d9-2bd4-480c-a971-c213fcfa03a8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:46 user nova-compute[74692]: WARNING nova.compute.manager [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-dbab20d9-2bd4-480c-a971-c213fcfa03a8 for instance with vm_state building and task_state spawning.
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-changed-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Refreshing instance network info cache due to event network-changed-bdd4ef83-835c-42c0-a7e0-0432ab03618f. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] Acquiring lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updating instance_info_cache with network_info: [{"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Releasing lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Instance network_info: |[{"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] Acquired lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:29:46 user nova-compute[74692]: DEBUG nova.network.neutron [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Refreshing network info cache for port bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:29:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updated VIF entry in instance network info cache for port bdd4ef83-835c-42c0-a7e0-0432ab03618f. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:29:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updating instance_info_cache with network_info: [{"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:29:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-80c36170-a06f-42dd-b5c7-ec83ca1614ec req-fe9b22ca-3a34-40fd-9210-85e9545a6374 service nova] Releasing lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:29:47 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:29:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:29:47 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Instance spawned successfully.
Nov 18 18:29:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:29:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:47 user nova-compute[74692]: INFO nova.compute.manager [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Took 16.21 seconds to spawn the instance on the hypervisor.
Nov 18 18:29:47 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:29:47 user nova-compute[74692]: INFO nova.compute.manager [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Took 39.03 seconds to build instance.
Nov 18 18:29:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1f22b9c2-5f3d-4faf-bb56-bec8f120ba2f tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "40481706-78c9-402d-9d19-d2d00d812095" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.181s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:29:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Creating image(s)
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Ensure instance console log exists: /opt/stack/data/nova/instances/7960f76b-9176-4d98-8045-03678457add7/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Start _get_guest_xml network_info=[{"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORgqFxrZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7960f76b-9176-4d98-8045-03678457add7', 'attached_at': '', 'detached_at': '', 'volume_id': '3eeda74a-6f86-4797-8c30-fb05c69e7bd6', 'serial': '3eeda74a-6f86-4797-8c30-fb05c69e7bd6'}, 'attachment_id': '0a4088bc-1915-4732-bce9-c0ec72cea416', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:29:50 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:29:50 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:29:50 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORgqFxrZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:29:51 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:29:51 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:29:51 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b7a537-8c47-4a47-8b50-f1a1643abac1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:29:51 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b4c2a8-65c4-4818-948e-414bdd8669a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6] added
Nov 18 18:29:51 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be233c2-942e-44f9-8638-cbd8d69f6e10]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1bd3cc-4512-4dd8-ad49-8982ddcde094]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ORgqFxrZ {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ORgqFxrZ" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[064271dd-5b9e-45fe-94f0-e96bfc0a1095]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ORgqFxrZ'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[88feb911-5774-447d-8a15-35166002951f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe69442a-5dab-4e02-8aba-2b25869b7f87]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:29:51 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:29:51 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cada76-c3f7-4e1e-bc56-2636a9dee479]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260]
Nov 18 18:29:51 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260] successful.
Nov 18 18:29:51 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64b9e72-2b83-47f2-ba68-9d6e42973ed2]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4bbf41-33f6-4dd1-b564-b91f5c124794]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:29:51 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:29:51 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[769fb671-a31f-4c38-983b-a0503c761597]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:29:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORgqFxrZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23164353338303532', 'path': '/dev/sdi'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164353338303532', 'path': '/dev/sdi'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2059968008',display_name='tempest-TestShelveInstance-server-2059968008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2059968008',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqvDFaau/67R12i2PVg3zAmOTHhomyvhTqHRvkp08NpDDwRA6rjvsD7HSARckE1h3VtjUuYwEBUoGDT9lZLitru1a2otYt+5V6h8m0rpnvHGvpStzG11FTI2Dj8WqOnDw==',key_name='tempest-TestShelveInstance-1852882518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5425715d2457463b8464c69b99c63831',ramdisk_id='',reservation_id='r-3gclmodf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-213519045',owner_user_name='tempest-TestShelveInstance-213519045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:44Z,user_data=None,user_id='dce10cede81746b2bead51383a21b0a3',uuid=7960f76b-9176-4d98-8045-03678457add7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Converting VIF {"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=bdd4ef83-835c-42c0-a7e0-0432ab03618f,network=Network(cb98a4f1-8a2e-4b02-923f-810f47f4dccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd4ef83-83') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG nova.objects.instance [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lazy-loading 'pci_devices' on Instance uuid 7960f76b-9176-4d98-8045-03678457add7 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:29:52 user nova-compute[74692]:   <uuid>7960f76b-9176-4d98-8045-03678457add7</uuid>
Nov 18 18:29:52 user nova-compute[74692]:   <name>instance-0000000b</name>
Nov 18 18:29:52 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:29:52 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:29:52 user nova-compute[74692]:   <metadata>
Nov 18 18:29:52 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:29:52 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:29:52 user nova-compute[74692]:       <nova:name>tempest-TestShelveInstance-server-2059968008</nova:name>
Nov 18 18:29:52 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:29:50</nova:creationTime>
Nov 18 18:29:52 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:29:52 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:29:52 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:29:52 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:29:52 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:29:52 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:29:52 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:29:52 user nova-compute[74692]:       <nova:owner>
Nov 18 18:29:52 user nova-compute[74692]:         <nova:user uuid="dce10cede81746b2bead51383a21b0a3">tempest-TestShelveInstance-213519045-project-member</nova:user>
Nov 18 18:29:52 user nova-compute[74692]:         <nova:project uuid="5425715d2457463b8464c69b99c63831">tempest-TestShelveInstance-213519045</nova:project>
Nov 18 18:29:52 user nova-compute[74692]:       </nova:owner>
Nov 18 18:29:52 user nova-compute[74692]:       <nova:ports>
Nov 18 18:29:52 user nova-compute[74692]:         <nova:port uuid="bdd4ef83-835c-42c0-a7e0-0432ab03618f">
Nov 18 18:29:52 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 18:29:52 user nova-compute[74692]:         </nova:port>
Nov 18 18:29:52 user nova-compute[74692]:       </nova:ports>
Nov 18 18:29:52 user nova-compute[74692]:     </nova:instance>
Nov 18 18:29:52 user nova-compute[74692]:   </metadata>
Nov 18 18:29:52 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:29:52 user nova-compute[74692]:     <system>
Nov 18 18:29:52 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:29:52 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:29:52 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:29:52 user nova-compute[74692]:       <entry name="serial">7960f76b-9176-4d98-8045-03678457add7</entry>
Nov 18 18:29:52 user nova-compute[74692]:       <entry name="uuid">7960f76b-9176-4d98-8045-03678457add7</entry>
Nov 18 18:29:52 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:29:52 user nova-compute[74692]:     </system>
Nov 18 18:29:52 user nova-compute[74692]:   </sysinfo>
Nov 18 18:29:52 user nova-compute[74692]:   <os>
Nov 18 18:29:52 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:29:52 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:29:52 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:29:52 user nova-compute[74692]:   </os>
Nov 18 18:29:52 user nova-compute[74692]:   <features>
Nov 18 18:29:52 user nova-compute[74692]:     <acpi/>
Nov 18 18:29:52 user nova-compute[74692]:     <apic/>
Nov 18 18:29:52 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:29:52 user nova-compute[74692]:   </features>
Nov 18 18:29:52 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:29:52 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:29:52 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:29:52 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:29:52 user nova-compute[74692]:   </clock>
Nov 18 18:29:52 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:29:52 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:29:52 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:29:52 user nova-compute[74692]:   </cpu>
Nov 18 18:29:52 user nova-compute[74692]:   <devices>
Nov 18 18:29:52 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:29:52 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:29:52 user nova-compute[74692]:       <source dev="/dev/sdi"/>
Nov 18 18:29:52 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:29:52 user nova-compute[74692]:       <serial>3eeda74a-6f86-4797-8c30-fb05c69e7bd6</serial>
Nov 18 18:29:52 user nova-compute[74692]:     </disk>
Nov 18 18:29:52 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:29:52 user nova-compute[74692]:       <mac address="fa:16:3e:0c:58:cc"/>
Nov 18 18:29:52 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:52 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:29:52 user nova-compute[74692]:       <target dev="tapbdd4ef83-83"/>
Nov 18 18:29:52 user nova-compute[74692]:     </interface>
Nov 18 18:29:52 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:29:52 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/7960f76b-9176-4d98-8045-03678457add7/console.log" append="off"/>
Nov 18 18:29:52 user nova-compute[74692]:     </serial>
Nov 18 18:29:52 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:29:52 user nova-compute[74692]:     <video>
Nov 18 18:29:52 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:29:52 user nova-compute[74692]:     </video>
Nov 18 18:29:52 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:29:52 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:29:52 user nova-compute[74692]:     </rng>
Nov 18 18:29:52 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:29:52 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:29:52 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:29:52 user nova-compute[74692]:     </memballoon>
Nov 18 18:29:52 user nova-compute[74692]:   </devices>
Nov 18 18:29:52 user nova-compute[74692]: </domain>
Nov 18 18:29:52 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2059968008',display_name='tempest-TestShelveInstance-server-2059968008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2059968008',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqvDFaau/67R12i2PVg3zAmOTHhomyvhTqHRvkp08NpDDwRA6rjvsD7HSARckE1h3VtjUuYwEBUoGDT9lZLitru1a2otYt+5V6h8m0rpnvHGvpStzG11FTI2Dj8WqOnDw==',key_name='tempest-TestShelveInstance-1852882518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5425715d2457463b8464c69b99c63831',ramdisk_id='',reservation_id='r-3gclmodf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-213519045',owner_user_name='tempest-TestShelveInstance-213519045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:29:44Z,user_data=None,user_id='dce10cede81746b2bead51383a21b0a3',uuid=7960f76b-9176-4d98-8045-03678457add7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Converting VIF {"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=bdd4ef83-835c-42c0-a7e0-0432ab03618f,network=Network(cb98a4f1-8a2e-4b02-923f-810f47f4dccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd4ef83-83') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG os_vif [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=bdd4ef83-835c-42c0-a7e0-0432ab03618f,network=Network(cb98a4f1-8a2e-4b02-923f-810f47f4dccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd4ef83-83') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0f343f2-e9d5-5c81-a2c9-b28965c6461c', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdd4ef83-83, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbdd4ef83-83, col_values=(('qos', UUID('15f95141-80ea-4cd2-9a89-7ac9d1beff67')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbdd4ef83-83, col_values=(('external_ids', {'iface-id': 'bdd4ef83-835c-42c0-a7e0-0432ab03618f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:58:cc', 'vm-uuid': '7960f76b-9176-4d98-8045-03678457add7'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:52 user nova-compute[74692]: INFO os_vif [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=bdd4ef83-835c-42c0-a7e0-0432ab03618f,network=Network(cb98a4f1-8a2e-4b02-923f-810f47f4dccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd4ef83-83')
Nov 18 18:29:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:29:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] No VIF found with MAC fa:16:3e:0c:58:cc, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:29:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:54 user nova-compute[74692]: DEBUG nova.compute.manager [req-f7dc3e9b-e711-4f92-a494-14c02e2581cf req-2f66138f-0341-4dd8-8187-a1281ee55de2 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f7dc3e9b-e711-4f92-a494-14c02e2581cf req-2f66138f-0341-4dd8-8187-a1281ee55de2 service nova] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f7dc3e9b-e711-4f92-a494-14c02e2581cf req-2f66138f-0341-4dd8-8187-a1281ee55de2 service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f7dc3e9b-e711-4f92-a494-14c02e2581cf req-2f66138f-0341-4dd8-8187-a1281ee55de2 service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:54 user nova-compute[74692]: DEBUG nova.compute.manager [req-f7dc3e9b-e711-4f92-a494-14c02e2581cf req-2f66138f-0341-4dd8-8187-a1281ee55de2 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] No waiting events found dispatching network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:54 user nova-compute[74692]: WARNING nova.compute.manager [req-f7dc3e9b-e711-4f92-a494-14c02e2581cf req-2f66138f-0341-4dd8-8187-a1281ee55de2 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received unexpected event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f for instance with vm_state building and task_state spawning.
Nov 18 18:29:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:29:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:29:56 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7960f76b-9176-4d98-8045-03678457add7] Instance spawned successfully.
Nov 18 18:29:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:29:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:29:56 user nova-compute[74692]: DEBUG nova.compute.manager [req-3ebaa33e-c3f4-493a-9240-eb23d39706bd req-b2e18f5e-f21e-412d-8deb-489f57d437db service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:29:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3ebaa33e-c3f4-493a-9240-eb23d39706bd req-b2e18f5e-f21e-412d-8deb-489f57d437db service nova] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:29:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3ebaa33e-c3f4-493a-9240-eb23d39706bd req-b2e18f5e-f21e-412d-8deb-489f57d437db service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:29:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3ebaa33e-c3f4-493a-9240-eb23d39706bd req-b2e18f5e-f21e-412d-8deb-489f57d437db service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:56 user nova-compute[74692]: DEBUG nova.compute.manager [req-3ebaa33e-c3f4-493a-9240-eb23d39706bd req-b2e18f5e-f21e-412d-8deb-489f57d437db service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] No waiting events found dispatching network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:29:56 user nova-compute[74692]: WARNING nova.compute.manager [req-3ebaa33e-c3f4-493a-9240-eb23d39706bd req-b2e18f5e-f21e-412d-8deb-489f57d437db service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received unexpected event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f for instance with vm_state building and task_state spawning.
Nov 18 18:29:56 user nova-compute[74692]: INFO nova.compute.manager [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 18 18:29:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:29:56 user nova-compute[74692]: INFO nova.compute.manager [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Took 14.00 seconds to build instance.
Nov 18 18:29:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2f3e9dab-9c4d-408f-b904-36066ee8ea89 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "7960f76b-9176-4d98-8045-03678457add7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.187s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:29:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:29:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:30:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 18:30:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:30:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:30:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:02 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquiring lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG nova.objects.instance [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lazy-loading 'flavor' on Instance uuid afe4e445-5419-4a79-ae32-294e0ac0a7c0 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquiring lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:03 user nova-compute[74692]: INFO nova.compute.manager [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Attaching volume 75e0cfd7-a441-428a-928e-bffbcbcffb01 to /dev/vdb
Nov 18 18:30:03 user nova-compute[74692]: DEBUG os_brick.utils [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10550d6-6877-4a6e-9723-d5ec2e14a944]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7310cbc6-b2f9-461d-9c53-9663d68383a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59eea96-7c44-4922-8087-dc5644d42ea6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd7c6d2-3426-4b77-95e0-7206b86134fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:03 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:30:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3d6855-4113-4db4-8a12-024e6c187805]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG os_brick.utils [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:03 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Updating existing volume attachment record: b4f383a8-d4d0-4b35-82e8-6584b8d06022 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:30:04 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:30:05 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:30:05 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:30:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:05 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:30:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:30:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:30:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:30:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:30:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:10 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:30:10 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=6780MB free_disk=25.498092651367188GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance afe4e445-5419-4a79-ae32-294e0ac0a7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance bebb6344-183e-4367-bb0b-b575b70adfbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17447e1-2e91-4d25-bf3a-3705927ec122 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 76506747-4a6b-40bd-b812-bf114be5e8b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d40a1c6a-a5c1-46ff-ae2f-70819a1903b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 765c948c-4ad7-4e98-9fb7-ec3a9f194a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance e1603038-3a10-4efb-b5f7-15495ccd3717 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 40481706-78c9-402d-9d19-d2d00d812095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7960f76b-9176-4d98-8045-03678457add7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wEVPorxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:10 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:10 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:10 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8579b278-49b3-4dcd-ba07-5352e19ee8f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:30:10 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[896c578e-bf96-422a-b10d-3e0917d0b818]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01] added
Nov 18 18:30:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c68e0b-8c28-4e72-9e43-8a492169a103]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5080439f-1557-4510-9667-43624dedad73]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wEVPorxl {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wEVPorxl" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da5e1e2-1571-474e-93dc-73e436c157cd]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wEVPorxl'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[336bbb3f-d8a7-4df8-b1d0-2ed54fee232a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82e071c-cb13-419b-abb5-d1e38fdf7ffb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34ccca5-3dd5-4ea2-9760-4dddeb9a793a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01, portal: 172.16.0.220,3260]
Nov 18 18:30:10 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01, portal: 172.16.0.220,3260] successful.
Nov 18 18:30:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0b196d-45d4-46c4-a31b-48c689c953af]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8738e4-df16-47d9-b0e4-64165c262cdf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:10 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.040s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eedb57-c1df-4a02-9e1c-468dea4f40ef]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:30:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wEVPorxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG nova.compute.manager [req-e506df2c-8ffd-4684-ad53-6193627bbd85 req-05ac1af8-8313-4c6a-b9c8-448c70510fe5 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received event network-changed-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG nova.compute.manager [req-e506df2c-8ffd-4684-ad53-6193627bbd85 req-05ac1af8-8313-4c6a-b9c8-448c70510fe5 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Refreshing instance network info cache due to event network-changed-3ea5c349-f13f-453c-81e5-388c93e6dfa4. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e506df2c-8ffd-4684-ad53-6193627bbd85 req-05ac1af8-8313-4c6a-b9c8-448c70510fe5 service nova] Acquiring lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e506df2c-8ffd-4684-ad53-6193627bbd85 req-05ac1af8-8313-4c6a-b9c8-448c70510fe5 service nova] Acquired lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG nova.network.neutron [req-e506df2c-8ffd-4684-ad53-6193627bbd85 req-05ac1af8-8313-4c6a-b9c8-448c70510fe5 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Refreshing network info cache for port 3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '26238626635323635', 'path': '/dev/sdj'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238626635323635', 'path': '/dev/sdj'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG nova.objects.instance [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lazy-loading 'flavor' on Instance uuid afe4e445-5419-4a79-ae32-294e0ac0a7c0 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:30:11 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:30:11 user nova-compute[74692]:   <source dev="/dev/sdj"/>
Nov 18 18:30:11 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:30:11 user nova-compute[74692]:   <serial>75e0cfd7-a441-428a-928e-bffbcbcffb01</serial>
Nov 18 18:30:11 user nova-compute[74692]: </disk>
Nov 18 18:30:11 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG nova.network.neutron [req-e506df2c-8ffd-4684-ad53-6193627bbd85 req-05ac1af8-8313-4c6a-b9c8-448c70510fe5 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updated VIF entry in instance network info cache for port 3ea5c349-f13f-453c-81e5-388c93e6dfa4. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG nova.network.neutron [req-e506df2c-8ffd-4684-ad53-6193627bbd85 req-05ac1af8-8313-4c6a-b9c8-448c70510fe5 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updating instance_info_cache with network_info: [{"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e506df2c-8ffd-4684-ad53-6193627bbd85 req-05ac1af8-8313-4c6a-b9c8-448c70510fe5 service nova] Releasing lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:30:11 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:30:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:12 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updating instance_info_cache with network_info: [{"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:30:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:30:12 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:30:12 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:30:12 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:30:12 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:30:12 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:30:12 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:30:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:30:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:30:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] No VIF found with MAC fa:16:3e:67:61:1d, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cde414b1-e5c7-48ff-b75b-1b097895b0c4 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.587s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquiring lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquiring lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:13 user nova-compute[74692]: INFO nova.compute.manager [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Terminating instance
Nov 18 18:30:13 user nova-compute[74692]: DEBUG nova.compute.manager [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG nova.compute.manager [req-6de9682b-3674-40e7-9c67-881a92625954 req-2a07a6ff-37fb-442b-b2b8-ad5b8a81a5e4 service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Received event network-vif-unplugged-0f17b65c-54ab-45fb-a250-e917fc87ef10 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6de9682b-3674-40e7-9c67-881a92625954 req-2a07a6ff-37fb-442b-b2b8-ad5b8a81a5e4 service nova] Acquiring lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6de9682b-3674-40e7-9c67-881a92625954 req-2a07a6ff-37fb-442b-b2b8-ad5b8a81a5e4 service nova] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6de9682b-3674-40e7-9c67-881a92625954 req-2a07a6ff-37fb-442b-b2b8-ad5b8a81a5e4 service nova] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG nova.compute.manager [req-6de9682b-3674-40e7-9c67-881a92625954 req-2a07a6ff-37fb-442b-b2b8-ad5b8a81a5e4 service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] No waiting events found dispatching network-vif-unplugged-0f17b65c-54ab-45fb-a250-e917fc87ef10 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:30:13 user nova-compute[74692]: DEBUG nova.compute.manager [req-6de9682b-3674-40e7-9c67-881a92625954 req-2a07a6ff-37fb-442b-b2b8-ad5b8a81a5e4 service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Received event network-vif-unplugged-0f17b65c-54ab-45fb-a250-e917fc87ef10 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:14 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Instance destroyed successfully.
Nov 18 18:30:14 user nova-compute[74692]: DEBUG nova.objects.instance [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lazy-loading 'resources' on Instance uuid afe4e445-5419-4a79-ae32-294e0ac0a7c0 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-38746030',display_name='tempest-DeleteServersTestJSON-server-38746030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-38746030',id=1,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:28:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0706238908747f1a06bc4ea7750dfdf',ramdisk_id='',reservation_id='r-j8tou1f4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1083559718',owner_user_name='tempest-DeleteServersTestJSON-1083559718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:28:26Z,user_data=None,user_id='9413da4a9a1d4b0c8a8ac05f03fe15da',uuid=afe4e445-5419-4a79-ae32-294e0ac0a7c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "address": "fa:16:3e:67:61:1d", "network": {"id": "58efb65a-1cab-4ed5-a03e-808fa70f9179", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747026108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0706238908747f1a06bc4ea7750dfdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f17b65c-54", "ovs_interfaceid": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Converting VIF {"id": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "address": "fa:16:3e:67:61:1d", "network": {"id": "58efb65a-1cab-4ed5-a03e-808fa70f9179", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747026108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0706238908747f1a06bc4ea7750dfdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f17b65c-54", "ovs_interfaceid": "0f17b65c-54ab-45fb-a250-e917fc87ef10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:61:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f17b65c-54ab-45fb-a250-e917fc87ef10,network=Network(58efb65a-1cab-4ed5-a03e-808fa70f9179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f17b65c-54') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_vif [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:61:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f17b65c-54ab-45fb-a250-e917fc87ef10,network=Network(58efb65a-1cab-4ed5-a03e-808fa70f9179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f17b65c-54') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f17b65c-54, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73e0398d-f516-4dd7-9f92-63c20f9391c3) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:30:14 user nova-compute[74692]: INFO os_vif [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:61:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f17b65c-54ab-45fb-a250-e917fc87ef10,network=Network(58efb65a-1cab-4ed5-a03e-808fa70f9179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f17b65c-54')
Nov 18 18:30:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wEVPorxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:14 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab483a9-d842-4820-a079-0d78ab107f8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:30:14 user nova-compute[74692]: No targets found.
Nov 18 18:30:14 user nova-compute[74692]: iSNS:
Nov 18 18:30:14 user nova-compute[74692]: No targets found.
Nov 18 18:30:14 user nova-compute[74692]: STATIC:
Nov 18 18:30:14 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf
Nov 18 18:30:14 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:14 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:14 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a
Nov 18 18:30:14 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:14 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:14 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16
Nov 18 18:30:14 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:14 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:14 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87
Nov 18 18:30:14 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:14 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:14 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0
Nov 18 18:30:14 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:14 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:14 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01
Nov 18 18:30:14 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:14 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:14 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:30:14 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:14 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:14 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e
Nov 18 18:30:14 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:14 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:14 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593
Nov 18 18:30:14 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:14 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:14 user nova-compute[74692]: FIRMWARE:
Nov 18 18:30:14 user nova-compute[74692]: No targets found.
Nov 18 18:30:14 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:30:14 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:30:14 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5ea25c-0206-4f4f-aecc-85004a5936a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[edef1df1-d2c7-4864-857b-0e7c24ff2d14]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:14 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:14 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:14 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41d418f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01'): ({'sdj'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Removing single pathed devices sdj {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[219f721a-a0a3-47c0-a2b1-3fe77391a916]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eb211a-a3ae-4b40-a978-4d2c40f10814]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Flushing IO for device /dev/sdj {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5182633-ac8e-4799-8b11-778fa185c08b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.045s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffafdc75-ac71-4e18-89af-bb76547fda5d]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] SCSI volumes sdj have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b21aff2-0696-444c-b80e-42ee1415cad3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbcd538-0e0e-4496-92b8-7eeda4218f19]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01, portal: 172.16.0.220,3260]
Nov 18 18:30:14 user nova-compute[74692]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01, portal: 172.16.0.220,3260] successful.
Nov 18 18:30:14 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e0cfd7-a441-428a-928e-bffbcbcffb01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c89f2c-ba34-403b-ae80-1702add4db69]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] <== disconnect_volume: return (349ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:30:14 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Deleting instance files /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0_del
Nov 18 18:30:14 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Deletion of /opt/stack/data/nova/instances/afe4e445-5419-4a79-ae32-294e0ac0a7c0_del complete
Nov 18 18:30:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74692) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 18 18:30:14 user nova-compute[74692]: INFO nova.virt.libvirt.host [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] UEFI support detected
Nov 18 18:30:14 user nova-compute[74692]: INFO nova.compute.manager [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 18 18:30:14 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:30:14 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:30:15 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:30:15 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Took 0.64 seconds to deallocate network for instance.
Nov 18 18:30:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "bebb6344-183e-4367-bb0b-b575b70adfbc" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:15 user nova-compute[74692]: INFO nova.compute.manager [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Shelving
Nov 18 18:30:15 user nova-compute[74692]: DEBUG nova.compute.manager [req-269e40b0-1013-4091-977a-036458ef46e3 req-1bf3264d-6bfc-4d5f-9292-60755ceecaee service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Received event network-vif-plugged-0f17b65c-54ab-45fb-a250-e917fc87ef10 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-269e40b0-1013-4091-977a-036458ef46e3 req-1bf3264d-6bfc-4d5f-9292-60755ceecaee service nova] Acquiring lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-269e40b0-1013-4091-977a-036458ef46e3 req-1bf3264d-6bfc-4d5f-9292-60755ceecaee service nova] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-269e40b0-1013-4091-977a-036458ef46e3 req-1bf3264d-6bfc-4d5f-9292-60755ceecaee service nova] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:15 user nova-compute[74692]: DEBUG nova.compute.manager [req-269e40b0-1013-4091-977a-036458ef46e3 req-1bf3264d-6bfc-4d5f-9292-60755ceecaee service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] No waiting events found dispatching network-vif-plugged-0f17b65c-54ab-45fb-a250-e917fc87ef10 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:30:15 user nova-compute[74692]: WARNING nova.compute.manager [req-269e40b0-1013-4091-977a-036458ef46e3 req-1bf3264d-6bfc-4d5f-9292-60755ceecaee service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Received unexpected event network-vif-plugged-0f17b65c-54ab-45fb-a250-e917fc87ef10 for instance with vm_state active and task_state deleting.
Nov 18 18:30:15 user nova-compute[74692]: DEBUG nova.compute.manager [req-269e40b0-1013-4091-977a-036458ef46e3 req-1bf3264d-6bfc-4d5f-9292-60755ceecaee service nova] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Received event network-vif-deleted-0f17b65c-54ab-45fb-a250-e917fc87ef10 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-37eafc5c-bfdf-4330-a45c-4fa7284d95ba req-10aaf4a4-d49c-4689-9687-525b2258b318 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received event network-vif-unplugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-37eafc5c-bfdf-4330-a45c-4fa7284d95ba req-10aaf4a4-d49c-4689-9687-525b2258b318 service nova] Acquiring lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-37eafc5c-bfdf-4330-a45c-4fa7284d95ba req-10aaf4a4-d49c-4689-9687-525b2258b318 service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-37eafc5c-bfdf-4330-a45c-4fa7284d95ba req-10aaf4a4-d49c-4689-9687-525b2258b318 service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-37eafc5c-bfdf-4330-a45c-4fa7284d95ba req-10aaf4a4-d49c-4689-9687-525b2258b318 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] No waiting events found dispatching network-vif-unplugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:30:16 user nova-compute[74692]: WARNING nova.compute.manager [req-37eafc5c-bfdf-4330-a45c-4fa7284d95ba req-10aaf4a4-d49c-4689-9687-525b2258b318 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received unexpected event network-vif-unplugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 for instance with vm_state active and task_state shelving.
Nov 18 18:30:16 user nova-compute[74692]: INFO nova.compute.manager [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] [instance: afe4e445-5419-4a79-ae32-294e0ac0a7c0] Took 0.94 seconds to detach 1 volumes for instance.
Nov 18 18:30:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:16 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Instance destroyed successfully.
Nov 18 18:30:16 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Beginning cold snapshot process
Nov 18 18:30:16 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:30:16 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:30:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:16 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:30:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk /opt/stack/data/nova/instances/snapshots/tmpbk783ify/c35f2bce54ab41ce99a1c574676d8b30 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:16 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Deleted allocations for instance afe4e445-5419-4a79-ae32-294e0ac0a7c0
Nov 18 18:30:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e7326f72-f0eb-462b-a3a3-32d7ad5e8f44 tempest-DeleteServersTestJSON-1083559718 tempest-DeleteServersTestJSON-1083559718-project-member] Lock "afe4e445-5419-4a79-ae32-294e0ac0a7c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.758s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk /opt/stack/data/nova/instances/snapshots/tmpbk783ify/c35f2bce54ab41ce99a1c574676d8b30" returned: 0 in 1.275s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:18 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Snapshot extracted, beginning image upload
Nov 18 18:30:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-30ee4cf5-f816-4974-9587-ecc84a7f65e1 req-4c0b8844-7cea-4fd8-857a-58c1bbe4fc61 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received event network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-30ee4cf5-f816-4974-9587-ecc84a7f65e1 req-4c0b8844-7cea-4fd8-857a-58c1bbe4fc61 service nova] Acquiring lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-30ee4cf5-f816-4974-9587-ecc84a7f65e1 req-4c0b8844-7cea-4fd8-857a-58c1bbe4fc61 service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-30ee4cf5-f816-4974-9587-ecc84a7f65e1 req-4c0b8844-7cea-4fd8-857a-58c1bbe4fc61 service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-30ee4cf5-f816-4974-9587-ecc84a7f65e1 req-4c0b8844-7cea-4fd8-857a-58c1bbe4fc61 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] No waiting events found dispatching network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:30:18 user nova-compute[74692]: WARNING nova.compute.manager [req-30ee4cf5-f816-4974-9587-ecc84a7f65e1 req-4c0b8844-7cea-4fd8-857a-58c1bbe4fc61 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received unexpected event network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 for instance with vm_state active and task_state shelving_image_uploading.
Nov 18 18:30:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Snapshot image upload complete
Nov 18 18:30:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:30:20 user nova-compute[74692]: INFO nova.compute.manager [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Shelve offloading
Nov 18 18:30:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Instance destroyed successfully.
Nov 18 18:30:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:30:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:30:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquired lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:30:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG nova.network.neutron [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updating instance_info_cache with network_info: [{"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Releasing lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:30:21 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Instance destroyed successfully.
Nov 18 18:30:21 user nova-compute[74692]: DEBUG nova.objects.instance [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'resources' on Instance uuid bebb6344-183e-4367-bb0b-b575b70adfbc {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1074163696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1074163696',id=2,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeLBOPFzK9EaCTBkDnIIkEDoB/rVhgGY9JYnZGbi0tGbLRkFO76l0CO4COQkIW7VJcbNIL08CVp8x3z68j+yJdAOAZQA/in4FEAcfWxAJTCv0DtidMPu5KzAnRV9OgdZw==',key_name='tempest-keypair-1821240249',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1f169f28da1640d9b03b4ba44b4e7b7c',ramdisk_id='',reservation_id='r-s1ly0l0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1768400085',owner_user_name='tempest-AttachVolumeShelveTestJSON-1768400085-project-member',shelved_at='2023-11-18T18:30:20.752089',shelved_host='user',shelved_image_id='b9d765e0-1746-42a0-8e83-25846f14c7e1'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a005c7c46c46ad9217578412ec906f',uuid=bebb6344-183e-4367-bb0b-b575b70adfbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converting VIF {"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:98:ed,bridge_name='br-int',has_traffic_filtering=True,id=3ea5c349-f13f-453c-81e5-388c93e6dfa4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea5c349-f1') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG os_vif [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:98:ed,bridge_name='br-int',has_traffic_filtering=True,id=3ea5c349-f13f-453c-81e5-388c93e6dfa4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea5c349-f1') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ea5c349-f1, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4a9ab58-a6c2-46b6-a384-080efba53676) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:21 user nova-compute[74692]: INFO os_vif [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:98:ed,bridge_name='br-int',has_traffic_filtering=True,id=3ea5c349-f13f-453c-81e5-388c93e6dfa4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea5c349-f1')
Nov 18 18:30:21 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Deleting instance files /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc_del
Nov 18 18:30:21 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Deletion of /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc_del complete
Nov 18 18:30:21 user nova-compute[74692]: DEBUG nova.compute.manager [req-1b8de916-138d-4d30-8316-19c0239732a0 req-6bfd9d21-8b68-4830-aa01-f687864f9c95 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received event network-changed-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG nova.compute.manager [req-1b8de916-138d-4d30-8316-19c0239732a0 req-6bfd9d21-8b68-4830-aa01-f687864f9c95 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Refreshing instance network info cache due to event network-changed-3ea5c349-f13f-453c-81e5-388c93e6dfa4. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1b8de916-138d-4d30-8316-19c0239732a0 req-6bfd9d21-8b68-4830-aa01-f687864f9c95 service nova] Acquiring lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1b8de916-138d-4d30-8316-19c0239732a0 req-6bfd9d21-8b68-4830-aa01-f687864f9c95 service nova] Acquired lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG nova.network.neutron [req-1b8de916-138d-4d30-8316-19c0239732a0 req-6bfd9d21-8b68-4830-aa01-f687864f9c95 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Refreshing network info cache for port 3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:30:21 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Deleted allocations for instance bebb6344-183e-4367-bb0b-b575b70adfbc
Nov 18 18:30:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG nova.objects.instance [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'numa_topology' on Instance uuid bebb6344-183e-4367-bb0b-b575b70adfbc {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:21 user nova-compute[74692]: DEBUG nova.objects.base [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Object Instance<bebb6344-183e-4367-bb0b-b575b70adfbc> lazy-loaded attributes: resources,numa_topology {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:30:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:22 user nova-compute[74692]: DEBUG nova.network.neutron [req-1b8de916-138d-4d30-8316-19c0239732a0 req-6bfd9d21-8b68-4830-aa01-f687864f9c95 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updated VIF entry in instance network info cache for port 3ea5c349-f13f-453c-81e5-388c93e6dfa4. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:30:22 user nova-compute[74692]: DEBUG nova.network.neutron [req-1b8de916-138d-4d30-8316-19c0239732a0 req-6bfd9d21-8b68-4830-aa01-f687864f9c95 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updating instance_info_cache with network_info: [{"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:30:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1b8de916-138d-4d30-8316-19c0239732a0 req-6bfd9d21-8b68-4830-aa01-f687864f9c95 service nova] Releasing lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:30:22 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:30:22 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:30:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4e9edafc-7b44-42b3-a348-890fa441d159 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.570s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:26 user nova-compute[74692]: DEBUG nova.compute.manager [req-e5f89df2-8964-4f18-a75c-adcd885caef9 req-c8a7a8fe-0cb1-472f-8cb9-ae9dd36dce4d service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Received event network-changed-c79b925e-78c4-4334-a547-9294f9b4c8fe {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:26 user nova-compute[74692]: DEBUG nova.compute.manager [req-e5f89df2-8964-4f18-a75c-adcd885caef9 req-c8a7a8fe-0cb1-472f-8cb9-ae9dd36dce4d service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Refreshing instance network info cache due to event network-changed-c79b925e-78c4-4334-a547-9294f9b4c8fe. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:30:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e5f89df2-8964-4f18-a75c-adcd885caef9 req-c8a7a8fe-0cb1-472f-8cb9-ae9dd36dce4d service nova] Acquiring lock "refresh_cache-7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:30:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e5f89df2-8964-4f18-a75c-adcd885caef9 req-c8a7a8fe-0cb1-472f-8cb9-ae9dd36dce4d service nova] Acquired lock "refresh_cache-7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:30:26 user nova-compute[74692]: DEBUG nova.network.neutron [req-e5f89df2-8964-4f18-a75c-adcd885caef9 req-c8a7a8fe-0cb1-472f-8cb9-ae9dd36dce4d service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Refreshing network info cache for port c79b925e-78c4-4334-a547-9294f9b4c8fe {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:30:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:27 user nova-compute[74692]: DEBUG nova.network.neutron [req-e5f89df2-8964-4f18-a75c-adcd885caef9 req-c8a7a8fe-0cb1-472f-8cb9-ae9dd36dce4d service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Updated VIF entry in instance network info cache for port c79b925e-78c4-4334-a547-9294f9b4c8fe. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:30:27 user nova-compute[74692]: DEBUG nova.network.neutron [req-e5f89df2-8964-4f18-a75c-adcd885caef9 req-c8a7a8fe-0cb1-472f-8cb9-ae9dd36dce4d service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Updating instance_info_cache with network_info: [{"id": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "address": "fa:16:3e:61:b3:d1", "network": {"id": "820dd503-a51a-4b71-82db-3df377e71223", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-3428666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468fb75f9614b1a9830981e411c0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b925e-78", "ovs_interfaceid": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:30:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e5f89df2-8964-4f18-a75c-adcd885caef9 req-c8a7a8fe-0cb1-472f-8cb9-ae9dd36dce4d service nova] Releasing lock "refresh_cache-7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:30:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-ff271555-2e67-47cb-95cc-b90f3e24de84 req-63e75cb8-e02d-48e3-86ba-285b086a3cce service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received event network-changed-9935070a-ab06-4411-afeb-9039ecbea8bc {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-ff271555-2e67-47cb-95cc-b90f3e24de84 req-63e75cb8-e02d-48e3-86ba-285b086a3cce service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Refreshing instance network info cache due to event network-changed-9935070a-ab06-4411-afeb-9039ecbea8bc. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:30:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ff271555-2e67-47cb-95cc-b90f3e24de84 req-63e75cb8-e02d-48e3-86ba-285b086a3cce service nova] Acquiring lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:30:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ff271555-2e67-47cb-95cc-b90f3e24de84 req-63e75cb8-e02d-48e3-86ba-285b086a3cce service nova] Acquired lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:30:28 user nova-compute[74692]: DEBUG nova.network.neutron [req-ff271555-2e67-47cb-95cc-b90f3e24de84 req-63e75cb8-e02d-48e3-86ba-285b086a3cce service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Refreshing network info cache for port 9935070a-ab06-4411-afeb-9039ecbea8bc {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:30:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-8fe3458e-e5d7-45c5-93d1-1ed87e1db02b req-7ac177ef-2c47-45fb-9db1-baba1d43ae27 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Received event network-changed-11c1b5b3-4d09-4461-9d7f-d879f706805c {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-8fe3458e-e5d7-45c5-93d1-1ed87e1db02b req-7ac177ef-2c47-45fb-9db1-baba1d43ae27 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Refreshing instance network info cache due to event network-changed-11c1b5b3-4d09-4461-9d7f-d879f706805c. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:30:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8fe3458e-e5d7-45c5-93d1-1ed87e1db02b req-7ac177ef-2c47-45fb-9db1-baba1d43ae27 service nova] Acquiring lock "refresh_cache-d17447e1-2e91-4d25-bf3a-3705927ec122" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:30:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8fe3458e-e5d7-45c5-93d1-1ed87e1db02b req-7ac177ef-2c47-45fb-9db1-baba1d43ae27 service nova] Acquired lock "refresh_cache-d17447e1-2e91-4d25-bf3a-3705927ec122" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:30:28 user nova-compute[74692]: DEBUG nova.network.neutron [req-8fe3458e-e5d7-45c5-93d1-1ed87e1db02b req-7ac177ef-2c47-45fb-9db1-baba1d43ae27 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Refreshing network info cache for port 11c1b5b3-4d09-4461-9d7f-d879f706805c {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquiring lock "d17447e1-2e91-4d25-bf3a-3705927ec122" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG nova.objects.instance [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lazy-loading 'flavor' on Instance uuid d17447e1-2e91-4d25-bf3a-3705927ec122 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.119s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "interface-0b9551f1-bc3e-4221-95fc-3b3a4a33251c-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "interface-0b9551f1-bc3e-4221-95fc-3b3a4a33251c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG nova.objects.instance [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lazy-loading 'flavor' on Instance uuid 0b9551f1-bc3e-4221-95fc-3b3a4a33251c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG nova.network.neutron [req-8fe3458e-e5d7-45c5-93d1-1ed87e1db02b req-7ac177ef-2c47-45fb-9db1-baba1d43ae27 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Updated VIF entry in instance network info cache for port 11c1b5b3-4d09-4461-9d7f-d879f706805c. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG nova.network.neutron [req-8fe3458e-e5d7-45c5-93d1-1ed87e1db02b req-7ac177ef-2c47-45fb-9db1-baba1d43ae27 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Updating instance_info_cache with network_info: [{"id": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "address": "fa:16:3e:1c:ef:47", "network": {"id": "dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1097989855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ac758bb60347ad8ea3b4f2bf9292cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c1b5b3-4d", "ovs_interfaceid": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8fe3458e-e5d7-45c5-93d1-1ed87e1db02b req-7ac177ef-2c47-45fb-9db1-baba1d43ae27 service nova] Releasing lock "refresh_cache-d17447e1-2e91-4d25-bf3a-3705927ec122" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquiring lock "d17447e1-2e91-4d25-bf3a-3705927ec122" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:29 user nova-compute[74692]: INFO nova.compute.manager [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Attaching volume 8273228d-7d9f-4179-a45f-4eb6e5b5880b to /dev/vdb
Nov 18 18:30:29 user nova-compute[74692]: DEBUG os_brick.utils [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b158e0b9-fc79-47e0-977c-6c1b5c6c2030]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6aa7bea-4bf3-4387-87f0-211d59d49991]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG nova.objects.instance [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lazy-loading 'pci_requests' on Instance uuid 0b9551f1-bc3e-4221-95fc-3b3a4a33251c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG nova.objects.base [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Object Instance<0b9551f1-bc3e-4221-95fc-3b3a4a33251c> lazy-loaded attributes: flavor,pci_requests {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb6dc45-7f79-4f26-9dcb-7e9c93da9a86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f88d8a4-4838-4aa9-97e4-8c415e90f80c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:29 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[077354da-9944-4b1d-a993-a54d5989e46f]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG os_brick.utils [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Updating existing volume attachment record: 6980f6eb-3e49-47f7-9df3-72eac8bd1862 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG nova.objects.instance [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lazy-loading 'flavor' on Instance uuid 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG nova.policy [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39b207b60dbe460f83bf961a995e5342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722ae3b1a66f46c9a0679d562b22e470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG nova.network.neutron [req-ff271555-2e67-47cb-95cc-b90f3e24de84 req-63e75cb8-e02d-48e3-86ba-285b086a3cce service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Updated VIF entry in instance network info cache for port 9935070a-ab06-4411-afeb-9039ecbea8bc. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG nova.network.neutron [req-ff271555-2e67-47cb-95cc-b90f3e24de84 req-63e75cb8-e02d-48e3-86ba-285b086a3cce service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Updating instance_info_cache with network_info: [{"id": "9935070a-ab06-4411-afeb-9039ecbea8bc", "address": "fa:16:3e:a9:05:46", "network": {"id": "da3ff499-fbcd-4f27-bd2a-6f4d23814cc6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1280089118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9935070a-ab", "ovs_interfaceid": "9935070a-ab06-4411-afeb-9039ecbea8bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ff271555-2e67-47cb-95cc-b90f3e24de84 req-63e75cb8-e02d-48e3-86ba-285b086a3cce service nova] Releasing lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:29 user nova-compute[74692]: INFO nova.compute.manager [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Attaching volume 423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 to /dev/sdc
Nov 18 18:30:29 user nova-compute[74692]: DEBUG os_brick.utils [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c679135-5abb-4534-b916-2ea0a8b03113]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[531acee8-abb4-4640-b5bd-c74d32b8d9aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eec1776-257b-4479-80f7-401c67a7b1d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[90422e79-b24b-4d09-a4e5-4a83ab7d0afc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:29 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:30:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d516fe-a51d-4157-b156-f55327688c84]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG os_brick.utils [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:29 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Updating existing volume attachment record: 22688239-d4c1-4836-95d1-0d8279d46969 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:30:30 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Successfully created port: 57868bb5-51e2-4d1f-b04e-6308332991b6 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:30:30 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Successfully updated port: 57868bb5-51e2-4d1f-b04e-6308332991b6 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:30:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:30:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquired lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:30:30 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:30:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-91779d17-624d-430d-b5f1-6f6efd90b67e req-84080a19-1157-4db4-9d67-3ac383c88ff2 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received event network-changed-57868bb5-51e2-4d1f-b04e-6308332991b6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-91779d17-624d-430d-b5f1-6f6efd90b67e req-84080a19-1157-4db4-9d67-3ac383c88ff2 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Refreshing instance network info cache due to event network-changed-57868bb5-51e2-4d1f-b04e-6308332991b6. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:30:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91779d17-624d-430d-b5f1-6f6efd90b67e req-84080a19-1157-4db4-9d67-3ac383c88ff2 service nova] Acquiring lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Updating instance_info_cache with network_info: [{"id": "9935070a-ab06-4411-afeb-9039ecbea8bc", "address": "fa:16:3e:a9:05:46", "network": {"id": "da3ff499-fbcd-4f27-bd2a-6f4d23814cc6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1280089118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9935070a-ab", "ovs_interfaceid": "9935070a-ab06-4411-afeb-9039ecbea8bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57868bb5-51e2-4d1f-b04e-6308332991b6", "address": "fa:16:3e:42:b5:34", "network": {"id": "007966f5-554c-4e4a-a409-9aa0d874260b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-279700966", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57868bb5-51", "ovs_interfaceid": "57868bb5-51e2-4d1f-b04e-6308332991b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Releasing lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91779d17-624d-430d-b5f1-6f6efd90b67e req-84080a19-1157-4db4-9d67-3ac383c88ff2 service nova] Acquired lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG nova.network.neutron [req-91779d17-624d-430d-b5f1-6f6efd90b67e req-84080a19-1157-4db4-9d67-3ac383c88ff2 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Refreshing network info cache for port 57868bb5-51e2-4d1f-b04e-6308332991b6 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-796391196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-796391196',id=5,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3gJO/TwdDSf1yN3ZchrXCyXLk6TezdqH7o7X0wfuK4mUN+34DlZO1554usfJkK2dsoaKwNDHuloE+Z5C2eKZ2s7LsvuKmsXer8Y96AOq7N/zPoRVeXal22WhpetQTiRg==',key_name='tempest-keypair-1001776154',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:28:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='722ae3b1a66f46c9a0679d562b22e470',ramdisk_id='',reservation_id='r-j9yyn7m1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1784015919',owner_user_name='tempest-TaggedAttachmentsTest-1784015919-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:28:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39b207b60dbe460f83bf961a995e5342',uuid=0b9551f1-bc3e-4221-95fc-3b3a4a33251c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57868bb5-51e2-4d1f-b04e-6308332991b6", "address": "fa:16:3e:42:b5:34", "network": {"id": "007966f5-554c-4e4a-a409-9aa0d874260b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-279700966", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57868bb5-51", "ovs_interfaceid": "57868bb5-51e2-4d1f-b04e-6308332991b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Converting VIF {"id": "57868bb5-51e2-4d1f-b04e-6308332991b6", "address": "fa:16:3e:42:b5:34", "network": {"id": "007966f5-554c-4e4a-a409-9aa0d874260b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-279700966", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57868bb5-51", "ovs_interfaceid": "57868bb5-51e2-4d1f-b04e-6308332991b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:b5:34,bridge_name='br-int',has_traffic_filtering=True,id=57868bb5-51e2-4d1f-b04e-6308332991b6,network=Network(007966f5-554c-4e4a-a409-9aa0d874260b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57868bb5-51') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG os_vif [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:b5:34,bridge_name='br-int',has_traffic_filtering=True,id=57868bb5-51e2-4d1f-b04e-6308332991b6,network=Network(007966f5-554c-4e4a-a409-9aa0d874260b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57868bb5-51') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0068b77-1a77-524e-b12c-2528ed1f67d4', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57868bb5-51, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57868bb5-51, col_values=(('qos', UUID('d2ab4d4c-614e-4e56-bc80-f6bbfb331127')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57868bb5-51, col_values=(('external_ids', {'iface-id': '57868bb5-51e2-4d1f-b04e-6308332991b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:b5:34', 'vm-uuid': '0b9551f1-bc3e-4221-95fc-3b3a4a33251c'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:31 user nova-compute[74692]: INFO os_vif [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:b5:34,bridge_name='br-int',has_traffic_filtering=True,id=57868bb5-51e2-4d1f-b04e-6308332991b6,network=Network(007966f5-554c-4e4a-a409-9aa0d874260b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57868bb5-51')
Nov 18 18:30:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-796391196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-796391196',id=5,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3gJO/TwdDSf1yN3ZchrXCyXLk6TezdqH7o7X0wfuK4mUN+34DlZO1554usfJkK2dsoaKwNDHuloE+Z5C2eKZ2s7LsvuKmsXer8Y96AOq7N/zPoRVeXal22WhpetQTiRg==',key_name='tempest-keypair-1001776154',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:28:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='722ae3b1a66f46c9a0679d562b22e470',ramdisk_id='',reservation_id='r-j9yyn7m1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1784015919',owner_user_name='tempest-TaggedAttachmentsTest-1784015919-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:28:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39b207b60dbe460f83bf961a995e5342',uuid=0b9551f1-bc3e-4221-95fc-3b3a4a33251c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57868bb5-51e2-4d1f-b04e-6308332991b6", "address": "fa:16:3e:42:b5:34", "network": {"id": "007966f5-554c-4e4a-a409-9aa0d874260b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-279700966", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57868bb5-51", "ovs_interfaceid": "57868bb5-51e2-4d1f-b04e-6308332991b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Converting VIF {"id": "57868bb5-51e2-4d1f-b04e-6308332991b6", "address": "fa:16:3e:42:b5:34", "network": {"id": "007966f5-554c-4e4a-a409-9aa0d874260b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-279700966", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57868bb5-51", "ovs_interfaceid": "57868bb5-51e2-4d1f-b04e-6308332991b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:b5:34,bridge_name='br-int',has_traffic_filtering=True,id=57868bb5-51e2-4d1f-b04e-6308332991b6,network=Network(007966f5-554c-4e4a-a409-9aa0d874260b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57868bb5-51') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] attach device xml: <interface type="ethernet">
Nov 18 18:30:31 user nova-compute[74692]:   <mac address="fa:16:3e:42:b5:34"/>
Nov 18 18:30:31 user nova-compute[74692]:   <model type="virtio"/>
Nov 18 18:30:31 user nova-compute[74692]:   <mtu size="1442"/>
Nov 18 18:30:31 user nova-compute[74692]:   <target dev="tap57868bb5-51"/>
Nov 18 18:30:31 user nova-compute[74692]: </interface>
Nov 18 18:30:31 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] No BDM found with device name hda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] No VIF found with MAC fa:16:3e:a9:05:46, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG nova.network.neutron [req-91779d17-624d-430d-b5f1-6f6efd90b67e req-84080a19-1157-4db4-9d67-3ac383c88ff2 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Updated VIF entry in instance network info cache for port 57868bb5-51e2-4d1f-b04e-6308332991b6. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG nova.network.neutron [req-91779d17-624d-430d-b5f1-6f6efd90b67e req-84080a19-1157-4db4-9d67-3ac383c88ff2 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Updating instance_info_cache with network_info: [{"id": "9935070a-ab06-4411-afeb-9039ecbea8bc", "address": "fa:16:3e:a9:05:46", "network": {"id": "da3ff499-fbcd-4f27-bd2a-6f4d23814cc6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1280089118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9935070a-ab", "ovs_interfaceid": "9935070a-ab06-4411-afeb-9039ecbea8bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57868bb5-51e2-4d1f-b04e-6308332991b6", "address": "fa:16:3e:42:b5:34", "network": {"id": "007966f5-554c-4e4a-a409-9aa0d874260b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-279700966", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57868bb5-51", "ovs_interfaceid": "57868bb5-51e2-4d1f-b04e-6308332991b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91779d17-624d-430d-b5f1-6f6efd90b67e req-84080a19-1157-4db4-9d67-3ac383c88ff2 service nova] Releasing lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:30:32 user nova-compute[74692]:   <nova:package version="0.0.0"/>
Nov 18 18:30:32 user nova-compute[74692]:   <nova:name>tempest-device-tagging-server-796391196</nova:name>
Nov 18 18:30:32 user nova-compute[74692]:   <nova:creationTime>2023-11-18 18:30:32</nova:creationTime>
Nov 18 18:30:32 user nova-compute[74692]:   <nova:flavor name="m1.tiny">
Nov 18 18:30:32 user nova-compute[74692]:     <nova:memory>512</nova:memory>
Nov 18 18:30:32 user nova-compute[74692]:     <nova:disk>1</nova:disk>
Nov 18 18:30:32 user nova-compute[74692]:     <nova:swap>0</nova:swap>
Nov 18 18:30:32 user nova-compute[74692]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:30:32 user nova-compute[74692]:     <nova:vcpus>1</nova:vcpus>
Nov 18 18:30:32 user nova-compute[74692]:   </nova:flavor>
Nov 18 18:30:32 user nova-compute[74692]:   <nova:owner>
Nov 18 18:30:32 user nova-compute[74692]:     <nova:user uuid="39b207b60dbe460f83bf961a995e5342">tempest-TaggedAttachmentsTest-1784015919-project-member</nova:user>
Nov 18 18:30:32 user nova-compute[74692]:     <nova:project uuid="722ae3b1a66f46c9a0679d562b22e470">tempest-TaggedAttachmentsTest-1784015919</nova:project>
Nov 18 18:30:32 user nova-compute[74692]:   </nova:owner>
Nov 18 18:30:32 user nova-compute[74692]:   <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:30:32 user nova-compute[74692]:   <nova:ports>
Nov 18 18:30:32 user nova-compute[74692]:     <nova:port uuid="9935070a-ab06-4411-afeb-9039ecbea8bc">
Nov 18 18:30:32 user nova-compute[74692]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 18:30:32 user nova-compute[74692]:     </nova:port>
Nov 18 18:30:32 user nova-compute[74692]:     <nova:port uuid="57868bb5-51e2-4d1f-b04e-6308332991b6">
Nov 18 18:30:32 user nova-compute[74692]:       <nova:ip type="fixed" address="10.10.10.100" ipVersion="4"/>
Nov 18 18:30:32 user nova-compute[74692]:     </nova:port>
Nov 18 18:30:32 user nova-compute[74692]:   </nova:ports>
Nov 18 18:30:32 user nova-compute[74692]: </nova:instance>
Nov 18 18:30:32 user nova-compute[74692]:  {{(pid=74692) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cbdb9b60-a0cd-4f5b-b599-39284e7e4b6b tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "interface-0b9551f1-bc3e-4221-95fc-3b3a4a33251c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.145s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lazy-loading 'flavor' on Instance uuid 0b9551f1-bc3e-4221-95fc-3b3a4a33251c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:32 user nova-compute[74692]: INFO nova.compute.manager [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Attaching volume 8f5a57ce-001e-487a-83d3-1265fb253860 to /dev/vdb
Nov 18 18:30:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-84f09be4-2766-45de-83d9-bd589cee2bbe req-4cfae4e0-d5c2-4e85-b17e-782f2205d535 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received event network-vif-plugged-57868bb5-51e2-4d1f-b04e-6308332991b6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-84f09be4-2766-45de-83d9-bd589cee2bbe req-4cfae4e0-d5c2-4e85-b17e-782f2205d535 service nova] Acquiring lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-84f09be4-2766-45de-83d9-bd589cee2bbe req-4cfae4e0-d5c2-4e85-b17e-782f2205d535 service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-84f09be4-2766-45de-83d9-bd589cee2bbe req-4cfae4e0-d5c2-4e85-b17e-782f2205d535 service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-84f09be4-2766-45de-83d9-bd589cee2bbe req-4cfae4e0-d5c2-4e85-b17e-782f2205d535 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] No waiting events found dispatching network-vif-plugged-57868bb5-51e2-4d1f-b04e-6308332991b6 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:30:33 user nova-compute[74692]: WARNING nova.compute.manager [req-84f09be4-2766-45de-83d9-bd589cee2bbe req-4cfae4e0-d5c2-4e85-b17e-782f2205d535 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received unexpected event network-vif-plugged-57868bb5-51e2-4d1f-b04e-6308332991b6 for instance with vm_state active and task_state None.
Nov 18 18:30:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-84f09be4-2766-45de-83d9-bd589cee2bbe req-4cfae4e0-d5c2-4e85-b17e-782f2205d535 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received event network-vif-plugged-57868bb5-51e2-4d1f-b04e-6308332991b6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-84f09be4-2766-45de-83d9-bd589cee2bbe req-4cfae4e0-d5c2-4e85-b17e-782f2205d535 service nova] Acquiring lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-84f09be4-2766-45de-83d9-bd589cee2bbe req-4cfae4e0-d5c2-4e85-b17e-782f2205d535 service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-84f09be4-2766-45de-83d9-bd589cee2bbe req-4cfae4e0-d5c2-4e85-b17e-782f2205d535 service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-84f09be4-2766-45de-83d9-bd589cee2bbe req-4cfae4e0-d5c2-4e85-b17e-782f2205d535 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] No waiting events found dispatching network-vif-plugged-57868bb5-51e2-4d1f-b04e-6308332991b6 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:30:33 user nova-compute[74692]: WARNING nova.compute.manager [req-84f09be4-2766-45de-83d9-bd589cee2bbe req-4cfae4e0-d5c2-4e85-b17e-782f2205d535 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received unexpected event network-vif-plugged-57868bb5-51e2-4d1f-b04e-6308332991b6 for instance with vm_state active and task_state None.
Nov 18 18:30:33 user nova-compute[74692]: DEBUG os_brick.utils [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e6f9c6-c811-43bd-954f-b22d110a5228]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[45236759-c669-4f79-a6bc-f96961929694]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a946d0-4c07-4b96-a251-3a34a61f133c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e65d6b2-27ba-4a1b-8d12-434c82b266b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:33 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3859f313-99e8-45bb-b609-413c4153c5ae]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG os_brick.utils [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Updating existing volume attachment record: 405b5b36-3c91-48c3-92dd-fd2e32764968 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-ed567a59-cd61-4f57-828b-480edebe35db req-9450ee98-f005-4403-ae53-61d2668cb3f3 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received event network-changed-9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-ed567a59-cd61-4f57-828b-480edebe35db req-9450ee98-f005-4403-ae53-61d2668cb3f3 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Refreshing instance network info cache due to event network-changed-9ba43cb0-30b9-43ae-8f81-3df420497fff. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ed567a59-cd61-4f57-828b-480edebe35db req-9450ee98-f005-4403-ae53-61d2668cb3f3 service nova] Acquiring lock "refresh_cache-76506747-4a6b-40bd-b812-bf114be5e8b4" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ed567a59-cd61-4f57-828b-480edebe35db req-9450ee98-f005-4403-ae53-61d2668cb3f3 service nova] Acquired lock "refresh_cache-76506747-4a6b-40bd-b812-bf114be5e8b4" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:30:33 user nova-compute[74692]: DEBUG nova.network.neutron [req-ed567a59-cd61-4f57-828b-480edebe35db req-9450ee98-f005-4403-ae53-61d2668cb3f3 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Refreshing network info cache for port 9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:30:34 user nova-compute[74692]: DEBUG nova.network.neutron [req-ed567a59-cd61-4f57-828b-480edebe35db req-9450ee98-f005-4403-ae53-61d2668cb3f3 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Updated VIF entry in instance network info cache for port 9ba43cb0-30b9-43ae-8f81-3df420497fff. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:30:34 user nova-compute[74692]: DEBUG nova.network.neutron [req-ed567a59-cd61-4f57-828b-480edebe35db req-9450ee98-f005-4403-ae53-61d2668cb3f3 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Updating instance_info_cache with network_info: [{"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:30:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ed567a59-cd61-4f57-828b-480edebe35db req-9450ee98-f005-4403-ae53-61d2668cb3f3 service nova] Releasing lock "refresh_cache-76506747-4a6b-40bd-b812-bf114be5e8b4" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkNgoGnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:35 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:35 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:35 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c2f95e-3bae-4206-b771-760a9311bb72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:30:35 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2d127e-7690-4717-b46e-b172a60f7941]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b] added
Nov 18 18:30:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f58940-284a-47aa-a406-5b2e14d59900]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[284e7e9b-f52c-4b06-94fc-78ef6cea3254]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkNgoGnR {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkNgoGnR" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a605e5b-66ae-4114-93e4-c03aae24b7cf]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vkNgoGnR'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb96b84-cdf4-44a6-80fb-194dfcd1ce7e]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c460b0a8-1412-46dd-abef-df9633811680]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8a13f2-fc3f-4265-a4f1-a4574fe979b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260]
Nov 18 18:30:35 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260] successful.
Nov 18 18:30:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd45522f-5e73-413b-9bf0-c28492c4928d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c9aa16-36d8-4f75-97ee-19ef15e9df9c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:35 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.028s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2409d05-43a1-4d24-b8be-c625dbf9f0b5]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:30:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkNgoGnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NpkJeGAm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:36 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:30:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:36 user nova-compute[74692]: INFO nova.compute.manager [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Rebuilding instance
Nov 18 18:30:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '26334386165616666', 'path': '/dev/sdj'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334386165616666', 'path': '/dev/sdj'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.659s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:36 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:30:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:36 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:30:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG nova.objects.instance [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lazy-loading 'flavor' on Instance uuid d17447e1-2e91-4d25-bf3a-3705927ec122 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94a56ab-c18e-4546-a5f7-ecfb4301eaca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:30:36 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:30:36 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:30:36 user nova-compute[74692]:   <source dev="/dev/sdj"/>
Nov 18 18:30:36 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:30:36 user nova-compute[74692]:   <serial>8273228d-7d9f-4179-a45f-4eb6e5b5880b</serial>
Nov 18 18:30:36 user nova-compute[74692]: </disk>
Nov 18 18:30:36 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-62b3256c-3866-41da-9246-0ce604adbe54 req-b517968b-8064-4759-b4c8-37f60815aeb7 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received event network-vif-unplugged-9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-62b3256c-3866-41da-9246-0ce604adbe54 req-b517968b-8064-4759-b4c8-37f60815aeb7 service nova] Acquiring lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-62b3256c-3866-41da-9246-0ce604adbe54 req-b517968b-8064-4759-b4c8-37f60815aeb7 service nova] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-62b3256c-3866-41da-9246-0ce604adbe54 req-b517968b-8064-4759-b4c8-37f60815aeb7 service nova] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-62b3256c-3866-41da-9246-0ce604adbe54 req-b517968b-8064-4759-b4c8-37f60815aeb7 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] No waiting events found dispatching network-vif-unplugged-9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:30:36 user nova-compute[74692]: WARNING nova.compute.manager [req-62b3256c-3866-41da-9246-0ce604adbe54 req-b517968b-8064-4759-b4c8-37f60815aeb7 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received unexpected event network-vif-unplugged-9ba43cb0-30b9-43ae-8f81-3df420497fff for instance with vm_state active and task_state rebuilding.
Nov 18 18:30:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8f9e7d-f881-4352-9a72-80c4f0938cd9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6] added
Nov 18 18:30:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2dde3c-e7df-4a0d-8b3f-fdc46841cc8d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a0c1bc-34b1-43db-9119-0eb4c54ece93]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NpkJeGAm {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NpkJeGAm" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[186e91cd-0cf8-443f-9d56-cb5e347aa0b5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NpkJeGAm'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a872f450-3d7c-4e74-b6dc-e83269c787c5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e519d48-7eda-4857-8d0b-b42bc204e7ef]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d13d8f-4c99-4cf4-a3b7-21d3e8c8ffcf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6, portal: 172.16.0.220,3260]
Nov 18 18:30:37 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6, portal: 172.16.0.220,3260] successful.
Nov 18 18:30:37 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d3405b-e633-40db-9f98-0b20e6458e48]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33b4aa9-e190-471b-a1df-6265aeb03e15]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:37 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:37 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[897dd2f4-5700-43b2-ad5f-22db0d498d64]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NpkJeGAm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] No VIF found with MAC fa:16:3e:1c:ef:47, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-243cdfdf-82f5-4e3d-b9e6-5d0a7800696e tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.254s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:37 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Instance destroyed successfully.
Nov 18 18:30:37 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Instance destroyed successfully.
Nov 18 18:30:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-531822998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-626426105',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTHSxq3l9P151CfI0F18PIKGxWORN+tyCeI14rp0SJ3N9oq0TLT9ZnzNpxntJM2DuX3cToXTszKRjjVF26/nMLI0+HVGYhPNvxTS05iN12eMktmp14rfpm1F3GFT67jMA==',key_name='tempest-keypair-503198552',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='210268bb72854d749ca0e5865b441377',ramdisk_id='',reservation_id='r-0j9378kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-812059553',owner_user_name='tempest-ServerActionsV293TestJSON-812059553-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:30:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0babd17983e74a4792e3c72b70e4298b',uuid=76506747-4a6b-40bd-b812-bf114be5e8b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Converting VIF {"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:c2:39,bridge_name='br-int',has_traffic_filtering=True,id=9ba43cb0-30b9-43ae-8f81-3df420497fff,network=Network(9f685a03-85ba-4cab-bccb-8862ef230237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba43cb0-30') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_vif [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:c2:39,bridge_name='br-int',has_traffic_filtering=True,id=9ba43cb0-30b9-43ae-8f81-3df420497fff,network=Network(9f685a03-85ba-4cab-bccb-8862ef230237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba43cb0-30') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ba43cb0-30, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27d8696a-6e31-4236-993c-3e34e9a7248b) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:37 user nova-compute[74692]: INFO os_vif [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:c2:39,bridge_name='br-int',has_traffic_filtering=True,id=9ba43cb0-30b9-43ae-8f81-3df420497fff,network=Network(9f685a03-85ba-4cab-bccb-8862ef230237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba43cb0-30')
Nov 18 18:30:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqQgpinc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:37 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 18:30:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Acquiring lock "d17447e1-2e91-4d25-bf3a-3705927ec122" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] <== connect_volume: return (2129ms) {'type': 'block', 'scsi_wwn': '26630343732623263', 'path': '/dev/sdk'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630343732623263', 'path': '/dev/sdk'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.670s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.utils [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG nova.objects.instance [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lazy-loading 'flavor' on Instance uuid 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[419ccdd6-7403-49b3-a598-81d58e6e30eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b15ef19-02e6-42de-9b65-4f061c33a4ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:30:38 user nova-compute[74692]: No targets found.
Nov 18 18:30:38 user nova-compute[74692]: iSNS:
Nov 18 18:30:38 user nova-compute[74692]: No targets found.
Nov 18 18:30:38 user nova-compute[74692]: STATIC:
Nov 18 18:30:38 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf
Nov 18 18:30:38 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:38 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:38 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a
Nov 18 18:30:38 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:38 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:38 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16
Nov 18 18:30:38 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:38 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:38 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87
Nov 18 18:30:38 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:38 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:38 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0
Nov 18 18:30:38 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:38 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:38 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b
Nov 18 18:30:38 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:38 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:38 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:30:38 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:38 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:38 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6
Nov 18 18:30:38 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:38 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:38 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e
Nov 18 18:30:38 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:38 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:38 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593
Nov 18 18:30:38 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:38 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:38 user nova-compute[74692]: FIRMWARE:
Nov 18 18:30:38 user nova-compute[74692]: No targets found.
Nov 18 18:30:38 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:30:38 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:30:38 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-8b83ffe6-f666-4cc4-ad68-26d965be8cbf req-b32d1915-ae55-474b-bfa3-c47b3c43648c service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Received event network-changed-aec7a2cf-bc00-43f3-819b-fc6e0471448f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-8b83ffe6-f666-4cc4-ad68-26d965be8cbf req-b32d1915-ae55-474b-bfa3-c47b3c43648c service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Refreshing instance network info cache due to event network-changed-aec7a2cf-bc00-43f3-819b-fc6e0471448f. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8b83ffe6-f666-4cc4-ad68-26d965be8cbf req-b32d1915-ae55-474b-bfa3-c47b3c43648c service nova] Acquiring lock "refresh_cache-d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8b83ffe6-f666-4cc4-ad68-26d965be8cbf req-b32d1915-ae55-474b-bfa3-c47b3c43648c service nova] Acquired lock "refresh_cache-d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG nova.network.neutron [req-8b83ffe6-f666-4cc4-ad68-26d965be8cbf req-b32d1915-ae55-474b-bfa3-c47b3c43648c service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Refreshing network info cache for port aec7a2cf-bc00-43f3-819b-fc6e0471448f {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:30:38 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:30:38 user nova-compute[74692]:   <source dev="/dev/sdk"/>
Nov 18 18:30:38 user nova-compute[74692]:   <target dev="sdc" bus="scsi"/>
Nov 18 18:30:38 user nova-compute[74692]:   <serial>423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6</serial>
Nov 18 18:30:38 user nova-compute[74692]:   <address type="drive" controller="0" unit="2"/>
Nov 18 18:30:38 user nova-compute[74692]: </disk>
Nov 18 18:30:38 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c429d242-84de-4216-8b69-972de936c954]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd91692-4c05-4225-b695-a83dcc07f0f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cd785e-2633-49cf-b415-a6b7c136f17e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea26005-e6e7-4eef-ba53-605d30876785]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0823512-5846-4c79-9a91-ac1516be3217]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:38 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:38 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:38 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c474f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:38 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc413e6-1df7-4366-b8c7-546b1b067233]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.utils [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb4d41f-4210-4608-ace0-8d89b3ac8ef2]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7519bc6-abfd-4fc9-826f-14b2716ba163]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce39271-ec5d-4f7c-a78e-cab8beba6700]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:38 user nova-compute[74692]: INFO nova.compute.manager [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Swapping volume 8273228d-7d9f-4179-a45f-4eb6e5b5880b for 3d151d79-2775-4092-9852-83e8cf4eaee7
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ed4aaf-440c-407d-b3bc-3dee56451acc]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Acquiring lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Lazy-loading 'flavor' on Instance uuid d40a1c6a-a5c1-46ff-ae2f-70819a1903b0 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9c9079-877c-4899-825e-99e685145514]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.126s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd35d3b8-e403-4201-8841-daab12a0e8c1]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260]
Nov 18 18:30:38 user nova-compute[74692]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260] successful.
Nov 18 18:30:38 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddca9919-a9aa-4d1d-b9bd-e41acc38e5d6]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.484s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] <== disconnect_volume: return (1153ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:30:38 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Deleting instance files /opt/stack/data/nova/instances/76506747-4a6b-40bd-b812-bf114be5e8b4_del
Nov 18 18:30:38 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Deletion of /opt/stack/data/nova/instances/76506747-4a6b-40bd-b812-bf114be5e8b4_del complete
Nov 18 18:30:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] No BDM found with device name sda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:30:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] No VIF found with MAC fa:16:3e:61:b3:d1, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG nova.network.neutron [req-8b83ffe6-f666-4cc4-ad68-26d965be8cbf req-b32d1915-ae55-474b-bfa3-c47b3c43648c service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Updated VIF entry in instance network info cache for port aec7a2cf-bc00-43f3-819b-fc6e0471448f. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG nova.network.neutron [req-8b83ffe6-f666-4cc4-ad68-26d965be8cbf req-b32d1915-ae55-474b-bfa3-c47b3c43648c service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Updating instance_info_cache with network_info: [{"id": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "address": "fa:16:3e:7b:25:65", "network": {"id": "5181b213-08d4-4a73-9a77-cbf83dea1a3e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1859216473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e80926040f74a899bc7af0af8cc7343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec7a2cf-bc", "ovs_interfaceid": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8b83ffe6-f666-4cc4-ad68-26d965be8cbf req-b32d1915-ae55-474b-bfa3-c47b3c43648c service nova] Releasing lock "refresh_cache-d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-6f5e1701-8faf-46e9-a60c-4d40ebf79e73 req-97f435e5-a066-4f9e-88a3-05bfebf0f682 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received event network-vif-plugged-9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6f5e1701-8faf-46e9-a60c-4d40ebf79e73 req-97f435e5-a066-4f9e-88a3-05bfebf0f682 service nova] Acquiring lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6f5e1701-8faf-46e9-a60c-4d40ebf79e73 req-97f435e5-a066-4f9e-88a3-05bfebf0f682 service nova] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6f5e1701-8faf-46e9-a60c-4d40ebf79e73 req-97f435e5-a066-4f9e-88a3-05bfebf0f682 service nova] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-6f5e1701-8faf-46e9-a60c-4d40ebf79e73 req-97f435e5-a066-4f9e-88a3-05bfebf0f682 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] No waiting events found dispatching network-vif-plugged-9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:30:39 user nova-compute[74692]: WARNING nova.compute.manager [req-6f5e1701-8faf-46e9-a60c-4d40ebf79e73 req-97f435e5-a066-4f9e-88a3-05bfebf0f682 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received unexpected event network-vif-plugged-9ba43cb0-30b9-43ae-8f81-3df420497fff for instance with vm_state active and task_state rebuilding.
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Acquiring lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:39 user nova-compute[74692]: INFO nova.compute.manager [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Attaching volume 5867953c-08d6-4ec6-be4a-467716bed898 to /dev/vdb
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-77672e09-1d7a-474f-907c-1d6ffe1e16f6 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.562s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:39 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 76506747-4a6b-40bd-b812-bf114be5e8b4 could not be found.
Nov 18 18:30:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqQgpinc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:39 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.utils [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2ebe92-16f8-40cb-89c3-3f9be4235884]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:30:39 user nova-compute[74692]: No targets found.
Nov 18 18:30:39 user nova-compute[74692]: iSNS:
Nov 18 18:30:39 user nova-compute[74692]: No targets found.
Nov 18 18:30:39 user nova-compute[74692]: STATIC:
Nov 18 18:30:39 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf
Nov 18 18:30:39 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:39 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:39 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a
Nov 18 18:30:39 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:39 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:39 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16
Nov 18 18:30:39 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:39 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:39 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87
Nov 18 18:30:39 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:39 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:39 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b
Nov 18 18:30:39 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:39 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:39 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:30:39 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:39 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:39 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6
Nov 18 18:30:39 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:39 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:39 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e
Nov 18 18:30:39 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:39 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:39 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593
Nov 18 18:30:39 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:39 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:39 user nova-compute[74692]: FIRMWARE:
Nov 18 18:30:39 user nova-compute[74692]: No targets found.
Nov 18 18:30:39 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:30:39 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:30:39 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7450621-90b8-4bfa-acc3-940b2ed64b0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[753718d8-857a-43ba-b1f7-3d659ef367a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[79008bef-804b-4696-aa86-34dd37990362]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b68c17b-ee10-4f61-b639-d0dddd29bd49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[286b4fda-b384-403e-bb10-0903de5d0f63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8edab2e-4c9b-4caf-9e05-d902f10f8985]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:39 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:39 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:39 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c41efe20>, {}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Disconnecting from: [] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.126s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] <== disconnect_volume: return (127ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:39 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa380f4b-a538-44a5-9481-3c58cbd24e82]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.utils [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Updating existing volume attachment record: 4ba85ba2-1362-46e2-b8f0-6054d0a2d473 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqmKEYkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:39 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:39 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:39 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef456b4-db69-4acd-be0b-3a3bec7d7c3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:30:39 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3451ac-0bcf-4fc2-8354-ae9a40b3ba53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860] added
Nov 18 18:30:39 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a07bbdb-da0a-47ed-9e8b-0f274ce6eb79]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93b7979-3f7a-4788-b9b2-6ca7e2d90ad1]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eqmKEYkI {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eqmKEYkI" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b016af5e-3a24-41a7-8daf-40b65d747b25]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eqmKEYkI'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cc9f7f-ec34-42ba-8b22-2f19ac818df6]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[423460f6-3442-4f3f-9fba-cf1f9f96f520]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --login" returned: 0 in 0.185s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4062beae-00c4-46fa-86a2-be18e4220d34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860, portal: 172.16.0.220,3260]
Nov 18 18:30:40 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860, portal: 172.16.0.220,3260] successful.
Nov 18 18:30:40 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c661e1fe-0d24-44de-800d-d70a35de54dd]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a0bd9a-d3f2-47ed-8612-64583b00d6a1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:40 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:40 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.493s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8ccb92-4876-42be-a079-445c34b0a948]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:40 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: None {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Preparing to wait for external event volume-reimaged-a2912de2-b649-4082-bc87-4b46b3981cd0 {{(pid=74692) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqmKEYkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.528s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] <== connect_volume: return (1530ms) {'type': 'block', 'scsi_wwn': '23436343031316234', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436343031316234', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lazy-loading 'flavor' on Instance uuid 0b9551f1-bc3e-4221-95fc-3b3a4a33251c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:30:41 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:30:41 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 18:30:41 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:30:41 user nova-compute[74692]:   <serial>8f5a57ce-001e-487a-83d3-1265fb253860</serial>
Nov 18 18:30:41 user nova-compute[74692]: </disk>
Nov 18 18:30:41 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] No BDM found with device name hda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:30:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] No VIF found with MAC fa:16:3e:a9:05:46, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:30:41 user nova-compute[74692]: INFO nova.compute.manager [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Detaching volume 423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6
Nov 18 18:30:41 user nova-compute[74692]: INFO nova.virt.block_device [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Attempting to driver detach volume 423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 from mountpoint /dev/sdc
Nov 18 18:30:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Attempting to detach device sdc from instance 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:30:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:30:42 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:30:42 user nova-compute[74692]:   <source dev="/dev/sdk"/>
Nov 18 18:30:42 user nova-compute[74692]:   <target dev="sdc" bus="scsi"/>
Nov 18 18:30:42 user nova-compute[74692]:   <serial>423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6</serial>
Nov 18 18:30:42 user nova-compute[74692]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 18 18:30:42 user nova-compute[74692]: </disk>
Nov 18 18:30:42 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:30:42 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Successfully detached device sdc from instance 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1 from the persistent domain config.
Nov 18 18:30:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:30:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:30:42 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:30:42 user nova-compute[74692]:   <source dev="/dev/sdk"/>
Nov 18 18:30:42 user nova-compute[74692]:   <target dev="sdc" bus="scsi"/>
Nov 18 18:30:42 user nova-compute[74692]:   <serial>423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6</serial>
Nov 18 18:30:42 user nova-compute[74692]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 18 18:30:42 user nova-compute[74692]: </disk>
Nov 18 18:30:42 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:30:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3bea546c-acea-4803-8c09-9e7ab8da4686 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.133s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:30:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:43 user nova-compute[74692]: INFO nova.compute.manager [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Detaching volume 8f5a57ce-001e-487a-83d3-1265fb253860
Nov 18 18:30:43 user nova-compute[74692]: INFO nova.virt.block_device [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Attempting to driver detach volume 8f5a57ce-001e-487a-83d3-1265fb253860 from mountpoint /dev/vdb
Nov 18 18:30:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Attempting to detach device vdb from instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:30:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:30:43 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:30:43 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 18:30:43 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:30:43 user nova-compute[74692]:   <serial>8f5a57ce-001e-487a-83d3-1265fb253860</serial>
Nov 18 18:30:43 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 18:30:43 user nova-compute[74692]: </disk>
Nov 18 18:30:43 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:30:43 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Successfully detached device vdb from instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c from the persistent domain config.
Nov 18 18:30:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:30:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:30:43 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:30:43 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 18:30:43 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:30:43 user nova-compute[74692]:   <serial>8f5a57ce-001e-487a-83d3-1265fb253860</serial>
Nov 18 18:30:43 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 18:30:43 user nova-compute[74692]: </disk>
Nov 18 18:30:43 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:30:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjoDlnut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd17447e1-2e91-4d25-bf3a-3705927ec122', 'attached_at': '', 'detached_at': '', 'volume_id': '3d151d79-2775-4092-9852-83e8cf4eaee7', 'serial': '3d151d79-2775-4092-9852-83e8cf4eaee7'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkNgoGnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'd17447e1-2e91-4d25-bf3a-3705927ec122', 'attached_at': '', 'detached_at': '', 'volume_id': '8273228d-7d9f-4179-a45f-4eb6e5b5880b', 'serial'} {{(pid=74692) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjoDlnut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:45 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:45 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:45 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94ab6d5-f628-4ef7-9383-5e7d7e99fa56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:30:45 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[98502e88-7a4e-4d60-98e0-32f4f4014399]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7] added
Nov 18 18:30:45 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a115cf0-70d9-4d03-8e5c-e1084339460f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[52982d81-4711-42ae-89bf-0128686febe7]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjoDlnut {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjoDlnut" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[17707cfd-a300-4201-8c7f-38fee459e120]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QjoDlnut'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cb78f2-eeb8-408b-9def-0e89b23cf428]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c5986a-d198-4fdf-9bea-51c68b69a532]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe167158-ef2a-4a1f-80d3-ce36a19c6da9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7, portal: 172.16.0.220,3260]
Nov 18 18:30:45 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7, portal: 172.16.0.220,3260] successful.
Nov 18 18:30:45 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2147f6-8264-49be-9692-6a4bd66a5152]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28ce0a5-92a3-498d-9f51-c390eb43e185]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:45 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:45 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] HCTL ('43', '-', '-', 0) found on session 14 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3449544-1420-4c52-86dd-3ed006e6e65d]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:45 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Searching for a device in session 14 and hctl ['43', '*', '*', 0] yield: None {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MaekHtEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:46 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Searching for a device in session 14 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjoDlnut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26466346266613362', 'path': '/dev/sdl'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466346266613362', 'path': '/dev/sdl'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.030s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:46 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:46 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG nova.objects.instance [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lazy-loading 'flavor' on Instance uuid d17447e1-2e91-4d25-bf3a-3705927ec122 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e929dd-6316-4639-aaa2-13e4dcef0033]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:30:46 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8dc349-4255-466a-a895-745c4ca97015]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898] added
Nov 18 18:30:46 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7584fbec-1714-4e66-9585-aa72ac7aa1db]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff6580e-2a51-4492-b2a5-92f00da75198]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MaekHtEG {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MaekHtEG" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2b38f6-a7f9-490e-b127-37dffba730bd]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MaekHtEG'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[46164f2d-01a0-4dad-98ca-be25a6932170]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90a4a83-ffc8-4552-8e49-f1169470f2c5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bdf8ac-67ca-41f4-8efe-7edc87505777]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898, portal: 172.16.0.220,3260]
Nov 18 18:30:46 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898, portal: 172.16.0.220,3260] successful.
Nov 18 18:30:46 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e4a918-3eff-41b6-9977-58f6e3f39caf]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[948e15cc-7567-4a1c-a00c-518c33d8ee37]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:46 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:46 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] HCTL ('44', '-', '-', 0) found on session 15 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Scanning host 44 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[005d32cf-761d-456d-bbd1-5a934bae6a89]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Searching for a device in session 15 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MaekHtEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:30:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:30:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 93323264 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:30:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23037653830333835', 'path': '/dev/sdm'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037653830333835', 'path': '/dev/sdm'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:30:47 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Lazy-loading 'flavor' on Instance uuid d40a1c6a-a5c1-46ff-ae2f-70819a1903b0 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] attach device xml: <disk type="block" device="disk">
Nov 18 18:30:47 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:30:47 user nova-compute[74692]:   <source dev="/dev/sdm"/>
Nov 18 18:30:47 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:30:47 user nova-compute[74692]:   <serial>5867953c-08d6-4ec6-be4a-467716bed898</serial>
Nov 18 18:30:47 user nova-compute[74692]: </disk>
Nov 18 18:30:47 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:30:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 261095424 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:30:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:30:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:30:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] No VIF found with MAC fa:16:3e:7b:25:65, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:30:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 464519168 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:30:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c4ea2575-0706-4b39-b718-7e181d5d0093 tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.397s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 615514112 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:30:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 782237696 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:30:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8bc57755-501d-4485-a4f8-5d19a9b01917 tempest-VolumesAssistedSnapshotsTest-550418715 tempest-VolumesAssistedSnapshotsTest-550418715-project] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] volume_snapshot_create: create_info: {'snapshot_id': '16ce8768-1fe7-4f16-ab5c-ca266b7f68de', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74692) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 18 18:30:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8bc57755-501d-4485-a4f8-5d19a9b01917 tempest-VolumesAssistedSnapshotsTest-550418715 tempest-VolumesAssistedSnapshotsTest-550418715-project] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] snap xml: <domainsnapshot>
Nov 18 18:30:49 user nova-compute[74692]:   <disks>
Nov 18 18:30:49 user nova-compute[74692]:     <disk name="/dev/sdm" snapshot="external" type="file">
Nov 18 18:30:49 user nova-compute[74692]:       <source file="/dev/new_file"/>
Nov 18 18:30:49 user nova-compute[74692]:     </disk>
Nov 18 18:30:49 user nova-compute[74692]:     <disk name="vda" snapshot="no"/>
Nov 18 18:30:49 user nova-compute[74692]:   </disks>
Nov 18 18:30:49 user nova-compute[74692]: </domainsnapshot>
Nov 18 18:30:49 user nova-compute[74692]:  {{(pid=74692) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 18 18:30:49 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8bc57755-501d-4485-a4f8-5d19a9b01917 tempest-VolumesAssistedSnapshotsTest-550418715 tempest-VolumesAssistedSnapshotsTest-550418715-project] Lazy-loading 'system_metadata' on Instance uuid d40a1c6a-a5c1-46ff-ae2f-70819a1903b0 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:49 user nova-compute[74692]: INFO nova.compute.manager [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Terminating instance
Nov 18 18:30:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:30:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8845ddca-946b-480e-a04e-1f0044815184 tempest-VolumesAssistedSnapshotsTest-550418715 tempest-VolumesAssistedSnapshotsTest-550418715-project] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] volume_snapshot_delete: delete_info: {'volume_id': '5867953c-08d6-4ec6-be4a-467716bed898'} {{(pid=74692) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [None req-8845ddca-946b-480e-a04e-1f0044815184 tempest-VolumesAssistedSnapshotsTest-550418715 tempest-VolumesAssistedSnapshotsTest-550418715-project] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Traceback (most recent call last):
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     if delete_info['type'] != 'qcow2':
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] KeyError: 'type'
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] 
Nov 18 18:30:49 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-8bc57755-501d-4485-a4f8-5d19a9b01917 tempest-VolumesAssistedSnapshotsTest-550418715 tempest-VolumesAssistedSnapshotsTest-550418715-project] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [None req-8bc57755-501d-4485-a4f8-5d19a9b01917 tempest-VolumesAssistedSnapshotsTest-550418715 tempest-VolumesAssistedSnapshotsTest-550418715-project] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Traceback (most recent call last):
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     rv = execute(f, *args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     six.reraise(c, e, tb)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     raise value
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     rv = meth(*args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] 
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [None req-8bc57755-501d-4485-a4f8-5d19a9b01917 tempest-VolumesAssistedSnapshotsTest-550418715 tempest-VolumesAssistedSnapshotsTest-550418715-project] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Traceback (most recent call last):
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     self._volume_snapshot_create(context, instance, guest,
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     rv = execute(f, *args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     six.reraise(c, e, tb)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     raise value
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     rv = meth(*args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] 
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [None req-8845ddca-946b-480e-a04e-1f0044815184 tempest-VolumesAssistedSnapshotsTest-550418715 tempest-VolumesAssistedSnapshotsTest-550418715-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver 
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver 
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-382cce2a-66c6-478d-96ba-9aa80401c38e)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver 
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver 
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver 
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server [None req-8845ddca-946b-480e-a04e-1f0044815184 tempest-VolumesAssistedSnapshotsTest-550418715 tempest-VolumesAssistedSnapshotsTest-550418715-project] Exception during message handling: KeyError: 'type'
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server 
Nov 18 18:30:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver [None req-8bc57755-501d-4485-a4f8-5d19a9b01917 tempest-VolumesAssistedSnapshotsTest-550418715 tempest-VolumesAssistedSnapshotsTest-550418715-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 16ce8768-1fe7-4f16-ab5c-ca266b7f68de could not be found.
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     raise value
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver 
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver 
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 16ce8768-1fe7-4f16-ab5c-ca266b7f68de could not be found. (HTTP 404) (Request-ID: req-1e635e0f-5de1-4db3-82fa-414b38284239)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver 
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver 
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 16ce8768-1fe7-4f16-ab5c-ca266b7f68de could not be found.
Nov 18 18:30:49 user nova-compute[74692]: ERROR nova.virt.libvirt.driver 
Nov 18 18:30:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server [None req-8bc57755-501d-4485-a4f8-5d19a9b01917 tempest-VolumesAssistedSnapshotsTest-550418715 tempest-VolumesAssistedSnapshotsTest-550418715-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     raise value
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 18:30:49 user nova-compute[74692]: ERROR oslo_messaging.rpc.server 
Nov 18 18:30:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 950009856 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Acquiring lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:50 user nova-compute[74692]: INFO nova.compute.manager [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Detaching volume 5867953c-08d6-4ec6-be4a-467716bed898
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-7d29bb14-f0ad-4779-9b49-092a448c9d6b req-6451ce48-68ca-41f8-8018-793d8fcf66c7 service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Received event network-vif-unplugged-d62f0de0-f5fb-4c9b-abc0-962c4442e25a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7d29bb14-f0ad-4779-9b49-092a448c9d6b req-6451ce48-68ca-41f8-8018-793d8fcf66c7 service nova] Acquiring lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7d29bb14-f0ad-4779-9b49-092a448c9d6b req-6451ce48-68ca-41f8-8018-793d8fcf66c7 service nova] Lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7d29bb14-f0ad-4779-9b49-092a448c9d6b req-6451ce48-68ca-41f8-8018-793d8fcf66c7 service nova] Lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-7d29bb14-f0ad-4779-9b49-092a448c9d6b req-6451ce48-68ca-41f8-8018-793d8fcf66c7 service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] No waiting events found dispatching network-vif-unplugged-d62f0de0-f5fb-4c9b-abc0-962c4442e25a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-7d29bb14-f0ad-4779-9b49-092a448c9d6b req-6451ce48-68ca-41f8-8018-793d8fcf66c7 service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Received event network-vif-unplugged-d62f0de0-f5fb-4c9b-abc0-962c4442e25a for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:30:50 user nova-compute[74692]: INFO nova.virt.block_device [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Attempting to driver detach volume 5867953c-08d6-4ec6-be4a-467716bed898 from mountpoint /dev/vdb
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Attempting to detach device vdb from instance d40a1c6a-a5c1-46ff-ae2f-70819a1903b0 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] detach device xml: <disk type="block" device="disk">
Nov 18 18:30:50 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:30:50 user nova-compute[74692]:   <source dev="/dev/sdm"/>
Nov 18 18:30:50 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:30:50 user nova-compute[74692]:   <serial>5867953c-08d6-4ec6-be4a-467716bed898</serial>
Nov 18 18:30:50 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:30:50 user nova-compute[74692]: </disk>
Nov 18 18:30:50 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:30:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Successfully detached device vdb from instance d40a1c6a-a5c1-46ff-ae2f-70819a1903b0 from the persistent domain config.
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d40a1c6a-a5c1-46ff-ae2f-70819a1903b0 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] detach device xml: <disk type="block" device="disk">
Nov 18 18:30:50 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:30:50 user nova-compute[74692]:   <source dev="/dev/sdm"/>
Nov 18 18:30:50 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:30:50 user nova-compute[74692]:   <serial>5867953c-08d6-4ec6-be4a-467716bed898</serial>
Nov 18 18:30:50 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:30:50 user nova-compute[74692]: </disk>
Nov 18 18:30:50 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d40a1c6a-a5c1-46ff-ae2f-70819a1903b0 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:30:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Instance destroyed successfully.
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.objects.instance [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lazy-loading 'resources' on Instance uuid 765c948c-4ad7-4e98-9fb7-ec3a9f194a05 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkNgoGnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:50 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:30:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-610115112',display_name='tempest-VolumesActionsTest-instance-610115112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-610115112',id=8,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c49de78bbe48494ca84537a8c3203c03',ramdisk_id='',reservation_id='r-1zfanp70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-948228922',owner_user_name='tempest-VolumesActionsTest-948228922-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:10Z,user_data=None,user_id='5fbcfd5f1f8949aea3a12d1cdad4fadd',uuid=765c948c-4ad7-4e98-9fb7-ec3a9f194a05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "address": "fa:16:3e:74:6f:59", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f0de0-f5", "ovs_interfaceid": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Converting VIF {"id": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "address": "fa:16:3e:74:6f:59", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f0de0-f5", "ovs_interfaceid": "d62f0de0-f5fb-4c9b-abc0-962c4442e25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=d62f0de0-f5fb-4c9b-abc0-962c4442e25a,network=Network(77ac5902-ef13-4b4f-b0b3-7c130c82a723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62f0de0-f5') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG os_vif [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=d62f0de0-f5fb-4c9b-abc0-962c4442e25a,network=Network(77ac5902-ef13-4b4f-b0b3-7c130c82a723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62f0de0-f5') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd62f0de0-f5, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=202f705c-950b-4964-878d-7a8619a1daaa) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b397e695-8717-4888-b131-d5232ae0338b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:30:50 user nova-compute[74692]: No targets found.
Nov 18 18:30:50 user nova-compute[74692]: iSNS:
Nov 18 18:30:50 user nova-compute[74692]: No targets found.
Nov 18 18:30:50 user nova-compute[74692]: STATIC:
Nov 18 18:30:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf
Nov 18 18:30:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a
Nov 18 18:30:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16
Nov 18 18:30:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87
Nov 18 18:30:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0
Nov 18 18:30:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860
Nov 18 18:30:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b
Nov 18 18:30:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7
Nov 18 18:30:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:30:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898
Nov 18 18:30:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6
Nov 18 18:30:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e
Nov 18 18:30:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593
Nov 18 18:30:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:30:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:30:50 user nova-compute[74692]: FIRMWARE:
Nov 18 18:30:50 user nova-compute[74692]: No targets found.
Nov 18 18:30:50 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:30:50 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:30:50 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:30:50 user nova-compute[74692]: INFO os_vif [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=d62f0de0-f5fb-4c9b-abc0-962c4442e25a,network=Network(77ac5902-ef13-4b4f-b0b3-7c130c82a723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62f0de0-f5')
Nov 18 18:30:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Deleting instance files /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05_del
Nov 18 18:30:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Deletion of /opt/stack/data/nova/instances/765c948c-4ad7-4e98-9fb7-ec3a9f194a05_del complete
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[983846ca-3097-4f35-b4d3-d5e360fbd984]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3335d9-d2e9-40ce-8afb-292f2e1a70ff]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:30:50 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:30:50 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a47863b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b'): ({'sdj'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Removing single pathed devices sdj {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:50 user nova-compute[74692]: INFO nova.compute.manager [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9e307e-489f-4c24-9fe2-e624e1724c3f]: (4, ('path checker states:\nup                  12\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b9d55e-c837-46bb-9b22-f8a6ae148b07]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Flushing IO for device /dev/sdj {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae040909-01dc-4c30-98da-53717cbaeedf]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:30:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.047s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c8afb8-4b19-429f-8771-c2cd38c79130]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] SCSI volumes sdj have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fa5786-d10f-4d50-b5b2-f653582bbc55]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[db43c9bb-6ac4-4b5c-85af-6ae60fd94d6f]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260]
Nov 18 18:30:51 user nova-compute[74692]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260] successful.
Nov 18 18:30:51 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c7cb6b-ae54-418e-9bde-fc7db4a218c9]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] <== disconnect_volume: return (398ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjoDlnut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': 'd17447e1-2e91-4d25-bf3a-3705927ec122', 'attached_at': '', 'detached_at': '', 'volume_id': '3d151d79-2775-4092-9852-83e8cf4eaee7', 'serial'} {{(pid=74692) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] swap_volume: removing Cinder connection for volume 8273228d-7d9f-4179-a45f-4eb6e5b5880b {{(pid=74692) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:30:51 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Took 0.90 seconds to deallocate network for instance.
Nov 18 18:30:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:52 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:30:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-6eb725bc-cfbf-40e7-8b0c-17ff87e45011 req-2174987e-ba96-4b1b-bd71-98af463f3887 service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Received event network-vif-plugged-d62f0de0-f5fb-4c9b-abc0-962c4442e25a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6eb725bc-cfbf-40e7-8b0c-17ff87e45011 req-2174987e-ba96-4b1b-bd71-98af463f3887 service nova] Acquiring lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6eb725bc-cfbf-40e7-8b0c-17ff87e45011 req-2174987e-ba96-4b1b-bd71-98af463f3887 service nova] Lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6eb725bc-cfbf-40e7-8b0c-17ff87e45011 req-2174987e-ba96-4b1b-bd71-98af463f3887 service nova] Lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-6eb725bc-cfbf-40e7-8b0c-17ff87e45011 req-2174987e-ba96-4b1b-bd71-98af463f3887 service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] No waiting events found dispatching network-vif-plugged-d62f0de0-f5fb-4c9b-abc0-962c4442e25a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:30:52 user nova-compute[74692]: WARNING nova.compute.manager [req-6eb725bc-cfbf-40e7-8b0c-17ff87e45011 req-2174987e-ba96-4b1b-bd71-98af463f3887 service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Received unexpected event network-vif-plugged-d62f0de0-f5fb-4c9b-abc0-962c4442e25a for instance with vm_state deleted and task_state None.
Nov 18 18:30:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-6eb725bc-cfbf-40e7-8b0c-17ff87e45011 req-2174987e-ba96-4b1b-bd71-98af463f3887 service nova] [instance: 765c948c-4ad7-4e98-9fb7-ec3a9f194a05] Received event network-vif-deleted-d62f0de0-f5fb-4c9b-abc0-962c4442e25a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:52 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:30:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:52 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Deleted allocations for instance 765c948c-4ad7-4e98-9fb7-ec3a9f194a05
Nov 18 18:30:52 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] swap_volume: Updating volume 8273228d-7d9f-4179-a45f-4eb6e5b5880b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "QjoDlnut", "auth_password": "i76TNWEfsg8ju9", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdl", "volume_id": "3d151d79-2775-4092-9852-83e8cf4eaee7"}, "status": "reserved", "instance": "d17447e1-2e91-4d25-bf3a-3705927ec122", "attached_at": "", "detached_at": "", "volume_id": "3d151d79-2775-4092-9852-83e8cf4eaee7", "serial": "3d151d79-2775-4092-9852-83e8cf4eaee7"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3d151d79-2775-4092-9852-83e8cf4eaee7', 'no_device': None, 'attachment_id': '5466c922-ac79-454d-a8e3-759a604c7195'} {{(pid=74692) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 18 18:30:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-08d765af-2b0f-4bc3-bf3d-67acd46c47d4 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "765c948c-4ad7-4e98-9fb7-ec3a9f194a05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.729s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1b56b041-0e37-4658-897c-ec7bc1a82867 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.972s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Acquiring lock "d17447e1-2e91-4d25-bf3a-3705927ec122" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG os_brick.utils [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3db0e95-ab65-406f-af14-922afefd2a69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cfeb53-c2a9-4523-9924-ddf835f13959]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a16c718-222b-4800-9d4e-52d3e902b736]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8901b9a-fb3d-4b59-b855-85ec7b5a4970]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:53 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:30:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb26f3b-2c67-469b-bcc2-8208f4b9915e]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:30:53 user nova-compute[74692]: DEBUG os_brick.utils [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:54 user nova-compute[74692]: INFO nova.compute.manager [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Swapping volume 3d151d79-2775-4092-9852-83e8cf4eaee7 for 8273228d-7d9f-4179-a45f-4eb6e5b5880b
Nov 18 18:30:55 user nova-compute[74692]: DEBUG nova.compute.manager [req-514668b1-f04d-4543-9f92-66420cc60fec req-a1250e54-b0e1-406b-bac5-7b9b452a241f service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-changed-d3d79063-efeb-4014-acb1-ddcfc7c57309 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:55 user nova-compute[74692]: DEBUG nova.compute.manager [req-514668b1-f04d-4543-9f92-66420cc60fec req-a1250e54-b0e1-406b-bac5-7b9b452a241f service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing instance network info cache due to event network-changed-d3d79063-efeb-4014-acb1-ddcfc7c57309. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:30:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-514668b1-f04d-4543-9f92-66420cc60fec req-a1250e54-b0e1-406b-bac5-7b9b452a241f service nova] Acquiring lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:30:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-514668b1-f04d-4543-9f92-66420cc60fec req-a1250e54-b0e1-406b-bac5-7b9b452a241f service nova] Acquired lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:30:55 user nova-compute[74692]: DEBUG nova.network.neutron [req-514668b1-f04d-4543-9f92-66420cc60fec req-a1250e54-b0e1-406b-bac5-7b9b452a241f service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Refreshing network info cache for port d3d79063-efeb-4014-acb1-ddcfc7c57309 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:30:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:56 user nova-compute[74692]: DEBUG nova.network.neutron [req-514668b1-f04d-4543-9f92-66420cc60fec req-a1250e54-b0e1-406b-bac5-7b9b452a241f service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updated VIF entry in instance network info cache for port d3d79063-efeb-4014-acb1-ddcfc7c57309. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:30:56 user nova-compute[74692]: DEBUG nova.network.neutron [req-514668b1-f04d-4543-9f92-66420cc60fec req-a1250e54-b0e1-406b-bac5-7b9b452a241f service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating instance_info_cache with network_info: [{"id": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "address": "fa:16:3e:fb:50:e4", "network": {"id": "27774fe7-2099-4253-8194-b6d160291ece", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-210587587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d79063-ef", "ovs_interfaceid": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14e00c18-ad6b-4481-852d-e336bee32648", "address": "fa:16:3e:6a:7c:8a", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e00c18-ad", "ovs_interfaceid": "14e00c18-ad6b-4481-852d-e336bee32648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "address": "fa:16:3e:2f:01:4c", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26cb4ab6-5d", "ovs_interfaceid": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "050fa40f-fc29-49bd-b29d-c7954818aa63", "address": "fa:16:3e:32:3f:b3", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050fa40f-fc", "ovs_interfaceid": "050fa40f-fc29-49bd-b29d-c7954818aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:30:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-514668b1-f04d-4543-9f92-66420cc60fec req-a1250e54-b0e1-406b-bac5-7b9b452a241f service nova] Releasing lock "refresh_cache-e1603038-3a10-4efb-b5f7-15495ccd3717" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:30:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:58 user nova-compute[74692]: INFO nova.compute.manager [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Terminating instance
Nov 18 18:30:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG nova.compute.manager [req-15b2125b-6e72-4b97-8f64-263bc45889d8 req-305f0995-430b-48e6-bc4d-7ca75b3c1bb1 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-changed-a4b46c64-5441-46a3-8da4-529a1d32046e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG nova.compute.manager [req-15b2125b-6e72-4b97-8f64-263bc45889d8 req-305f0995-430b-48e6-bc4d-7ca75b3c1bb1 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing instance network info cache due to event network-changed-a4b46c64-5441-46a3-8da4-529a1d32046e. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-15b2125b-6e72-4b97-8f64-263bc45889d8 req-305f0995-430b-48e6-bc4d-7ca75b3c1bb1 service nova] Acquiring lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-15b2125b-6e72-4b97-8f64-263bc45889d8 req-305f0995-430b-48e6-bc4d-7ca75b3c1bb1 service nova] Acquired lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG nova.network.neutron [req-15b2125b-6e72-4b97-8f64-263bc45889d8 req-305f0995-430b-48e6-bc4d-7ca75b3c1bb1 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Refreshing network info cache for port a4b46c64-5441-46a3-8da4-529a1d32046e {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-b94770f5-5958-40fb-835f-0137b906d4fa req-5261d4d5-5947-4b5f-ad44-628d65407691 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received event volume-reimaged-a2912de2-b649-4082-bc87-4b46b3981cd0 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b94770f5-5958-40fb-835f-0137b906d4fa req-5261d4d5-5947-4b5f-ad44-628d65407691 service nova] Acquiring lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b94770f5-5958-40fb-835f-0137b906d4fa req-5261d4d5-5947-4b5f-ad44-628d65407691 service nova] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b94770f5-5958-40fb-835f-0137b906d4fa req-5261d4d5-5947-4b5f-ad44-628d65407691 service nova] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-b94770f5-5958-40fb-835f-0137b906d4fa req-5261d4d5-5947-4b5f-ad44-628d65407691 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Processing event volume-reimaged-a2912de2-b649-4082-bc87-4b46b3981cd0 {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:59 user nova-compute[74692]: INFO nova.virt.block_device [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Booting with volume a2912de2-b649-4082-bc87-4b46b3981cd0 at /dev/vda
Nov 18 18:30:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-d649cd70-32e9-4ace-804f-bdc9660dd4bc req-3d0b66be-97cc-495c-845b-e019934fb989 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-unplugged-820a0454-d628-4849-956e-e219a7c77f71 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d649cd70-32e9-4ace-804f-bdc9660dd4bc req-3d0b66be-97cc-495c-845b-e019934fb989 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d649cd70-32e9-4ace-804f-bdc9660dd4bc req-3d0b66be-97cc-495c-845b-e019934fb989 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d649cd70-32e9-4ace-804f-bdc9660dd4bc req-3d0b66be-97cc-495c-845b-e019934fb989 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-d649cd70-32e9-4ace-804f-bdc9660dd4bc req-3d0b66be-97cc-495c-845b-e019934fb989 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-unplugged-820a0454-d628-4849-956e-e219a7c77f71 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-d649cd70-32e9-4ace-804f-bdc9660dd4bc req-3d0b66be-97cc-495c-845b-e019934fb989 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-unplugged-820a0454-d628-4849-956e-e219a7c77f71 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG os_brick.utils [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffde5fb9-9414-44e3-bf71-9f3bb4198e6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-3a2fe5b7-4c33-433c-bf34-bb0f30ed8108 req-bd1887b6-654a-46af-8200-adc695f82074 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-unplugged-14e00c18-ad6b-4481-852d-e336bee32648 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3a2fe5b7-4c33-433c-bf34-bb0f30ed8108 req-bd1887b6-654a-46af-8200-adc695f82074 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3a2fe5b7-4c33-433c-bf34-bb0f30ed8108 req-bd1887b6-654a-46af-8200-adc695f82074 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3a2fe5b7-4c33-433c-bf34-bb0f30ed8108 req-bd1887b6-654a-46af-8200-adc695f82074 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-3a2fe5b7-4c33-433c-bf34-bb0f30ed8108 req-bd1887b6-654a-46af-8200-adc695f82074 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-unplugged-14e00c18-ad6b-4481-852d-e336bee32648 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-3a2fe5b7-4c33-433c-bf34-bb0f30ed8108 req-bd1887b6-654a-46af-8200-adc695f82074 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-unplugged-14e00c18-ad6b-4481-852d-e336bee32648 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[66814da8-5876-449d-b5dc-403c1b2c2233]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7e005b-1451-4fa6-b5e6-20ea047ba87b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e5aad9-b5b6-40d3-bd2d-639d53d7b3d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:30:59 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:30:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[89261050-8bca-4fdf-a558-24344bc4386b]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG os_brick.utils [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Updating existing volume attachment record: 27263234-7099-4183-82be-897f4f39a1e6 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:30:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.network.neutron [req-15b2125b-6e72-4b97-8f64-263bc45889d8 req-305f0995-430b-48e6-bc4d-7ca75b3c1bb1 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updated VIF entry in instance network info cache for port a4b46c64-5441-46a3-8da4-529a1d32046e. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.network.neutron [req-15b2125b-6e72-4b97-8f64-263bc45889d8 req-305f0995-430b-48e6-bc4d-7ca75b3c1bb1 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updating instance_info_cache with network_info: [{"id": "a4b46c64-5441-46a3-8da4-529a1d32046e", "address": "fa:16:3e:04:37:ca", "network": {"id": "a4f639ab-5d23-44cf-9586-1df19a47170c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1273332395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b46c64-54", "ovs_interfaceid": "a4b46c64-5441-46a3-8da4-529a1d32046e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd5d1c9a-bf27-47ce-9047-72844816accd", "address": "fa:16:3e:c1:a9:96", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5d1c9a-bf", "ovs_interfaceid": "bd5d1c9a-bf27-47ce-9047-72844816accd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "address": "fa:16:3e:87:4c:60", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2a0340-80", "ovs_interfaceid": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "address": "fa:16:3e:e9:84:44", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd929622-57", "ovs_interfaceid": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11839468-beda-436e-9437-715fdaa17168", "address": "fa:16:3e:94:77:bc", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11839468-be", "ovs_interfaceid": "11839468-beda-436e-9437-715fdaa17168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "address": "fa:16:3e:e4:17:89", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbab20d9-2b", "ovs_interfaceid": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "address": "fa:16:3e:4c:4a:a6", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f12897-9a", "ovs_interfaceid": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-15b2125b-6e72-4b97-8f64-263bc45889d8 req-305f0995-430b-48e6-bc4d-7ca75b3c1bb1 service nova] Releasing lock "refresh_cache-40481706-78c9-402d-9d19-d2d00d812095" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:31:00 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Instance destroyed successfully.
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.objects.instance [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lazy-loading 'resources' on Instance uuid e1603038-3a10-4efb-b5f7-15495ccd3717 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "address": "fa:16:3e:fb:50:e4", "network": {"id": "27774fe7-2099-4253-8194-b6d160291ece", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-210587587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d79063-ef", "ovs_interfaceid": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "address": "fa:16:3e:fb:50:e4", "network": {"id": "27774fe7-2099-4253-8194-b6d160291ece", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-210587587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d79063-ef", "ovs_interfaceid": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:50:e4,bridge_name='br-int',has_traffic_filtering=True,id=d3d79063-efeb-4014-acb1-ddcfc7c57309,network=Network(27774fe7-2099-4253-8194-b6d160291ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d79063-ef') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG os_vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:50:e4,bridge_name='br-int',has_traffic_filtering=True,id=d3d79063-efeb-4014-acb1-ddcfc7c57309,network=Network(27774fe7-2099-4253-8194-b6d160291ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d79063-ef') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3d79063-ef, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-unplugged-d3d79063-efeb-4014-acb1-ddcfc7c57309 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-unplugged-d3d79063-efeb-4014-acb1-ddcfc7c57309 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-unplugged-d3d79063-efeb-4014-acb1-ddcfc7c57309 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-d3d79063-efeb-4014-acb1-ddcfc7c57309 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-d3d79063-efeb-4014-acb1-ddcfc7c57309 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:00 user nova-compute[74692]: WARNING nova.compute.manager [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-d3d79063-efeb-4014-acb1-ddcfc7c57309 for instance with vm_state active and task_state deleting.
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-unplugged-81eda6a3-90f4-42dc-8462-171ec3afbf2f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-unplugged-81eda6a3-90f4-42dc-8462-171ec3afbf2f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-f9faf568-449a-44bc-91f9-a99f5ed4ddb5 req-a0bd953b-4b56-4a6c-9bac-7fa1c20d8e49 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-unplugged-81eda6a3-90f4-42dc-8462-171ec3afbf2f for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=818f926f-294c-49a5-bd4e-dd435ed78b6c) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: INFO os_vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:50:e4,bridge_name='br-int',has_traffic_filtering=True,id=d3d79063-efeb-4014-acb1-ddcfc7c57309,network=Network(27774fe7-2099-4253-8194-b6d160291ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d79063-ef')
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ab:b4,bridge_name='br-int',has_traffic_filtering=True,id=81eda6a3-90f4-42dc-8462-171ec3afbf2f,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81eda6a3-90') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG os_vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ab:b4,bridge_name='br-int',has_traffic_filtering=True,id=81eda6a3-90f4-42dc-8462-171ec3afbf2f,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81eda6a3-90') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81eda6a3-90, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3e4aeeb-3815-4976-bed2-fcdc2bcb850a) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: INFO os_vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ab:b4,bridge_name='br-int',has_traffic_filtering=True,id=81eda6a3-90f4-42dc-8462-171ec3afbf2f,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81eda6a3-90')
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a7:62,bridge_name='br-int',has_traffic_filtering=True,id=a955bfd0-166d-4030-bb78-6402891c7af3,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa955bfd0-16') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG os_vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a7:62,bridge_name='br-int',has_traffic_filtering=True,id=a955bfd0-166d-4030-bb78-6402891c7af3,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa955bfd0-16') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa955bfd0-16, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9246445f-0570-4284-892a-14900fdb7be7) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: INFO os_vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a7:62,bridge_name='br-int',has_traffic_filtering=True,id=a955bfd0-166d-4030-bb78-6402891c7af3,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa955bfd0-16')
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:79:03,bridge_name='br-int',has_traffic_filtering=True,id=820a0454-d628-4849-956e-e219a7c77f71,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820a0454-d6') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG os_vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:79:03,bridge_name='br-int',has_traffic_filtering=True,id=820a0454-d628-4849-956e-e219a7c77f71,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820a0454-d6') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap820a0454-d6, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b1b9476-3aa9-4cff-be44-4a2049f7f635) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: INFO os_vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:79:03,bridge_name='br-int',has_traffic_filtering=True,id=820a0454-d628-4849-956e-e219a7c77f71,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820a0454-d6')
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14e00c18-ad6b-4481-852d-e336bee32648", "address": "fa:16:3e:6a:7c:8a", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e00c18-ad", "ovs_interfaceid": "14e00c18-ad6b-4481-852d-e336bee32648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "14e00c18-ad6b-4481-852d-e336bee32648", "address": "fa:16:3e:6a:7c:8a", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e00c18-ad", "ovs_interfaceid": "14e00c18-ad6b-4481-852d-e336bee32648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7c:8a,bridge_name='br-int',has_traffic_filtering=True,id=14e00c18-ad6b-4481-852d-e336bee32648,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e00c18-ad') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7c:8a,bridge_name='br-int',has_traffic_filtering=True,id=14e00c18-ad6b-4481-852d-e336bee32648,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e00c18-ad') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14e00c18-ad, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7767406-5dfa-42a8-a9e8-08d96c55abee) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: INFO os_vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7c:8a,bridge_name='br-int',has_traffic_filtering=True,id=14e00c18-ad6b-4481-852d-e336bee32648,network=Network(42e84e21-a31a-4c5b-a4c0-4ffdf19a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e00c18-ad')
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "address": "fa:16:3e:2f:01:4c", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26cb4ab6-5d", "ovs_interfaceid": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "address": "fa:16:3e:2f:01:4c", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26cb4ab6-5d", "ovs_interfaceid": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:01:4c,bridge_name='br-int',has_traffic_filtering=True,id=26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe,network=Network(404ec382-2e6d-4924-bf12-3e796e02e1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26cb4ab6-5d') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:01:4c,bridge_name='br-int',has_traffic_filtering=True,id=26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe,network=Network(404ec382-2e6d-4924-bf12-3e796e02e1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26cb4ab6-5d') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26cb4ab6-5d, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db77f127-ba2a-4a23-8b16-063287d6d749) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: INFO os_vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:01:4c,bridge_name='br-int',has_traffic_filtering=True,id=26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe,network=Network(404ec382-2e6d-4924-bf12-3e796e02e1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26cb4ab6-5d')
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448869874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448869874',id=9,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyCGnTxDYF2iN1rINM9eE7nCqZnARXZptHlBcs+PfZtEbtbS5aU+8ea+9iwOcw9TE3IIKZNMCnPc8/URdOTxCGe9XRUBH+7zWby88HnEbsXEjUt60wk3CUkeE1CzB20AA==',key_name='tempest-keypair-1144501646',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e3d9f86d2ba49ecbb73e8128900d73b',ramdisk_id='',reservation_id='r-zkqw60se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1827349967',owner_user_name='tempest-TaggedBootDevicesTest-1827349967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68365438753241d3964290162350e225',uuid=e1603038-3a10-4efb-b5f7-15495ccd3717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "050fa40f-fc29-49bd-b29d-c7954818aa63", "address": "fa:16:3e:32:3f:b3", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050fa40f-fc", "ovs_interfaceid": "050fa40f-fc29-49bd-b29d-c7954818aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converting VIF {"id": "050fa40f-fc29-49bd-b29d-c7954818aa63", "address": "fa:16:3e:32:3f:b3", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050fa40f-fc", "ovs_interfaceid": "050fa40f-fc29-49bd-b29d-c7954818aa63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:3f:b3,bridge_name='br-int',has_traffic_filtering=True,id=050fa40f-fc29-49bd-b29d-c7954818aa63,network=Network(404ec382-2e6d-4924-bf12-3e796e02e1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap050fa40f-fc') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:3f:b3,bridge_name='br-int',has_traffic_filtering=True,id=050fa40f-fc29-49bd-b29d-c7954818aa63,network=Network(404ec382-2e6d-4924-bf12-3e796e02e1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap050fa40f-fc') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap050fa40f-fc, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1eda4a44-cb06-4dee-80a2-43e85539b055) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:01 user nova-compute[74692]: INFO os_vif [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:3f:b3,bridge_name='br-int',has_traffic_filtering=True,id=050fa40f-fc29-49bd-b29d-c7954818aa63,network=Network(404ec382-2e6d-4924-bf12-3e796e02e1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap050fa40f-fc')
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYKWNbIB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:31:01 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4783638-938e-4a09-bc36-00df31b47ce8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:31:01 user nova-compute[74692]: No targets found.
Nov 18 18:31:01 user nova-compute[74692]: iSNS:
Nov 18 18:31:01 user nova-compute[74692]: No targets found.
Nov 18 18:31:01 user nova-compute[74692]: STATIC:
Nov 18 18:31:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf
Nov 18 18:31:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a
Nov 18 18:31:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16
Nov 18 18:31:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87
Nov 18 18:31:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860
Nov 18 18:31:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7
Nov 18 18:31:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:31:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898
Nov 18 18:31:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6
Nov 18 18:31:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e
Nov 18 18:31:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593
Nov 18 18:31:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:01 user nova-compute[74692]: FIRMWARE:
Nov 18 18:31:01 user nova-compute[74692]: No targets found.
Nov 18 18:31:01 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:31:01 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:31:01 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[14079fae-26c9-41ec-9744-74625d789104]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[df05fd05-3db3-4601-842c-4f5113283619]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:01 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:01 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a452beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e'): ({'sdc'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Removing single pathed devices sdc {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a6e3e4-88af-4e59-98cd-28841727d481]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[652f5a84-6f0f-43f7-8692-211146570d5e]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Flushing IO for device /dev/sdc {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1f05b8-27f8-44aa-b4c7-d8e5b2144d78]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64feac0-fdcb-401e-b650-06c97ad62a2e]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-820a0454-d628-4849-956e-e219a7c77f71 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-820a0454-d628-4849-956e-e219a7c77f71 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:01 user nova-compute[74692]: WARNING nova.compute.manager [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-820a0454-d628-4849-956e-e219a7c77f71 for instance with vm_state active and task_state deleting.
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-unplugged-050fa40f-fc29-49bd-b29d-c7954818aa63 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-unplugged-050fa40f-fc29-49bd-b29d-c7954818aa63 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-unplugged-050fa40f-fc29-49bd-b29d-c7954818aa63 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-050fa40f-fc29-49bd-b29d-c7954818aa63 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-050fa40f-fc29-49bd-b29d-c7954818aa63 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:01 user nova-compute[74692]: WARNING nova.compute.manager [req-588b6e30-02dd-4ad0-b526-e0b12054882d req-e5133632-662e-4985-bfb0-ebc84647d7fd service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-050fa40f-fc29-49bd-b29d-c7954818aa63 for instance with vm_state active and task_state deleting.
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff432ea-4736-4c4a-baf7-ceabc238a235]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-e86cd170-3bbe-429f-a134-bac82df1eafa req-500db3db-0e76-4fd0-be18-7905741b906b service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-14e00c18-ad6b-4481-852d-e336bee32648 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e86cd170-3bbe-429f-a134-bac82df1eafa req-500db3db-0e76-4fd0-be18-7905741b906b service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e86cd170-3bbe-429f-a134-bac82df1eafa req-500db3db-0e76-4fd0-be18-7905741b906b service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e86cd170-3bbe-429f-a134-bac82df1eafa req-500db3db-0e76-4fd0-be18-7905741b906b service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-e86cd170-3bbe-429f-a134-bac82df1eafa req-500db3db-0e76-4fd0-be18-7905741b906b service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-14e00c18-ad6b-4481-852d-e336bee32648 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:01 user nova-compute[74692]: WARNING nova.compute.manager [req-e86cd170-3bbe-429f-a134-bac82df1eafa req-500db3db-0e76-4fd0-be18-7905741b906b service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-14e00c18-ad6b-4481-852d-e336bee32648 for instance with vm_state active and task_state deleting.
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[154b6b7c-0428-4475-8fe3-67a0fc0a212a]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e, portal: 172.16.0.220,3260]
Nov 18 18:31:01 user nova-compute[74692]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e, portal: 172.16.0.220,3260] successful.
Nov 18 18:31:01 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkNgoGnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd17447e1-2e91-4d25-bf3a-3705927ec122', 'attached_at': '', 'detached_at': '', 'volume_id': '8273228d-7d9f-4179-a45f-4eb6e5b5880b', 'serial': '8273228d-7d9f-4179-a45f-4eb6e5b5880b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjoDlnut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '3d151d79-2775-4092-9852-83e8cf4eaee7'}, 'status': 'reserved', 'instance': 'd17447e1-2e91-4d25-bf3a-3705927ec122', 'attached_at': '', 'detached_at': '', 'volume_id': '3d151d79-2775-4092-9852-83e8cf4eaee7', 'serial'} {{(pid=74692) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkNgoGnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:31:01 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8ee283-42a6-4087-b21b-7a12bcd8687e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c6a866-cef6-4705-9d6e-d1ecc950ae20]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] <== disconnect_volume: return (423ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:01 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:01 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjIXCMAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:31:01 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7f8195-0c93-4927-9361-35eff0177083]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:31:01 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bf299d-d70a-4300-b251-7095f6891cc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b] added
Nov 18 18:31:01 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26ec711-b0ae-411d-9559-400dd59f2090]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.146s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[44deab23-00b7-422a-898e-3685e3fe9438]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkNgoGnR {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkNgoGnR" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b78561d-78e1-441e-b56e-0de3d5ef208f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vkNgoGnR'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[576aef32-5df3-4b86-8f12-da215eea35dc]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3791112c-cd5f-48cc-87ad-22365fad99bd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[044d3f24-09a9-4818-9433-46d1d095510a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260]
Nov 18 18:31:02 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260] successful.
Nov 18 18:31:02 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.065s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3664c81-a2b7-4602-8417-67bf5b0de1d7]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5625a408-f6bb-4403-9f83-a04c1bc16000]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:02 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:02 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.622s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb8c79b-1a64-4a7e-af50-00a32833b595]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkNgoGnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:31:02 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1 is timed out.
Nov 18 18:31:02 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Successfully detached device sdc from instance 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1 from the live domain config.
Nov 18 18:31:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NpkJeGAm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:31:02 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:31:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "40481706-78c9-402d-9d19-d2d00d812095" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:02 user nova-compute[74692]: INFO nova.compute.manager [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Terminating instance
Nov 18 18:31:02 user nova-compute[74692]: DEBUG nova.compute.manager [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-81eda6a3-90f4-42dc-8462-171ec3afbf2f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-81eda6a3-90f4-42dc-8462-171ec3afbf2f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:02 user nova-compute[74692]: WARNING nova.compute.manager [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-81eda6a3-90f4-42dc-8462-171ec3afbf2f for instance with vm_state active and task_state deleting.
Nov 18 18:31:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-unplugged-a955bfd0-166d-4030-bb78-6402891c7af3 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-unplugged-a955bfd0-166d-4030-bb78-6402891c7af3 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-unplugged-a955bfd0-166d-4030-bb78-6402891c7af3 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-a955bfd0-166d-4030-bb78-6402891c7af3 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-a955bfd0-166d-4030-bb78-6402891c7af3 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:02 user nova-compute[74692]: WARNING nova.compute.manager [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-a955bfd0-166d-4030-bb78-6402891c7af3 for instance with vm_state active and task_state deleting.
Nov 18 18:31:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-unplugged-26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-unplugged-26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-unplugged-26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-plugged-26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] Acquiring lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] No waiting events found dispatching network-vif-plugged-26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:02 user nova-compute[74692]: WARNING nova.compute.manager [req-b1e98f14-7b74-46cf-8916-c0f5d5a042a2 req-196ad999-82c3-4fc5-b761-e789088f5e4a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received unexpected event network-vif-plugged-26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe for instance with vm_state active and task_state deleting.
Nov 18 18:31:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:31:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.670s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] <== connect_volume: return (1676ms) {'type': 'block', 'scsi_wwn': '26334386165616666', 'path': '/dev/sdc'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334386165616666', 'path': '/dev/sdc'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.666s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lazy-loading 'flavor' on Instance uuid d17447e1-2e91-4d25-bf3a-3705927ec122 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[20daf5a6-9f58-42df-ae57-81c2d3db1b1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:31:03 user nova-compute[74692]: No targets found.
Nov 18 18:31:03 user nova-compute[74692]: iSNS:
Nov 18 18:31:03 user nova-compute[74692]: No targets found.
Nov 18 18:31:03 user nova-compute[74692]: STATIC:
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: FIRMWARE:
Nov 18 18:31:03 user nova-compute[74692]: No targets found.
Nov 18 18:31:03 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:31:03 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:31:03 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4077fe2-d77d-48ef-b024-0005e1c25e17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc869de-afe4-41db-8d86-96bb421043ab]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c43cdfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf'): ({'sdd'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Removing single pathed devices sdd {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fc5d0a-256b-472b-a82e-cc1bbd2f11b5]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b69748-5154-4c99-9cb4-7547863f4770]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Flushing IO for device /dev/sdd {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9f377b-ddd9-455b-8cc2-8d30f9b9a66a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.071s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dba8209-4c01-4a80-8844-2272039e7be7]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ab86b882-d0ce-438f-95b8-38c82355e26c req-8d8dab12-7720-4eb9-b28f-76a0e8d41d1a service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-unplugged-8c2a0340-808f-4987-a0dd-38d3d9548b4d {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ab86b882-d0ce-438f-95b8-38c82355e26c req-8d8dab12-7720-4eb9-b28f-76a0e8d41d1a service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ab86b882-d0ce-438f-95b8-38c82355e26c req-8d8dab12-7720-4eb9-b28f-76a0e8d41d1a service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ab86b882-d0ce-438f-95b8-38c82355e26c req-8d8dab12-7720-4eb9-b28f-76a0e8d41d1a service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ab86b882-d0ce-438f-95b8-38c82355e26c req-8d8dab12-7720-4eb9-b28f-76a0e8d41d1a service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-unplugged-8c2a0340-808f-4987-a0dd-38d3d9548b4d {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ab86b882-d0ce-438f-95b8-38c82355e26c req-8d8dab12-7720-4eb9-b28f-76a0e8d41d1a service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-unplugged-8c2a0340-808f-4987-a0dd-38d3d9548b4d for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ab86b882-d0ce-438f-95b8-38c82355e26c req-8d8dab12-7720-4eb9-b28f-76a0e8d41d1a service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-8c2a0340-808f-4987-a0dd-38d3d9548b4d {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ab86b882-d0ce-438f-95b8-38c82355e26c req-8d8dab12-7720-4eb9-b28f-76a0e8d41d1a service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ab86b882-d0ce-438f-95b8-38c82355e26c req-8d8dab12-7720-4eb9-b28f-76a0e8d41d1a service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ab86b882-d0ce-438f-95b8-38c82355e26c req-8d8dab12-7720-4eb9-b28f-76a0e8d41d1a service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ab86b882-d0ce-438f-95b8-38c82355e26c req-8d8dab12-7720-4eb9-b28f-76a0e8d41d1a service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-8c2a0340-808f-4987-a0dd-38d3d9548b4d {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:03 user nova-compute[74692]: WARNING nova.compute.manager [req-ab86b882-d0ce-438f-95b8-38c82355e26c req-8d8dab12-7720-4eb9-b28f-76a0e8d41d1a service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-8c2a0340-808f-4987-a0dd-38d3d9548b4d for instance with vm_state active and task_state deleting.
Nov 18 18:31:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-8160f3ac-d008-40c1-aa71-26bcc1efcba4 req-0c86a558-0324-4e69-963b-4db0cdb77f48 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-unplugged-11839468-beda-436e-9437-715fdaa17168 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8160f3ac-d008-40c1-aa71-26bcc1efcba4 req-0c86a558-0324-4e69-963b-4db0cdb77f48 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8160f3ac-d008-40c1-aa71-26bcc1efcba4 req-0c86a558-0324-4e69-963b-4db0cdb77f48 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8160f3ac-d008-40c1-aa71-26bcc1efcba4 req-0c86a558-0324-4e69-963b-4db0cdb77f48 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-8160f3ac-d008-40c1-aa71-26bcc1efcba4 req-0c86a558-0324-4e69-963b-4db0cdb77f48 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-unplugged-11839468-beda-436e-9437-715fdaa17168 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-8160f3ac-d008-40c1-aa71-26bcc1efcba4 req-0c86a558-0324-4e69-963b-4db0cdb77f48 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-unplugged-11839468-beda-436e-9437-715fdaa17168 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f8f03e-3ddb-4139-b0e7-de4aefdc0981]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f649f70-5629-4d3c-9ef6-b1915d9bfa47]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf, portal: 172.16.0.220,3260]
Nov 18 18:31:03 user nova-compute[74692]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf, portal: 172.16.0.220,3260] successful.
Nov 18 18:31:03 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c77d7f8c-d05c-45f4-b339-5f63fe0064cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee4c1ca-d007-4619-afbb-f021efe4723d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] <== disconnect_volume: return (2121ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.306s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyNpVbYx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:31:03 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.042s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cffcaa-8210-4267-9b36-6616ca29a7a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:31:03 user nova-compute[74692]: No targets found.
Nov 18 18:31:03 user nova-compute[74692]: iSNS:
Nov 18 18:31:03 user nova-compute[74692]: No targets found.
Nov 18 18:31:03 user nova-compute[74692]: STATIC:
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593
Nov 18 18:31:03 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:03 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:03 user nova-compute[74692]: FIRMWARE:
Nov 18 18:31:03 user nova-compute[74692]: No targets found.
Nov 18 18:31:03 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:31:03 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:31:03 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f392453-dc19-4c49-b43e-e42d6d68c37b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e44887a-938c-48a2-b37b-347a51ba5d76]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:03 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:03 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a46afd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6'): ({'sdk'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Removing single pathed devices sdk {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:03 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c is timed out.
Nov 18 18:31:03 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Successfully detached device vdb from instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c from the live domain config.
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a166fae7-e6b7-4eab-99fb-987a51109b40]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqmKEYkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:31:03 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3aa148-325c-4ad0-b9dc-8d78e1bee414]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Flushing IO for device /dev/sdk {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67dbb72-d02d-4237-bec2-c307e9b53f43]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:31:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.056s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0db23e8-14e2-493c-8769-37364dd43fd2]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] SCSI volumes sdk have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66afdb2-5b22-4626-8ab4-5de3f9a4b836]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.108s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[921d7e93-9c3a-49c2-b270-fc3411545af8]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6, portal: 172.16.0.220,3260]
Nov 18 18:31:04 user nova-compute[74692]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6, portal: 172.16.0.220,3260] successful.
Nov 18 18:31:04 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423cafd1-5747-4e8b-b3ed-8ad15d6d3cc6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.061s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[76576241-c871-4400-b5e6-9b26fd8b24e1]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.516s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] <== disconnect_volume: return (1823ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.517s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.055s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[932435da-418d-4038-bb32-720b0c3ee6b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:31:04 user nova-compute[74692]: No targets found.
Nov 18 18:31:04 user nova-compute[74692]: iSNS:
Nov 18 18:31:04 user nova-compute[74692]: No targets found.
Nov 18 18:31:04 user nova-compute[74692]: STATIC:
Nov 18 18:31:04 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a
Nov 18 18:31:04 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:04 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:04 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16
Nov 18 18:31:04 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:04 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:04 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87
Nov 18 18:31:04 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:04 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:04 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860
Nov 18 18:31:04 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:04 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:04 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b
Nov 18 18:31:04 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:04 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:04 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7
Nov 18 18:31:04 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:04 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:04 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:31:04 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:04 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:04 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898
Nov 18 18:31:04 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:04 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:04 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593
Nov 18 18:31:04 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:04 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:04 user nova-compute[74692]: FIRMWARE:
Nov 18 18:31:04 user nova-compute[74692]: No targets found.
Nov 18 18:31:04 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:31:04 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:31:04 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 135266304 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.052s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9859825-513f-44e8-b1b0-e76e119e52af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e411d0-0ead-4a0a-8af1-050ead50553c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:04 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:04 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:04 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a450c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87'): ({'sdf'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Removing single pathed devices sdf {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.048s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53457e6-63d1-4cf8-89a5-bd823266f6d0]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.061s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf83898-7caf-446a-b69d-e3a2b5938ac7]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Flushing IO for device /dev/sdf {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b25b23-beba-4627-8b6c-618d6b8d8952]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Instance destroyed successfully.
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.objects.instance [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lazy-loading 'resources' on Instance uuid 40481706-78c9-402d-9d19-d2d00d812095 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4b46c64-5441-46a3-8da4-529a1d32046e", "address": "fa:16:3e:04:37:ca", "network": {"id": "a4f639ab-5d23-44cf-9586-1df19a47170c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1273332395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b46c64-54", "ovs_interfaceid": "a4b46c64-5441-46a3-8da4-529a1d32046e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "a4b46c64-5441-46a3-8da4-529a1d32046e", "address": "fa:16:3e:04:37:ca", "network": {"id": "a4f639ab-5d23-44cf-9586-1df19a47170c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1273332395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b46c64-54", "ovs_interfaceid": "a4b46c64-5441-46a3-8da4-529a1d32046e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:37:ca,bridge_name='br-int',has_traffic_filtering=True,id=a4b46c64-5441-46a3-8da4-529a1d32046e,network=Network(a4f639ab-5d23-44cf-9586-1df19a47170c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4b46c64-54') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:37:ca,bridge_name='br-int',has_traffic_filtering=True,id=a4b46c64-5441-46a3-8da4-529a1d32046e,network=Network(a4f639ab-5d23-44cf-9586-1df19a47170c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4b46c64-54') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4b46c64-54, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.072s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1924849c-9bb3-442d-b9d3-0b32b58e3cf7]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] SCSI volumes sdf have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8174f08d-c293e6b0103aa6ca', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8174f08d', '/dev/disk/by-id/scsi-26332393365366230') {{(pid=84932) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[26264179-1188-49cf-bdde-81c0de37ac1e]: (4, None) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70a1e4e-a9f5-42e5-8e72-56627b0ee419]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c133c476-84a1-4318-8a65-0e1ab036284f) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-unplugged-a4b46c64-5441-46a3-8da4-529a1d32046e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-unplugged-a4b46c64-5441-46a3-8da4-529a1d32046e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-unplugged-a4b46c64-5441-46a3-8da4-529a1d32046e for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-a4b46c64-5441-46a3-8da4-529a1d32046e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-a4b46c64-5441-46a3-8da4-529a1d32046e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:04 user nova-compute[74692]: WARNING nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-a4b46c64-5441-46a3-8da4-529a1d32046e for instance with vm_state active and task_state deleting.
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-unplugged-bd5d1c9a-bf27-47ce-9047-72844816accd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-unplugged-bd5d1c9a-bf27-47ce-9047-72844816accd {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-unplugged-bd5d1c9a-bf27-47ce-9047-72844816accd for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-bd5d1c9a-bf27-47ce-9047-72844816accd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-bd5d1c9a-bf27-47ce-9047-72844816accd {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:04 user nova-compute[74692]: WARNING nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-bd5d1c9a-bf27-47ce-9047-72844816accd for instance with vm_state active and task_state deleting.
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-unplugged-dd929622-57d9-4e8c-9012-6340cc9d39ff {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-unplugged-dd929622-57d9-4e8c-9012-6340cc9d39ff {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-unplugged-dd929622-57d9-4e8c-9012-6340cc9d39ff for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-dd929622-57d9-4e8c-9012-6340cc9d39ff {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-dd929622-57d9-4e8c-9012-6340cc9d39ff {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:04 user nova-compute[74692]: WARNING nova.compute.manager [req-7ad320e8-8c8e-487e-a375-0f4706aa0bec req-8c79e35b-3186-4517-92c6-b73b7a582669 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-dd929622-57d9-4e8c-9012-6340cc9d39ff for instance with vm_state active and task_state deleting.
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 277872640 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.116s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[524d5c98-eb66-4d17-9853-10a71bdc592e]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87, portal: 172.16.0.220,3260]
Nov 18 18:31:04 user nova-compute[74692]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87, portal: 172.16.0.220,3260] successful.
Nov 18 18:31:04 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:04 user nova-compute[74692]: INFO os_vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:37:ca,bridge_name='br-int',has_traffic_filtering=True,id=a4b46c64-5441-46a3-8da4-529a1d32046e,network=Network(a4f639ab-5d23-44cf-9586-1df19a47170c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4b46c64-54')
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd5d1c9a-bf27-47ce-9047-72844816accd", "address": "fa:16:3e:c1:a9:96", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5d1c9a-bf", "ovs_interfaceid": "bd5d1c9a-bf27-47ce-9047-72844816accd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "bd5d1c9a-bf27-47ce-9047-72844816accd", "address": "fa:16:3e:c1:a9:96", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5d1c9a-bf", "ovs_interfaceid": "bd5d1c9a-bf27-47ce-9047-72844816accd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a9:96,bridge_name='br-int',has_traffic_filtering=True,id=bd5d1c9a-bf27-47ce-9047-72844816accd,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd5d1c9a-bf') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a9:96,bridge_name='br-int',has_traffic_filtering=True,id=bd5d1c9a-bf27-47ce-9047-72844816accd,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd5d1c9a-bf') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd5d1c9a-bf, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a4a768-c177-444c-bed8-eaa5a3fa1f87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d975ef1-bbc3-421b-bc06-8a34a29cccae]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.708s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] <== disconnect_volume: return (1225ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:31:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Deleting instance files /opt/stack/data/nova/instances/e1603038-3a10-4efb-b5f7-15495ccd3717_del
Nov 18 18:31:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Deletion of /opt/stack/data/nova/instances/e1603038-3a10-4efb-b5f7-15495ccd3717_del complete
Nov 18 18:31:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.065s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd2421d1-4930-499a-aee3-b43248cd926f) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1467fc28-dd8a-4ef0-b5e3-d4c1e2ba6d55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:31:05 user nova-compute[74692]: No targets found.
Nov 18 18:31:05 user nova-compute[74692]: iSNS:
Nov 18 18:31:05 user nova-compute[74692]: No targets found.
Nov 18 18:31:05 user nova-compute[74692]: STATIC:
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: FIRMWARE:
Nov 18 18:31:05 user nova-compute[74692]: No targets found.
Nov 18 18:31:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:31:05 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:31:05 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2b6a58-3e04-468b-b95b-14b8b1b472fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: INFO os_vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a9:96,bridge_name='br-int',has_traffic_filtering=True,id=bd5d1c9a-bf27-47ce-9047-72844816accd,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd5d1c9a-bf')
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "address": "fa:16:3e:87:4c:60", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2a0340-80", "ovs_interfaceid": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "address": "fa:16:3e:87:4c:60", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2a0340-80", "ovs_interfaceid": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4c:60,bridge_name='br-int',has_traffic_filtering=True,id=8c2a0340-808f-4987-a0dd-38d3d9548b4d,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c2a0340-80') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4c:60,bridge_name='br-int',has_traffic_filtering=True,id=8c2a0340-808f-4987-a0dd-38d3d9548b4d,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c2a0340-80') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c2a0340-80, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb69daf1-7443-42f5-8b40-cb7a953080ec]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41d5a3f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f327fef-ca22-494a-bf89-802130f7bb8f]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=265ba0c3-e85c-4842-a48a-9a3f306e9d4b) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[76423e91-f2e8-40ed-a3ae-fa72f4515a44]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:31:05 user nova-compute[74692]: INFO nova.compute.manager [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Took 6.62 seconds to destroy the instance on the hypervisor.
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[67847e56-7084-4671-8383-cdc90498f165]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:31:05 user nova-compute[74692]: INFO os_vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4c:60,bridge_name='br-int',has_traffic_filtering=True,id=8c2a0340-808f-4987-a0dd-38d3d9548b4d,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c2a0340-80')
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "address": "fa:16:3e:e9:84:44", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd929622-57", "ovs_interfaceid": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "address": "fa:16:3e:e9:84:44", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd929622-57", "ovs_interfaceid": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:84:44,bridge_name='br-int',has_traffic_filtering=True,id=dd929622-57d9-4e8c-9012-6340cc9d39ff,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd929622-57') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:84:44,bridge_name='br-int',has_traffic_filtering=True,id=dd929622-57d9-4e8c-9012-6340cc9d39ff,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd929622-57') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd929622-57, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11e513cd-0d09-4925-91f1-7b59a15e9902) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4b5c80-cefe-4f1d-8992-b8f6b6bd30c2]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5356df80-8c7f-41cf-a568-8befbc3b8000]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:05 user nova-compute[74692]: INFO os_vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:84:44,bridge_name='br-int',has_traffic_filtering=True,id=dd929622-57d9-4e8c-9012-6340cc9d39ff,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd929622-57')
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11839468-beda-436e-9437-715fdaa17168", "address": "fa:16:3e:94:77:bc", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11839468-be", "ovs_interfaceid": "11839468-beda-436e-9437-715fdaa17168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "11839468-beda-436e-9437-715fdaa17168", "address": "fa:16:3e:94:77:bc", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11839468-be", "ovs_interfaceid": "11839468-beda-436e-9437-715fdaa17168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:77:bc,bridge_name='br-int',has_traffic_filtering=True,id=11839468-beda-436e-9437-715fdaa17168,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11839468-be') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:77:bc,bridge_name='br-int',has_traffic_filtering=True,id=11839468-beda-436e-9437-715fdaa17168,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11839468-be') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11839468-be, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e02c1e28-091b-48a3-85e0-ab0f94fa0d43) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 389021696 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: INFO os_vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:77:bc,bridge_name='br-int',has_traffic_filtering=True,id=11839468-beda-436e-9437-715fdaa17168,network=Network(99572303-6b8f-4c79-a2d3-5c1322737bb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11839468-be')
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "address": "fa:16:3e:e4:17:89", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbab20d9-2b", "ovs_interfaceid": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "address": "fa:16:3e:e4:17:89", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbab20d9-2b", "ovs_interfaceid": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:17:89,bridge_name='br-int',has_traffic_filtering=True,id=dbab20d9-2bd4-480c-a971-c213fcfa03a8,network=Network(ee3f23fa-6cfb-4de2-a59a-3aa7e9501194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbab20d9-2b') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:17:89,bridge_name='br-int',has_traffic_filtering=True,id=dbab20d9-2bd4-480c-a971-c213fcfa03a8,network=Network(ee3f23fa-6cfb-4de2-a59a-3aa7e9501194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbab20d9-2b') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbab20d9-2b, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d959ab8-74db-4686-93fe-16b31df609d7]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860, portal: 172.16.0.220,3260]
Nov 18 18:31:05 user nova-compute[74692]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860, portal: 172.16.0.220,3260] successful.
Nov 18 18:31:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26548baf-0ff2-4ea0-b14f-34028fe02e47) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: INFO os_vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:17:89,bridge_name='br-int',has_traffic_filtering=True,id=dbab20d9-2bd4-480c-a971-c213fcfa03a8,network=Network(ee3f23fa-6cfb-4de2-a59a-3aa7e9501194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbab20d9-2b')
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1827640560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1827640560',id=10,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzprEfvdPHRf0xJLeMwCr8EeqwtVx+Wq8nQCzH1l5qYiIpdZZlB6ZF72WSKZNHzrSprtGZkLgoJrzeXdzMrTix9PYENRbL89MHpw0BzIWPl4soGizG58504jPjI95cgVg==',key_name='tempest-keypair-402861437',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a88be034ffb4322ad1a9d2aebef7e59',ramdisk_id='',reservation_id='r-zo2cp8ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-158402548',owner_user_name='tempest-TaggedBootDevicesTest_v242-158402548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc7bea88537f498f9a57f044cdede728',uuid=40481706-78c9-402d-9d19-d2d00d812095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "address": "fa:16:3e:4c:4a:a6", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f12897-9a", "ovs_interfaceid": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converting VIF {"id": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "address": "fa:16:3e:4c:4a:a6", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f12897-9a", "ovs_interfaceid": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:4a:a6,bridge_name='br-int',has_traffic_filtering=True,id=15f12897-9a5b-4c7a-b80e-4889ce96f780,network=Network(ee3f23fa-6cfb-4de2-a59a-3aa7e9501194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f12897-9a') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:4a:a6,bridge_name='br-int',has_traffic_filtering=True,id=15f12897-9a5b-4c7a-b80e-4889ce96f780,network=Network(ee3f23fa-6cfb-4de2-a59a-3aa7e9501194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f12897-9a') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5a57ce-001e-487a-83d3-1265fb253860 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a4d346-72db-4adc-b2cb-09fa563d03bb]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.487s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] <== disconnect_volume: return (1551ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15f12897-9a, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2022d968-8275-4321-a033-06708d81c3cc) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:05 user nova-compute[74692]: INFO os_vif [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:4a:a6,bridge_name='br-int',has_traffic_filtering=True,id=15f12897-9a5b-4c7a-b80e-4889ce96f780,network=Network(ee3f23fa-6cfb-4de2-a59a-3aa7e9501194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f12897-9a')
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZOkQCzN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:31:05 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a236a5-79a1-49a2-9f97-9d07d9ed9dba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:31:05 user nova-compute[74692]: No targets found.
Nov 18 18:31:05 user nova-compute[74692]: iSNS:
Nov 18 18:31:05 user nova-compute[74692]: No targets found.
Nov 18 18:31:05 user nova-compute[74692]: STATIC:
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: FIRMWARE:
Nov 18 18:31:05 user nova-compute[74692]: No targets found.
Nov 18 18:31:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:31:05 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:31:05 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6134759b-a58b-45cf-ab25-f3002535f264]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9726ad4-30a8-4932-a5ac-de7b38e3a409]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:05 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c4621090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593'): ({'sde'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Removing single pathed devices sde {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-11839468-beda-436e-9437-715fdaa17168 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-11839468-beda-436e-9437-715fdaa17168 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:05 user nova-compute[74692]: WARNING nova.compute.manager [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-11839468-beda-436e-9437-715fdaa17168 for instance with vm_state active and task_state deleting.
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-unplugged-dbab20d9-2bd4-480c-a971-c213fcfa03a8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-unplugged-dbab20d9-2bd4-480c-a971-c213fcfa03a8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-unplugged-dbab20d9-2bd4-480c-a971-c213fcfa03a8 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-dbab20d9-2bd4-480c-a971-c213fcfa03a8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-dbab20d9-2bd4-480c-a971-c213fcfa03a8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:05 user nova-compute[74692]: WARNING nova.compute.manager [req-7d6f7922-6ebe-4cda-96a6-f3eabc994588 req-70272548-96a1-47e3-a5e2-e25f2012841f service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-dbab20d9-2bd4-480c-a971-c213fcfa03a8 for instance with vm_state active and task_state deleting.
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1d3a04-33f5-4692-bff3-e587a92d6a67]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d974c1ce-87d2-4326-b280-136e63467d0a]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Flushing IO for device /dev/sde {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d372a9-219d-40ad-afcf-9407f17a77f6]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23321b4-bb4b-4ae4-9633-26b25a6cbd07]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] SCSI volumes sde have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3300735e-16b1-4126-9e2b-49063ef9107c]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 512753664 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4b3d61-4ec9-4d8d-b3ad-57b630cdd099]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593, portal: 172.16.0.220,3260]
Nov 18 18:31:05 user nova-compute[74692]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593, portal: 172.16.0.220,3260] successful.
Nov 18 18:31:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c599e24-bfc8-42cb-8129-6ba1be0c7593 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c4ac6c-4a1c-4376-87f1-3423efed59d5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] <== disconnect_volume: return (446ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLuyjFXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:31:05 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5e9a11-68fb-44ba-9862-f6b18724afb9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:31:05 user nova-compute[74692]: No targets found.
Nov 18 18:31:05 user nova-compute[74692]: iSNS:
Nov 18 18:31:05 user nova-compute[74692]: No targets found.
Nov 18 18:31:05 user nova-compute[74692]: STATIC:
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898
Nov 18 18:31:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:05 user nova-compute[74692]: FIRMWARE:
Nov 18 18:31:05 user nova-compute[74692]: No targets found.
Nov 18 18:31:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:31:05 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:31:05 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:05 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG nova.objects.instance [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lazy-loading 'flavor' on Instance uuid 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[01579ec9-a70f-479e-a033-dd5e884fbd59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[650ef269-4d6c-42d0-9daa-0a6ebdf50543]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a4785cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16'): ({'sdg'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Removing single pathed devices sdg {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-66b16b5a-c5ff-4e30-9ac4-35a74c68dfff tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.161s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c9d821-3b5f-4001-a290-0b83df735625]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.029s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c9cfb2-9cec-4fe2-a44d-743afbfe2d45]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Flushing IO for device /dev/sdg {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[64effe58-8675-42cb-8ea8-761c3df1025f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.062s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f671d0-162d-4f31-942f-f883aa3b9768]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] SCSI volumes sdg have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb00e46d-c808-4323-91da-a12b01365add]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f819d84d-ab20-4c6a-986a-a3fbc975fe37]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16, portal: 172.16.0.220,3260]
Nov 18 18:31:06 user nova-compute[74692]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16, portal: 172.16.0.220,3260] successful.
Nov 18 18:31:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 573571072 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8693b0-604a-41d5-a99a-dca528178e16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd226b72-8935-419e-90d6-2fd2df055ef7]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.496s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] <== disconnect_volume: return (497ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOnIcsPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:31:06 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[301036ef-e3a0-4ec7-9e65-9a32ff98a676]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:31:06 user nova-compute[74692]: No targets found.
Nov 18 18:31:06 user nova-compute[74692]: iSNS:
Nov 18 18:31:06 user nova-compute[74692]: No targets found.
Nov 18 18:31:06 user nova-compute[74692]: STATIC:
Nov 18 18:31:06 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a
Nov 18 18:31:06 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:06 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:06 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b
Nov 18 18:31:06 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:06 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:06 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7
Nov 18 18:31:06 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:06 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:06 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:31:06 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:06 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:06 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898
Nov 18 18:31:06 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:06 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:06 user nova-compute[74692]: FIRMWARE:
Nov 18 18:31:06 user nova-compute[74692]: No targets found.
Nov 18 18:31:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:31:06 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:31:06 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db90089-47dc-44e6-bf86-2fff7aa6b856]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3d6d44-615e-4675-a20e-c994eec9f140]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a (non-flash)
Nov 18 18:31:06 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a46aedd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a'): ({'sdh'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Removing single pathed devices sdh {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ed99c7-e50a-427a-bbec-ce3b811a1870]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8f75c1-71a0-4ad9-a398-1b8f68c01879]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Flushing IO for device /dev/sdh {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5990f123-4cf4-485a-949c-154e72ea73ab]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.036s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0910e4-0f4f-41fd-b419-26d5aa90434f]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] SCSI volumes sdh have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3a70d8-574d-43f9-bc43-a1e1322095d0]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0089d879-9a48-485f-a319-42a232a9aa9d]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a, portal: 172.16.0.220,3260]
Nov 18 18:31:06 user nova-compute[74692]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a, portal: 172.16.0.220,3260] successful.
Nov 18 18:31:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:06 user nova-compute[74692]: INFO nova.compute.manager [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Terminating instance
Nov 18 18:31:06 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909eed5b-357b-447f-8a30-de499ef54b1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1050fcc0-af60-4603-bf65-7afaab331729]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] <== disconnect_volume: return (439ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:31:06 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Deleting instance files /opt/stack/data/nova/instances/40481706-78c9-402d-9d19-d2d00d812095_del
Nov 18 18:31:06 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Deletion of /opt/stack/data/nova/instances/40481706-78c9-402d-9d19-d2d00d812095_del complete
Nov 18 18:31:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 645922816 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG nova.objects.instance [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lazy-loading 'flavor' on Instance uuid 0b9551f1-bc3e-4221-95fc-3b3a4a33251c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-08695f04-37ce-4999-8f08-ceb336aeef36 req-dc4c0669-ab9a-4027-8bab-31461e4df9bf service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-unplugged-15f12897-9a5b-4c7a-b80e-4889ce96f780 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-08695f04-37ce-4999-8f08-ceb336aeef36 req-dc4c0669-ab9a-4027-8bab-31461e4df9bf service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-08695f04-37ce-4999-8f08-ceb336aeef36 req-dc4c0669-ab9a-4027-8bab-31461e4df9bf service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-08695f04-37ce-4999-8f08-ceb336aeef36 req-dc4c0669-ab9a-4027-8bab-31461e4df9bf service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-08695f04-37ce-4999-8f08-ceb336aeef36 req-dc4c0669-ab9a-4027-8bab-31461e4df9bf service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-unplugged-15f12897-9a5b-4c7a-b80e-4889ce96f780 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-08695f04-37ce-4999-8f08-ceb336aeef36 req-dc4c0669-ab9a-4027-8bab-31461e4df9bf service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-unplugged-15f12897-9a5b-4c7a-b80e-4889ce96f780 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-08695f04-37ce-4999-8f08-ceb336aeef36 req-dc4c0669-ab9a-4027-8bab-31461e4df9bf service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-plugged-15f12897-9a5b-4c7a-b80e-4889ce96f780 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-08695f04-37ce-4999-8f08-ceb336aeef36 req-dc4c0669-ab9a-4027-8bab-31461e4df9bf service nova] Acquiring lock "40481706-78c9-402d-9d19-d2d00d812095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-08695f04-37ce-4999-8f08-ceb336aeef36 req-dc4c0669-ab9a-4027-8bab-31461e4df9bf service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-08695f04-37ce-4999-8f08-ceb336aeef36 req-dc4c0669-ab9a-4027-8bab-31461e4df9bf service nova] Lock "40481706-78c9-402d-9d19-d2d00d812095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-08695f04-37ce-4999-8f08-ceb336aeef36 req-dc4c0669-ab9a-4027-8bab-31461e4df9bf service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] No waiting events found dispatching network-vif-plugged-15f12897-9a5b-4c7a-b80e-4889ce96f780 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:06 user nova-compute[74692]: WARNING nova.compute.manager [req-08695f04-37ce-4999-8f08-ceb336aeef36 req-dc4c0669-ab9a-4027-8bab-31461e4df9bf service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received unexpected event network-vif-plugged-15f12897-9a5b-4c7a-b80e-4889ce96f780 for instance with vm_state active and task_state deleting.
Nov 18 18:31:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:07 user nova-compute[74692]: INFO nova.compute.manager [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Took 4.40 seconds to destroy the instance on the hypervisor.
Nov 18 18:31:07 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 40481706-78c9-402d-9d19-d2d00d812095] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-101684c5-7165-48e4-afd5-4b60a40b5df7 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.952s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "interface-0b9551f1-bc3e-4221-95fc-3b3a4a33251c-57868bb5-51e2-4d1f-b04e-6308332991b6" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "interface-0b9551f1-bc3e-4221-95fc-3b3a4a33251c-57868bb5-51e2-4d1f-b04e-6308332991b6" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 761266176 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.objects.instance [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lazy-loading 'flavor' on Instance uuid 0b9551f1-bc3e-4221-95fc-3b3a4a33251c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-796391196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-796391196',id=5,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3gJO/TwdDSf1yN3ZchrXCyXLk6TezdqH7o7X0wfuK4mUN+34DlZO1554usfJkK2dsoaKwNDHuloE+Z5C2eKZ2s7LsvuKmsXer8Y96AOq7N/zPoRVeXal22WhpetQTiRg==',key_name='tempest-keypair-1001776154',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:28:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='722ae3b1a66f46c9a0679d562b22e470',ramdisk_id='',reservation_id='r-j9yyn7m1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1784015919',owner_user_name='tempest-TaggedAttachmentsTest-1784015919-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:28:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39b207b60dbe460f83bf961a995e5342',uuid=0b9551f1-bc3e-4221-95fc-3b3a4a33251c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57868bb5-51e2-4d1f-b04e-6308332991b6", "address": "fa:16:3e:42:b5:34", "network": {"id": "007966f5-554c-4e4a-a409-9aa0d874260b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-279700966", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57868bb5-51", "ovs_interfaceid": "57868bb5-51e2-4d1f-b04e-6308332991b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Converting VIF {"id": "57868bb5-51e2-4d1f-b04e-6308332991b6", "address": "fa:16:3e:42:b5:34", "network": {"id": "007966f5-554c-4e4a-a409-9aa0d874260b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-279700966", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57868bb5-51", "ovs_interfaceid": "57868bb5-51e2-4d1f-b04e-6308332991b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:b5:34,bridge_name='br-int',has_traffic_filtering=True,id=57868bb5-51e2-4d1f-b04e-6308332991b6,network=Network(007966f5-554c-4e4a-a409-9aa0d874260b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57868bb5-51') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:42:b5:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap57868bb5-51"/></interface> {{(pid=74692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:42:b5:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap57868bb5-51"/></interface> {{(pid=74692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Attempting to detach device tap57868bb5-51 from instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] detach device xml: <interface type="ethernet">
Nov 18 18:31:07 user nova-compute[74692]:   <mac address="fa:16:3e:42:b5:34"/>
Nov 18 18:31:07 user nova-compute[74692]:   <model type="virtio"/>
Nov 18 18:31:07 user nova-compute[74692]:   <mtu size="1442"/>
Nov 18 18:31:07 user nova-compute[74692]:   <target dev="tap57868bb5-51"/>
Nov 18 18:31:07 user nova-compute[74692]: </interface>
Nov 18 18:31:07 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:42:b5:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap57868bb5-51"/></interface> {{(pid=74692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:42:b5:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap57868bb5-51"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 18 18:31:07 user nova-compute[74692]:   <name>instance-00000005</name>
Nov 18 18:31:07 user nova-compute[74692]:   <uuid>0b9551f1-bc3e-4221-95fc-3b3a4a33251c</uuid>
Nov 18 18:31:07 user nova-compute[74692]:   <metadata>
Nov 18 18:31:07 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:31:07 user nova-compute[74692]:   <nova:package version="0.0.0"/>
Nov 18 18:31:07 user nova-compute[74692]:   <nova:name>tempest-device-tagging-server-796391196</nova:name>
Nov 18 18:31:07 user nova-compute[74692]:   <nova:creationTime>2023-11-18 18:30:32</nova:creationTime>
Nov 18 18:31:07 user nova-compute[74692]:   <nova:flavor name="m1.tiny">
Nov 18 18:31:07 user nova-compute[74692]:     <nova:memory>512</nova:memory>
Nov 18 18:31:07 user nova-compute[74692]:     <nova:disk>1</nova:disk>
Nov 18 18:31:07 user nova-compute[74692]:     <nova:swap>0</nova:swap>
Nov 18 18:31:07 user nova-compute[74692]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:31:07 user nova-compute[74692]:     <nova:vcpus>1</nova:vcpus>
Nov 18 18:31:07 user nova-compute[74692]:   </nova:flavor>
Nov 18 18:31:07 user nova-compute[74692]:   <nova:owner>
Nov 18 18:31:07 user nova-compute[74692]:     <nova:user uuid="39b207b60dbe460f83bf961a995e5342">tempest-TaggedAttachmentsTest-1784015919-project-member</nova:user>
Nov 18 18:31:07 user nova-compute[74692]:     <nova:project uuid="722ae3b1a66f46c9a0679d562b22e470">tempest-TaggedAttachmentsTest-1784015919</nova:project>
Nov 18 18:31:07 user nova-compute[74692]:   </nova:owner>
Nov 18 18:31:07 user nova-compute[74692]:   <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:31:07 user nova-compute[74692]:   <nova:ports>
Nov 18 18:31:07 user nova-compute[74692]:     <nova:port uuid="9935070a-ab06-4411-afeb-9039ecbea8bc">
Nov 18 18:31:07 user nova-compute[74692]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 18:31:07 user nova-compute[74692]:     </nova:port>
Nov 18 18:31:07 user nova-compute[74692]:     <nova:port uuid="57868bb5-51e2-4d1f-b04e-6308332991b6">
Nov 18 18:31:07 user nova-compute[74692]:       <nova:ip type="fixed" address="10.10.10.100" ipVersion="4"/>
Nov 18 18:31:07 user nova-compute[74692]:     </nova:port>
Nov 18 18:31:07 user nova-compute[74692]:   </nova:ports>
Nov 18 18:31:07 user nova-compute[74692]: </nova:instance>
Nov 18 18:31:07 user nova-compute[74692]:   </metadata>
Nov 18 18:31:07 user nova-compute[74692]:   <memory unit='KiB'>524288</memory>
Nov 18 18:31:07 user nova-compute[74692]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 18 18:31:07 user nova-compute[74692]:   <vcpu placement='static'>1</vcpu>
Nov 18 18:31:07 user nova-compute[74692]:   <resource>
Nov 18 18:31:07 user nova-compute[74692]:     <partition>/machine</partition>
Nov 18 18:31:07 user nova-compute[74692]:   </resource>
Nov 18 18:31:07 user nova-compute[74692]:   <sysinfo type='smbios'>
Nov 18 18:31:07 user nova-compute[74692]:     <system>
Nov 18 18:31:07 user nova-compute[74692]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 18 18:31:07 user nova-compute[74692]:       <entry name='product'>OpenStack Nova</entry>
Nov 18 18:31:07 user nova-compute[74692]:       <entry name='version'>0.0.0</entry>
Nov 18 18:31:07 user nova-compute[74692]:       <entry name='serial'>0b9551f1-bc3e-4221-95fc-3b3a4a33251c</entry>
Nov 18 18:31:07 user nova-compute[74692]:       <entry name='uuid'>0b9551f1-bc3e-4221-95fc-3b3a4a33251c</entry>
Nov 18 18:31:07 user nova-compute[74692]:       <entry name='family'>Virtual Machine</entry>
Nov 18 18:31:07 user nova-compute[74692]:     </system>
Nov 18 18:31:07 user nova-compute[74692]:   </sysinfo>
Nov 18 18:31:07 user nova-compute[74692]:   <os>
Nov 18 18:31:07 user nova-compute[74692]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 18 18:31:07 user nova-compute[74692]:     <boot dev='hd'/>
Nov 18 18:31:07 user nova-compute[74692]:     <smbios mode='sysinfo'/>
Nov 18 18:31:07 user nova-compute[74692]:   </os>
Nov 18 18:31:07 user nova-compute[74692]:   <features>
Nov 18 18:31:07 user nova-compute[74692]:     <acpi/>
Nov 18 18:31:07 user nova-compute[74692]:     <apic/>
Nov 18 18:31:07 user nova-compute[74692]:     <vmcoreinfo state='on'/>
Nov 18 18:31:07 user nova-compute[74692]:   </features>
Nov 18 18:31:07 user nova-compute[74692]:   <cpu mode='custom' match='exact' check='full'>
Nov 18 18:31:07 user nova-compute[74692]:     <model fallback='forbid'>Nehalem</model>
Nov 18 18:31:07 user nova-compute[74692]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 18 18:31:07 user nova-compute[74692]:     <feature policy='require' name='vme'/>
Nov 18 18:31:07 user nova-compute[74692]:     <feature policy='require' name='x2apic'/>
Nov 18 18:31:07 user nova-compute[74692]:     <feature policy='require' name='hypervisor'/>
Nov 18 18:31:07 user nova-compute[74692]:   </cpu>
Nov 18 18:31:07 user nova-compute[74692]:   <clock offset='utc'>
Nov 18 18:31:07 user nova-compute[74692]:     <timer name='pit' tickpolicy='delay'/>
Nov 18 18:31:07 user nova-compute[74692]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 18 18:31:07 user nova-compute[74692]:     <timer name='hpet' present='no'/>
Nov 18 18:31:07 user nova-compute[74692]:   </clock>
Nov 18 18:31:07 user nova-compute[74692]:   <on_poweroff>destroy</on_poweroff>
Nov 18 18:31:07 user nova-compute[74692]:   <on_reboot>restart</on_reboot>
Nov 18 18:31:07 user nova-compute[74692]:   <on_crash>destroy</on_crash>
Nov 18 18:31:07 user nova-compute[74692]:   <devices>
Nov 18 18:31:07 user nova-compute[74692]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 18 18:31:07 user nova-compute[74692]:     <disk type='file' device='disk'>
Nov 18 18:31:07 user nova-compute[74692]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 18 18:31:07 user nova-compute[74692]:       <source file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk' index='2'/>
Nov 18 18:31:07 user nova-compute[74692]:       <backingStore type='file' index='3'>
Nov 18 18:31:07 user nova-compute[74692]:         <format type='raw'/>
Nov 18 18:31:07 user nova-compute[74692]:         <source file='/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701'/>
Nov 18 18:31:07 user nova-compute[74692]:         <backingStore/>
Nov 18 18:31:07 user nova-compute[74692]:       </backingStore>
Nov 18 18:31:07 user nova-compute[74692]:       <target dev='vda' bus='virtio'/>
Nov 18 18:31:07 user nova-compute[74692]:       <alias name='virtio-disk0'/>
Nov 18 18:31:07 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 18 18:31:07 user nova-compute[74692]:     </disk>
Nov 18 18:31:07 user nova-compute[74692]:     <disk type='file' device='cdrom'>
Nov 18 18:31:07 user nova-compute[74692]:       <driver name='qemu' type='raw' cache='none'/>
Nov 18 18:31:07 user nova-compute[74692]:       <source file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk.config' index='1'/>
Nov 18 18:31:07 user nova-compute[74692]:       <backingStore/>
Nov 18 18:31:07 user nova-compute[74692]:       <target dev='hda' bus='ide'/>
Nov 18 18:31:07 user nova-compute[74692]:       <readonly/>
Nov 18 18:31:07 user nova-compute[74692]:       <alias name='ide0-0-0'/>
Nov 18 18:31:07 user nova-compute[74692]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 18 18:31:07 user nova-compute[74692]:     </disk>
Nov 18 18:31:07 user nova-compute[74692]:     <controller type='usb' index='0' model='none'>
Nov 18 18:31:07 user nova-compute[74692]:       <alias name='usb'/>
Nov 18 18:31:07 user nova-compute[74692]:     </controller>
Nov 18 18:31:07 user nova-compute[74692]:     <controller type='pci' index='0' model='pci-root'>
Nov 18 18:31:07 user nova-compute[74692]:       <alias name='pci.0'/>
Nov 18 18:31:07 user nova-compute[74692]:     </controller>
Nov 18 18:31:07 user nova-compute[74692]:     <controller type='ide' index='0'>
Nov 18 18:31:07 user nova-compute[74692]:       <alias name='ide'/>
Nov 18 18:31:07 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 18 18:31:07 user nova-compute[74692]:     </controller>
Nov 18 18:31:07 user nova-compute[74692]:     <interface type='ethernet'>
Nov 18 18:31:07 user nova-compute[74692]:       <mac address='fa:16:3e:a9:05:46'/>
Nov 18 18:31:07 user nova-compute[74692]:       <target dev='tap9935070a-ab'/>
Nov 18 18:31:07 user nova-compute[74692]:       <model type='virtio'/>
Nov 18 18:31:07 user nova-compute[74692]:       <mtu size='1442'/>
Nov 18 18:31:07 user nova-compute[74692]:       <alias name='net0'/>
Nov 18 18:31:07 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 18 18:31:07 user nova-compute[74692]:     </interface>
Nov 18 18:31:07 user nova-compute[74692]:     <interface type='ethernet'>
Nov 18 18:31:07 user nova-compute[74692]:       <mac address='fa:16:3e:42:b5:34'/>
Nov 18 18:31:07 user nova-compute[74692]:       <target dev='tap57868bb5-51'/>
Nov 18 18:31:07 user nova-compute[74692]:       <model type='virtio'/>
Nov 18 18:31:07 user nova-compute[74692]:       <mtu size='1442'/>
Nov 18 18:31:07 user nova-compute[74692]:       <alias name='net1'/>
Nov 18 18:31:07 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 18 18:31:07 user nova-compute[74692]:     </interface>
Nov 18 18:31:07 user nova-compute[74692]:     <serial type='pty'>
Nov 18 18:31:07 user nova-compute[74692]:       <source path='/dev/pts/4'/>
Nov 18 18:31:07 user nova-compute[74692]:       <log file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/console.log' append='off'/>
Nov 18 18:31:07 user nova-compute[74692]:       <target type='isa-serial' port='0'>
Nov 18 18:31:07 user nova-compute[74692]:         <model name='isa-serial'/>
Nov 18 18:31:07 user nova-compute[74692]:       </target>
Nov 18 18:31:07 user nova-compute[74692]:       <alias name='serial0'/>
Nov 18 18:31:07 user nova-compute[74692]:     </serial>
Nov 18 18:31:07 user nova-compute[74692]:     <console type='pty' tty='/dev/pts/4'>
Nov 18 18:31:07 user nova-compute[74692]:       <source path='/dev/pts/4'/>
Nov 18 18:31:07 user nova-compute[74692]:       <log file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/console.log' append='off'/>
Nov 18 18:31:07 user nova-compute[74692]:       <target type='serial' port='0'/>
Nov 18 18:31:07 user nova-compute[74692]:       <alias name='serial0'/>
Nov 18 18:31:07 user nova-compute[74692]:     </console>
Nov 18 18:31:07 user nova-compute[74692]:     <input type='mouse' bus='ps2'>
Nov 18 18:31:07 user nova-compute[74692]:       <alias name='input0'/>
Nov 18 18:31:07 user nova-compute[74692]:     </input>
Nov 18 18:31:07 user nova-compute[74692]:     <input type='keyboard' bus='ps2'>
Nov 18 18:31:07 user nova-compute[74692]:       <alias name='input1'/>
Nov 18 18:31:07 user nova-compute[74692]:     </input>
Nov 18 18:31:07 user nova-compute[74692]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 18 18:31:07 user nova-compute[74692]:       <listen type='address' address='0.0.0.0'/>
Nov 18 18:31:07 user nova-compute[74692]:     </graphics>
Nov 18 18:31:07 user nova-compute[74692]:     <audio id='1' type='none'/>
Nov 18 18:31:07 user nova-compute[74692]:     <video>
Nov 18 18:31:07 user nova-compute[74692]:       <model type='virtio' heads='1' primary='yes'/>
Nov 18 18:31:07 user nova-compute[74692]:       <alias name='video0'/>
Nov 18 18:31:07 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 18 18:31:07 user nova-compute[74692]:     </video>
Nov 18 18:31:07 user nova-compute[74692]:     <memballoon model='virtio'>
Nov 18 18:31:07 user nova-compute[74692]:       <stats period='10'/>
Nov 18 18:31:07 user nova-compute[74692]:       <alias name='balloon0'/>
Nov 18 18:31:07 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 18 18:31:07 user nova-compute[74692]:     </memballoon>
Nov 18 18:31:07 user nova-compute[74692]:     <rng model='virtio'>
Nov 18 18:31:07 user nova-compute[74692]:       <backend model='random'>/dev/urandom</backend>
Nov 18 18:31:07 user nova-compute[74692]:       <alias name='rng0'/>
Nov 18 18:31:07 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 18 18:31:07 user nova-compute[74692]:     </rng>
Nov 18 18:31:07 user nova-compute[74692]:   </devices>
Nov 18 18:31:07 user nova-compute[74692]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 18 18:31:07 user nova-compute[74692]:     <label>libvirt-0b9551f1-bc3e-4221-95fc-3b3a4a33251c</label>
Nov 18 18:31:07 user nova-compute[74692]:     <imagelabel>libvirt-0b9551f1-bc3e-4221-95fc-3b3a4a33251c</imagelabel>
Nov 18 18:31:07 user nova-compute[74692]:   </seclabel>
Nov 18 18:31:07 user nova-compute[74692]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 18 18:31:07 user nova-compute[74692]:     <label>+64055:+108</label>
Nov 18 18:31:07 user nova-compute[74692]:     <imagelabel>+64055:+108</imagelabel>
Nov 18 18:31:07 user nova-compute[74692]:   </seclabel>
Nov 18 18:31:07 user nova-compute[74692]: </domain>
Nov 18 18:31:07 user nova-compute[74692]:  {{(pid=74692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 18 18:31:07 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Successfully detached device tap57868bb5-51 from instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c from the persistent domain config.
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] (1/8): Attempting to detach device tap57868bb5-51 with device alias net1 from instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] detach device xml: <interface type="ethernet">
Nov 18 18:31:07 user nova-compute[74692]:   <mac address="fa:16:3e:42:b5:34"/>
Nov 18 18:31:07 user nova-compute[74692]:   <model type="virtio"/>
Nov 18 18:31:07 user nova-compute[74692]:   <mtu size="1442"/>
Nov 18 18:31:07 user nova-compute[74692]:   <target dev="tap57868bb5-51"/>
Nov 18 18:31:07 user nova-compute[74692]: </interface>
Nov 18 18:31:07 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:07 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Instance destroyed successfully.
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.objects.instance [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lazy-loading 'resources' on Instance uuid 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:28:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-185263152',display_name='tempest-AttachSCSIVolumeTestJSON-server-185263152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-185263152',id=3,image_ref='9626391d-96b8-4ee6-9103-722c22865918',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPU7Il7iP4ihoBEomQ7mTYWdt4j2/nyza5CAMM57eUdKYAhgvy6jK9zBf1qt/lYQ65oU3IHLHeI3rmcbO6u/l46v+/lhKT+gazw/ecfZ//5tmtWIv8aEEj3zTT5oqLxVyw==',key_name='tempest-keypair-507163191',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:28:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4468fb75f9614b1a9830981e411c0af8',ramdisk_id='',reservation_id='r-14bhrlh8',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9626391d-96b8-4ee6-9103-722c22865918',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-580137397',owner_user_name='tempest-AttachSCSIVolumeTestJSON-580137397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:28:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ed810ee90bd421dae9874b8561716c0',uuid=7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "address": "fa:16:3e:61:b3:d1", "network": {"id": "820dd503-a51a-4b71-82db-3df377e71223", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-3428666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468fb75f9614b1a9830981e411c0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b925e-78", "ovs_interfaceid": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Converting VIF {"id": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "address": "fa:16:3e:61:b3:d1", "network": {"id": "820dd503-a51a-4b71-82db-3df377e71223", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-3428666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468fb75f9614b1a9830981e411c0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b925e-78", "ovs_interfaceid": "c79b925e-78c4-4334-a547-9294f9b4c8fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:b3:d1,bridge_name='br-int',has_traffic_filtering=True,id=c79b925e-78c4-4334-a547-9294f9b4c8fe,network=Network(820dd503-a51a-4b71-82db-3df377e71223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79b925e-78') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG os_vif [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:b3:d1,bridge_name='br-int',has_traffic_filtering=True,id=c79b925e-78c4-4334-a547-9294f9b4c8fe,network=Network(820dd503-a51a-4b71-82db-3df377e71223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79b925e-78') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc79b925e-78, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 896532480 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=929d5af3-fbef-4fc1-92b6-3768d1620723) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Start waiting for the detach event from libvirt for device tap57868bb5-51 with device alias net1 for instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:31:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:07 user nova-compute[74692]: INFO os_vif [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:b3:d1,bridge_name='br-int',has_traffic_filtering=True,id=c79b925e-78c4-4334-a547-9294f9b4c8fe,network=Network(820dd503-a51a-4b71-82db-3df377e71223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79b925e-78')
Nov 18 18:31:07 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Deleting instance files /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1_del
Nov 18 18:31:07 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Deletion of /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1_del complete
Nov 18 18:31:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk --force-share --output=json" returned: 1 in 0.298s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk --force-share --output=json' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:31:08 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000003, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1/disk
Nov 18 18:31:08 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid '40481706-78c9-402d-9d19-d2d00d812095' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid '40481706-78c9-402d-9d19-d2d00d812095' (instance-0000000a)
Nov 18 18:31:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:08 user nova-compute[74692]: INFO nova.compute.manager [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 18 18:31:08 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:31:08 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:31:08 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:31:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 1031798784 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:31:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:31:09 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Creating image(s)
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Ensure instance console log exists: /opt/stack/data/nova/instances/76506747-4a6b-40bd-b812-bf114be5e8b4/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Start _get_guest_xml network_info=[{"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqQgpinc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '76506747-4a6b-40bd-b812-bf114be5e8b4', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2912de2-b649-4082-bc87-4b46b3981cd0', 'serial': 'a2912de2-b649-4082-bc87-4b46b3981cd0'}, 'attachment_id': '27263234-7099-4183-82be-897f4f39a1e6', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:31:09 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:31:09 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7929MB free_disk=25.51070785522461GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:09 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 18 18:31:09 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.objects.instance [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lazy-loading 'vcpu_model' on Instance uuid 76506747-4a6b-40bd-b812-bf114be5e8b4 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqQgpinc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:31:09 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 18:31:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:09 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 18:31:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:09 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Received event network-vif-unplugged-c79b925e-78c4-4334-a547-9294f9b4c8fe {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] Acquiring lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] No waiting events found dispatching network-vif-unplugged-c79b925e-78c4-4334-a547-9294f9b4c8fe {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Received event network-vif-unplugged-c79b925e-78c4-4334-a547-9294f9b4c8fe for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Received event network-vif-plugged-c79b925e-78c4-4334-a547-9294f9b4c8fe {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] Acquiring lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] No waiting events found dispatching network-vif-plugged-c79b925e-78c4-4334-a547-9294f9b4c8fe {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:09 user nova-compute[74692]: WARNING nova.compute.manager [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Received unexpected event network-vif-plugged-c79b925e-78c4-4334-a547-9294f9b4c8fe for instance with vm_state active and task_state deleting.
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-deleted-050fa40f-fc29-49bd-b29d-c7954818aa63 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:09 user nova-compute[74692]: INFO nova.compute.manager [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Neutron deleted interface 050fa40f-fc29-49bd-b29d-c7954818aa63; detaching it from the instance and deleting it from the info cache
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.network.neutron [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating instance_info_cache with network_info: [{"id": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "address": "fa:16:3e:fb:50:e4", "network": {"id": "27774fe7-2099-4253-8194-b6d160291ece", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-210587587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d79063-ef", "ovs_interfaceid": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14e00c18-ad6b-4481-852d-e336bee32648", "address": "fa:16:3e:6a:7c:8a", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e00c18-ad", "ovs_interfaceid": "14e00c18-ad6b-4481-852d-e336bee32648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "address": "fa:16:3e:2f:01:4c", "network": {"id": "404ec382-2e6d-4924-bf12-3e796e02e1ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-560798634", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26cb4ab6-5d", "ovs_interfaceid": "26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f8cacd-998e-4178-8a0c-031ab9badfbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:31:09 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ceaff3-8088-4589-91c2-7e3b70568f92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0] added
Nov 18 18:31:09 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Detach interface failed, port_id=050fa40f-fc29-49bd-b29d-c7954818aa63, reason: Instance e1603038-3a10-4efb-b5f7-15495ccd3717 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received event network-vif-unplugged-57868bb5-51e2-4d1f-b04e-6308332991b6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] Acquiring lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] No waiting events found dispatching network-vif-unplugged-57868bb5-51e2-4d1f-b04e-6308332991b6 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:09 user nova-compute[74692]: WARNING nova.compute.manager [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received unexpected event network-vif-unplugged-57868bb5-51e2-4d1f-b04e-6308332991b6 for instance with vm_state active and task_state None.
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received event network-vif-plugged-57868bb5-51e2-4d1f-b04e-6308332991b6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] Acquiring lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] No waiting events found dispatching network-vif-plugged-57868bb5-51e2-4d1f-b04e-6308332991b6 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:09 user nova-compute[74692]: WARNING nova.compute.manager [req-1718328f-a61e-4078-a84d-09e23274a8c5 req-69b14b58-af42-47a8-abeb-4f8532973ba4 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received unexpected event network-vif-plugged-57868bb5-51e2-4d1f-b04e-6308332991b6 for instance with vm_state active and task_state None.
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17447e1-2e91-4d25-bf3a-3705927ec122 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 76506747-4a6b-40bd-b812-bf114be5e8b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d40a1c6a-a5c1-46ff-ae2f-70819a1903b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance e1603038-3a10-4efb-b5f7-15495ccd3717 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 40481706-78c9-402d-9d19-d2d00d812095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7960f76b-9176-4d98-8045-03678457add7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e32224-4b07-4fbb-8299-380db75d03b0]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjoDlnut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '3d151d79-2775-4092-9852-83e8cf4eaee7'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:31:09 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:31:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[934c2c88-a59c-4404-bff7-a880059dd048]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqQgpinc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqQgpinc" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32ca336-6f6e-42c8-a24c-60cb64eed59f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kqQgpinc'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[69df9645-76ec-4526-aa82-7b78b4d2b318]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c728c6-ac3d-40b7-aeae-820f62ce4f6e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:09 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:09 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:09 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:09 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:09 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:09 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:09 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:09 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:31:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-405e742e-bf26-4351-980d-31aa2b5293cc req-e98830a6-30b9-44bf-b7aa-c422e94725ae service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-deleted-a4b46c64-5441-46a3-8da4-529a1d32046e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:10 user nova-compute[74692]: INFO nova.compute.manager [req-405e742e-bf26-4351-980d-31aa2b5293cc req-e98830a6-30b9-44bf-b7aa-c422e94725ae service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Neutron deleted interface a4b46c64-5441-46a3-8da4-529a1d32046e; detaching it from the instance and deleting it from the info cache
Nov 18 18:31:10 user nova-compute[74692]: DEBUG nova.network.neutron [req-405e742e-bf26-4351-980d-31aa2b5293cc req-e98830a6-30b9-44bf-b7aa-c422e94725ae service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updating instance_info_cache with network_info: [{"id": "bd5d1c9a-bf27-47ce-9047-72844816accd", "address": "fa:16:3e:c1:a9:96", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5d1c9a-bf", "ovs_interfaceid": "bd5d1c9a-bf27-47ce-9047-72844816accd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "address": "fa:16:3e:87:4c:60", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2a0340-80", "ovs_interfaceid": "8c2a0340-808f-4987-a0dd-38d3d9548b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "address": "fa:16:3e:e9:84:44", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd929622-57", "ovs_interfaceid": "dd929622-57d9-4e8c-9012-6340cc9d39ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11839468-beda-436e-9437-715fdaa17168", "address": "fa:16:3e:94:77:bc", "network": {"id": "99572303-6b8f-4c79-a2d3-5c1322737bb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1154832963", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11839468-be", "ovs_interfaceid": "11839468-beda-436e-9437-715fdaa17168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "address": "fa:16:3e:e4:17:89", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbab20d9-2b", "ovs_interfaceid": "dbab20d9-2bd4-480c-a971-c213fcfa03a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "address": "fa:16:3e:4c:4a:a6", "network": {"id": "ee3f23fa-6cfb-4de2-a59a-3aa7e9501194", "bridge": "br-int", "label": "tempest-device-tagging-net2-327487582", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a88be034ffb4322ad1a9d2aebef7e59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f12897-9a", "ovs_interfaceid": "15f12897-9a5b-4c7a-b80e-4889ce96f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-9b4169af-77cf-4e4a-9cfb-9614511c04ec req-25701045-e320-4c3e-af5f-6cb01008d918 service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Received event network-vif-deleted-c79b925e-78c4-4334-a547-9294f9b4c8fe {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:10 user nova-compute[74692]: INFO nova.compute.manager [req-9b4169af-77cf-4e4a-9cfb-9614511c04ec req-25701045-e320-4c3e-af5f-6cb01008d918 service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Neutron deleted interface c79b925e-78c4-4334-a547-9294f9b4c8fe; detaching it from the instance and deleting it from the info cache
Nov 18 18:31:10 user nova-compute[74692]: DEBUG nova.network.neutron [req-9b4169af-77cf-4e4a-9cfb-9614511c04ec req-25701045-e320-4c3e-af5f-6cb01008d918 service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:10 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Took 2.13 seconds to deallocate network for instance.
Nov 18 18:31:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-405e742e-bf26-4351-980d-31aa2b5293cc req-e98830a6-30b9-44bf-b7aa-c422e94725ae service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Detach interface failed, port_id=a4b46c64-5441-46a3-8da4-529a1d32046e, reason: Instance 40481706-78c9-402d-9d19-d2d00d812095 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-9b4169af-77cf-4e4a-9cfb-9614511c04ec req-25701045-e320-4c3e-af5f-6cb01008d918 service nova] [instance: 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1] Detach interface failed, port_id=c79b925e-78c4-4334-a547-9294f9b4c8fe, reason: Instance 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --login" returned: 0 in 1.080s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[90610122-a59a-4ce5-a2ec-3c4a49f82ba0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260]
Nov 18 18:31:10 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260] successful.
Nov 18 18:31:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c5b089-65c0-47dd-b97e-dbed3f7ac934]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c00d1b-517c-455b-9772-f86cb2ab53e8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:10 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:10 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:10 user nova-compute[74692]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:31:10 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:10 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:10 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:10 user nova-compute[74692]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:31:10 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.373s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff6b1e9-f9d5-47c4-aa4a-d0bca3e778bb]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqQgpinc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:31:10 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d40a1c6a-a5c1-46ff-ae2f-70819a1903b0 is timed out.
Nov 18 18:31:10 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Successfully detached device vdb from instance d40a1c6a-a5c1-46ff-ae2f-70819a1903b0 from the live domain config.
Nov 18 18:31:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MaekHtEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:31:10 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:31:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:31:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:10 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Deleted allocations for instance 7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6a9efc04-36c5-4d5b-bee7-a47f96516318 tempest-AttachSCSIVolumeTestJSON-580137397 tempest-AttachSCSIVolumeTestJSON-580137397-project-member] Lock "7f40e2a3-b8a9-48c0-a3cd-0f45cc4a92e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.235s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.compute.manager [req-f608627c-d513-423f-819e-824c1c4b0d99 req-edeb13e3-a7ef-40c2-9b10-65017daa9e48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-deleted-26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:11 user nova-compute[74692]: INFO nova.compute.manager [req-f608627c-d513-423f-819e-824c1c4b0d99 req-edeb13e3-a7ef-40c2-9b10-65017daa9e48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Neutron deleted interface 26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe; detaching it from the instance and deleting it from the info cache
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.network.neutron [req-f608627c-d513-423f-819e-824c1c4b0d99 req-edeb13e3-a7ef-40c2-9b10-65017daa9e48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating instance_info_cache with network_info: [{"id": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "address": "fa:16:3e:fb:50:e4", "network": {"id": "27774fe7-2099-4253-8194-b6d160291ece", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-210587587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d79063-ef", "ovs_interfaceid": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14e00c18-ad6b-4481-852d-e336bee32648", "address": "fa:16:3e:6a:7c:8a", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e00c18-ad", "ovs_interfaceid": "14e00c18-ad6b-4481-852d-e336bee32648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.compute.manager [req-f608627c-d513-423f-819e-824c1c4b0d99 req-edeb13e3-a7ef-40c2-9b10-65017daa9e48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Detach interface failed, port_id=26cb4ab6-5d61-4fd6-bdc5-9aa8bc5cf9fe, reason: Instance e1603038-3a10-4efb-b5f7-15495ccd3717 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.compute.manager [req-f608627c-d513-423f-819e-824c1c4b0d99 req-edeb13e3-a7ef-40c2-9b10-65017daa9e48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-deleted-14e00c18-ad6b-4481-852d-e336bee32648 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:11 user nova-compute[74692]: INFO nova.compute.manager [req-f608627c-d513-423f-819e-824c1c4b0d99 req-edeb13e3-a7ef-40c2-9b10-65017daa9e48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Neutron deleted interface 14e00c18-ad6b-4481-852d-e336bee32648; detaching it from the instance and deleting it from the info cache
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.network.neutron [req-f608627c-d513-423f-819e-824c1c4b0d99 req-edeb13e3-a7ef-40c2-9b10-65017daa9e48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating instance_info_cache with network_info: [{"id": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "address": "fa:16:3e:fb:50:e4", "network": {"id": "27774fe7-2099-4253-8194-b6d160291ece", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-210587587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d79063-ef", "ovs_interfaceid": "d3d79063-efeb-4014-acb1-ddcfc7c57309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.compute.manager [req-f608627c-d513-423f-819e-824c1c4b0d99 req-edeb13e3-a7ef-40c2-9b10-65017daa9e48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Detach interface failed, port_id=14e00c18-ad6b-4481-852d-e336bee32648, reason: Instance e1603038-3a10-4efb-b5f7-15495ccd3717 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.compute.manager [req-f608627c-d513-423f-819e-824c1c4b0d99 req-edeb13e3-a7ef-40c2-9b10-65017daa9e48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-deleted-d3d79063-efeb-4014-acb1-ddcfc7c57309 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:11 user nova-compute[74692]: INFO nova.compute.manager [req-f608627c-d513-423f-819e-824c1c4b0d99 req-edeb13e3-a7ef-40c2-9b10-65017daa9e48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Neutron deleted interface d3d79063-efeb-4014-acb1-ddcfc7c57309; detaching it from the instance and deleting it from the info cache
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.network.neutron [req-f608627c-d513-423f-819e-824c1c4b0d99 req-edeb13e3-a7ef-40c2-9b10-65017daa9e48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating instance_info_cache with network_info: [{"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "820a0454-d628-4849-956e-e219a7c77f71", "address": "fa:16:3e:f0:79:03", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a0454-d6", "ovs_interfaceid": "820a0454-d628-4849-956e-e219a7c77f71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:11 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Took 6.28 seconds to deallocate network for instance.
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.compute.manager [req-f608627c-d513-423f-819e-824c1c4b0d99 req-edeb13e3-a7ef-40c2-9b10-65017daa9e48 service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Detach interface failed, port_id=d3d79063-efeb-4014-acb1-ddcfc7c57309, reason: Instance e1603038-3a10-4efb-b5f7-15495ccd3717 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.412s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] <== connect_volume: return (2414ms) {'type': 'block', 'scsi_wwn': '23732306636613337', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732306636613337', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.305s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5fb75e-d350-47ca-b86d-9c18752f3199]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:31:11 user nova-compute[74692]: No targets found.
Nov 18 18:31:11 user nova-compute[74692]: iSNS:
Nov 18 18:31:11 user nova-compute[74692]: No targets found.
Nov 18 18:31:11 user nova-compute[74692]: STATIC:
Nov 18 18:31:11 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0
Nov 18 18:31:11 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:11 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:11 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b
Nov 18 18:31:11 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:11 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:11 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7
Nov 18 18:31:11 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:11 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:11 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:31:11 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:11 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:11 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898
Nov 18 18:31:11 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:11 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:11 user nova-compute[74692]: FIRMWARE:
Nov 18 18:31:11 user nova-compute[74692]: No targets found.
Nov 18 18:31:11 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:31:11 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:31:11 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T18:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-531822998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-626426105',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTHSxq3l9P151CfI0F18PIKGxWORN+tyCeI14rp0SJ3N9oq0TLT9ZnzNpxntJM2DuX3cToXTszKRjjVF26/nMLI0+HVGYhPNvxTS05iN12eMktmp14rfpm1F3GFT67jMA==',key_name='tempest-keypair-503198552',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='210268bb72854d749ca0e5865b441377',ramdisk_id='',reservation_id='r-0j9378kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-812059553',owner_user_name='tempest-ServerActionsV293TestJSON-812059553-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0babd17983e74a4792e3c72b70e4298b',uuid=76506747-4a6b-40bd-b812-bf114be5e8b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Converting VIF {"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:c2:39,bridge_name='br-int',has_traffic_filtering=True,id=9ba43cb0-30b9-43ae-8f81-3df420497fff,network=Network(9f685a03-85ba-4cab-bccb-8862ef230237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba43cb0-30') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:31:11 user nova-compute[74692]:   <uuid>76506747-4a6b-40bd-b812-bf114be5e8b4</uuid>
Nov 18 18:31:11 user nova-compute[74692]:   <name>instance-00000006</name>
Nov 18 18:31:11 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:31:11 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:31:11 user nova-compute[74692]:   <metadata>
Nov 18 18:31:11 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:31:11 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:31:11 user nova-compute[74692]:       <nova:name>tempest-ServerActionsV293TestJSON-server-531822998</nova:name>
Nov 18 18:31:11 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:31:09</nova:creationTime>
Nov 18 18:31:11 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:31:11 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:31:11 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:31:11 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:31:11 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:31:11 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:31:11 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:31:11 user nova-compute[74692]:       <nova:owner>
Nov 18 18:31:11 user nova-compute[74692]:         <nova:user uuid="0babd17983e74a4792e3c72b70e4298b">tempest-ServerActionsV293TestJSON-812059553-project-member</nova:user>
Nov 18 18:31:11 user nova-compute[74692]:         <nova:project uuid="210268bb72854d749ca0e5865b441377">tempest-ServerActionsV293TestJSON-812059553</nova:project>
Nov 18 18:31:11 user nova-compute[74692]:       </nova:owner>
Nov 18 18:31:11 user nova-compute[74692]:       <nova:ports>
Nov 18 18:31:11 user nova-compute[74692]:         <nova:port uuid="9ba43cb0-30b9-43ae-8f81-3df420497fff">
Nov 18 18:31:11 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 18 18:31:11 user nova-compute[74692]:         </nova:port>
Nov 18 18:31:11 user nova-compute[74692]:       </nova:ports>
Nov 18 18:31:11 user nova-compute[74692]:     </nova:instance>
Nov 18 18:31:11 user nova-compute[74692]:   </metadata>
Nov 18 18:31:11 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:31:11 user nova-compute[74692]:     <system>
Nov 18 18:31:11 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:31:11 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:31:11 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:31:11 user nova-compute[74692]:       <entry name="serial">76506747-4a6b-40bd-b812-bf114be5e8b4</entry>
Nov 18 18:31:11 user nova-compute[74692]:       <entry name="uuid">76506747-4a6b-40bd-b812-bf114be5e8b4</entry>
Nov 18 18:31:11 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:31:11 user nova-compute[74692]:     </system>
Nov 18 18:31:11 user nova-compute[74692]:   </sysinfo>
Nov 18 18:31:11 user nova-compute[74692]:   <os>
Nov 18 18:31:11 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:31:11 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:31:11 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:31:11 user nova-compute[74692]:   </os>
Nov 18 18:31:11 user nova-compute[74692]:   <features>
Nov 18 18:31:11 user nova-compute[74692]:     <acpi/>
Nov 18 18:31:11 user nova-compute[74692]:     <apic/>
Nov 18 18:31:11 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:31:11 user nova-compute[74692]:   </features>
Nov 18 18:31:11 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:31:11 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:31:11 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:31:11 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:31:11 user nova-compute[74692]:   </clock>
Nov 18 18:31:11 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:31:11 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:31:11 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:31:11 user nova-compute[74692]:   </cpu>
Nov 18 18:31:11 user nova-compute[74692]:   <devices>
Nov 18 18:31:11 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:31:11 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:31:11 user nova-compute[74692]:       <source dev="/dev/sdb"/>
Nov 18 18:31:11 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:31:11 user nova-compute[74692]:       <serial>a2912de2-b649-4082-bc87-4b46b3981cd0</serial>
Nov 18 18:31:11 user nova-compute[74692]:     </disk>
Nov 18 18:31:11 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:31:11 user nova-compute[74692]:       <mac address="fa:16:3e:5b:c2:39"/>
Nov 18 18:31:11 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:31:11 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:31:11 user nova-compute[74692]:       <target dev="tap9ba43cb0-30"/>
Nov 18 18:31:11 user nova-compute[74692]:     </interface>
Nov 18 18:31:11 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:31:11 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/76506747-4a6b-40bd-b812-bf114be5e8b4/console.log" append="off"/>
Nov 18 18:31:11 user nova-compute[74692]:     </serial>
Nov 18 18:31:11 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:31:11 user nova-compute[74692]:     <video>
Nov 18 18:31:11 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:31:11 user nova-compute[74692]:     </video>
Nov 18 18:31:11 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:31:11 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:31:11 user nova-compute[74692]:     </rng>
Nov 18 18:31:11 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:31:11 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:31:11 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:31:11 user nova-compute[74692]:     </memballoon>
Nov 18 18:31:11 user nova-compute[74692]:   </devices>
Nov 18 18:31:11 user nova-compute[74692]: </domain>
Nov 18 18:31:11 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T18:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-531822998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-626426105',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTHSxq3l9P151CfI0F18PIKGxWORN+tyCeI14rp0SJ3N9oq0TLT9ZnzNpxntJM2DuX3cToXTszKRjjVF26/nMLI0+HVGYhPNvxTS05iN12eMktmp14rfpm1F3GFT67jMA==',key_name='tempest-keypair-503198552',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='210268bb72854d749ca0e5865b441377',ramdisk_id='',reservation_id='r-0j9378kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-812059553',owner_user_name='tempest-ServerActionsV293TestJSON-812059553-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0babd17983e74a4792e3c72b70e4298b',uuid=76506747-4a6b-40bd-b812-bf114be5e8b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Converting VIF {"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:c2:39,bridge_name='br-int',has_traffic_filtering=True,id=9ba43cb0-30b9-43ae-8f81-3df420497fff,network=Network(9f685a03-85ba-4cab-bccb-8862ef230237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba43cb0-30') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_vif [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:c2:39,bridge_name='br-int',has_traffic_filtering=True,id=9ba43cb0-30b9-43ae-8f81-3df420497fff,network=Network(9f685a03-85ba-4cab-bccb-8862ef230237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba43cb0-30') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c4778e3-eb1b-5b6b-8efc-04c829c42a58', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba4473a-04d6-4dc5-815c-3d697683c0a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ba43cb0-30, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ba43cb0-30, col_values=(('qos', UUID('eec77fc0-a700-459f-9de9-5056d1527f4b')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ba43cb0-30, col_values=(('external_ids', {'iface-id': '9ba43cb0-30b9-43ae-8f81-3df420497fff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:c2:39', 'vm-uuid': '76506747-4a6b-40bd-b812-bf114be5e8b4'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[781f4e6c-8108-4b43-b739-ff6ca18e8f98]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:11 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:11 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:11 user nova-compute[74692]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:31:11 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:11 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 (non-flash)
Nov 18 18:31:11 user nova-compute[74692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:11 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:11 user nova-compute[74692]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:31:11 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:11 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c4620700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7'): ({'sdl'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Removing single pathed devices sdl {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:11 user nova-compute[74692]: INFO os_vif [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:c2:39,bridge_name='br-int',has_traffic_filtering=True,id=9ba43cb0-30b9-43ae-8f81-3df420497fff,network=Network(9f685a03-85ba-4cab-bccb-8862ef230237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba43cb0-30')
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ff5c55-febf-48f9-8733-72cde08a784a]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dc8cf8-52af-49ec-be34-a3ed48655f47]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Flushing IO for device /dev/sdl {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] No VIF found with MAC fa:16:3e:5b:c2:39, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd019ae7-a33a-473d-acaf-460a00f4a18d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.033s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9ee4e0-7f31-44a5-a211-fdfa25bb0fbd]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] SCSI volumes sdl have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a03caa6-1235-44f8-9863-6d4b49fc9247]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0efee18-08ab-41d3-9e5f-dadb13e80388]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7, portal: 172.16.0.220,3260]
Nov 18 18:31:12 user nova-compute[74692]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7, portal: 172.16.0.220,3260] successful.
Nov 18 18:31:12 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:12 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Took 5.06 seconds to deallocate network for instance.
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d151d79-2775-4092-9852-83e8cf4eaee7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c47da75-ce89-49c3-9036-967042a54b30]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] <== disconnect_volume: return (2645ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.343s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c80f93-f461-4e98-a867-72e7868664fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:31:12 user nova-compute[74692]: No targets found.
Nov 18 18:31:12 user nova-compute[74692]: iSNS:
Nov 18 18:31:12 user nova-compute[74692]: No targets found.
Nov 18 18:31:12 user nova-compute[74692]: STATIC:
Nov 18 18:31:12 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0
Nov 18 18:31:12 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:12 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:12 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b
Nov 18 18:31:12 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:12 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:12 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:31:12 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:12 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:12 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898
Nov 18 18:31:12 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:12 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:12 user nova-compute[74692]: FIRMWARE:
Nov 18 18:31:12 user nova-compute[74692]: No targets found.
Nov 18 18:31:12 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:31:12 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:31:12 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9969450e-f8fc-4780-a970-fb7a276fef42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkNgoGnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd17447e1-2e91-4d25-bf3a-3705927ec122', 'attached_at': '', 'detached_at': '', 'volume_id': '8273228d-7d9f-4179-a45f-4eb6e5b5880b', 'serial'} {{(pid=74692) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] swap_volume: removing Cinder connection for volume 3d151d79-2775-4092-9852-83e8cf4eaee7 {{(pid=74692) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c77fd0-997d-4cc6-8aaf-9f43706d24a7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:12 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:12 user nova-compute[74692]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:31:12 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:12 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 (non-flash)
Nov 18 18:31:12 user nova-compute[74692]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:12 user nova-compute[74692]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:31:12 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:12 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41d418ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898'): ({'sdm'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Removing single pathed devices sdm {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fb7aba-f42d-48d1-86e3-40310fe4e495]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e17473-7131-4e4e-835d-a41e030bf234]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Flushing IO for device /dev/sdm {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[67319197-04f7-46c9-8000-80236ecb8fc1]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.044s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b187f61f-3e64-4b33-9cc8-49efe4b267a5]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Checking to see if SCSI volumes sdm have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] SCSI volumes sdm have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG nova.compute.manager [req-66543408-efac-4b0e-8c58-abc75201e669 req-25346bcb-8e2c-446e-b930-5551b6787378 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-deleted-dbab20d9-2bd4-480c-a971-c213fcfa03a8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG nova.compute.manager [req-66543408-efac-4b0e-8c58-abc75201e669 req-25346bcb-8e2c-446e-b930-5551b6787378 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-deleted-15f12897-9a5b-4c7a-b80e-4889ce96f780 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG nova.compute.manager [req-66543408-efac-4b0e-8c58-abc75201e669 req-25346bcb-8e2c-446e-b930-5551b6787378 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-deleted-11839468-beda-436e-9437-715fdaa17168 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG nova.compute.manager [req-66543408-efac-4b0e-8c58-abc75201e669 req-25346bcb-8e2c-446e-b930-5551b6787378 service nova] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Received event network-vif-deleted-dd929622-57d9-4e8c-9012-6340cc9d39ff {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0b7628-df33-427f-a6e3-f2451f23ea8f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d7ed77-f383-4733-a578-b43c23452f32]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898, portal: 172.16.0.220,3260]
Nov 18 18:31:12 user nova-compute[74692]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898, portal: 172.16.0.220,3260] successful.
Nov 18 18:31:12 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5867953c-08d6-4ec6-be4a-467716bed898 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e74b5c-0e02-4abe-b159-46e8b638d40e]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] <== disconnect_volume: return (1685ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:12 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] swap_volume: Updating volume 3d151d79-2775-4092-9852-83e8cf4eaee7 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "vkNgoGnR", "auth_password": "vJ4VU7ZbgNf3t1", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "8273228d-7d9f-4179-a45f-4eb6e5b5880b"}, "status": "reserved", "instance": "d17447e1-2e91-4d25-bf3a-3705927ec122", "attached_at": "", "detached_at": "", "volume_id": "8273228d-7d9f-4179-a45f-4eb6e5b5880b", "serial": "8273228d-7d9f-4179-a45f-4eb6e5b5880b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '8273228d-7d9f-4179-a45f-4eb6e5b5880b', 'no_device': None, 'attachment_id': '417e89d0-026d-4e6b-ae52-521ec3a469ce'} {{(pid=74692) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c565e796-82b0-4e8f-a813-cadcc9e40042 tempest-TestVolumeSwap-1308104431 tempest-TestVolumeSwap-1308104431-project-admin] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.195s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-d17447e1-2e91-4d25-bf3a-3705927ec122" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-d17447e1-2e91-4d25-bf3a-3705927ec122" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG nova.compute.manager [req-0dabb1e6-3498-497d-bc6b-8464b611ff66 req-01777e0f-30fb-49bb-98b9-f23b73d26b1a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Received event network-vif-deleted-820a0454-d628-4849-956e-e219a7c77f71 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:13 user nova-compute[74692]: INFO nova.compute.manager [req-0dabb1e6-3498-497d-bc6b-8464b611ff66 req-01777e0f-30fb-49bb-98b9-f23b73d26b1a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Neutron deleted interface 820a0454-d628-4849-956e-e219a7c77f71; detaching it from the instance and deleting it from the info cache
Nov 18 18:31:13 user nova-compute[74692]: DEBUG nova.network.neutron [req-0dabb1e6-3498-497d-bc6b-8464b611ff66 req-01777e0f-30fb-49bb-98b9-f23b73d26b1a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Updating instance_info_cache with network_info: [{"id": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "address": "fa:16:3e:4c:ab:b4", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eda6a3-90", "ovs_interfaceid": "81eda6a3-90f4-42dc-8462-171ec3afbf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a955bfd0-166d-4030-bb78-6402891c7af3", "address": "fa:16:3e:fd:a7:62", "network": {"id": "42e84e21-a31a-4c5b-a4c0-4ffdf19a8390", "bridge": "br-int", "label": "tempest-device-tagging-net1-462871650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4e3d9f86d2ba49ecbb73e8128900d73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa955bfd0-16", "ovs_interfaceid": "a955bfd0-166d-4030-bb78-6402891c7af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG nova.compute.manager [req-0dabb1e6-3498-497d-bc6b-8464b611ff66 req-01777e0f-30fb-49bb-98b9-f23b73d26b1a service nova] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Detach interface failed, port_id=820a0454-d628-4849-956e-e219a7c77f71, reason: Instance e1603038-3a10-4efb-b5f7-15495ccd3717 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG nova.objects.instance [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Lazy-loading 'flavor' on Instance uuid d40a1c6a-a5c1-46ff-ae2f-70819a1903b0 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Updating instance_info_cache with network_info: [{"id": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "address": "fa:16:3e:1c:ef:47", "network": {"id": "dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1097989855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ac758bb60347ad8ea3b4f2bf9292cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c1b5b3-4d", "ovs_interfaceid": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-d17447e1-2e91-4d25-bf3a-3705927ec122" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2c7ad5f2-d24f-4708-9fd1-da2e35c0e0fb tempest-VolumesAssistedSnapshotsTest-1729883633 tempest-VolumesAssistedSnapshotsTest-1729883633-project-admin] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.938s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquiring lock "d17447e1-2e91-4d25-bf3a-3705927ec122" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:14 user nova-compute[74692]: INFO nova.compute.manager [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Detaching volume 8273228d-7d9f-4179-a45f-4eb6e5b5880b
Nov 18 18:31:14 user nova-compute[74692]: INFO nova.virt.block_device [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Attempting to driver detach volume 8273228d-7d9f-4179-a45f-4eb6e5b5880b from mountpoint /dev/vdb
Nov 18 18:31:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Attempting to detach device vdb from instance d17447e1-2e91-4d25-bf3a-3705927ec122 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:31:14 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:31:14 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:31:14 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:31:14 user nova-compute[74692]:   <serial>8273228d-7d9f-4179-a45f-4eb6e5b5880b</serial>
Nov 18 18:31:14 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:31:14 user nova-compute[74692]: </disk>
Nov 18 18:31:14 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:31:14 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Successfully detached device vdb from instance d17447e1-2e91-4d25-bf3a-3705927ec122 from the persistent domain config.
Nov 18 18:31:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d17447e1-2e91-4d25-bf3a-3705927ec122 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:31:14 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:31:14 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:31:14 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:31:14 user nova-compute[74692]:   <serial>8273228d-7d9f-4179-a45f-4eb6e5b5880b</serial>
Nov 18 18:31:14 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:31:14 user nova-compute[74692]: </disk>
Nov 18 18:31:14 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-678efdfa-0b10-43e3-8aa4-1a0fdeccf884 req-88c14d99-bd86-4fbf-81f1-187e053b074f service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received event network-vif-plugged-9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-678efdfa-0b10-43e3-8aa4-1a0fdeccf884 req-88c14d99-bd86-4fbf-81f1-187e053b074f service nova] Acquiring lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-678efdfa-0b10-43e3-8aa4-1a0fdeccf884 req-88c14d99-bd86-4fbf-81f1-187e053b074f service nova] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-678efdfa-0b10-43e3-8aa4-1a0fdeccf884 req-88c14d99-bd86-4fbf-81f1-187e053b074f service nova] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-678efdfa-0b10-43e3-8aa4-1a0fdeccf884 req-88c14d99-bd86-4fbf-81f1-187e053b074f service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] No waiting events found dispatching network-vif-plugged-9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:14 user nova-compute[74692]: WARNING nova.compute.manager [req-678efdfa-0b10-43e3-8aa4-1a0fdeccf884 req-88c14d99-bd86-4fbf-81f1-187e053b074f service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received unexpected event network-vif-plugged-9ba43cb0-30b9-43ae-8f81-3df420497fff for instance with vm_state active and task_state rebuild_spawning.
Nov 18 18:31:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-678efdfa-0b10-43e3-8aa4-1a0fdeccf884 req-88c14d99-bd86-4fbf-81f1-187e053b074f service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received event network-vif-plugged-9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-678efdfa-0b10-43e3-8aa4-1a0fdeccf884 req-88c14d99-bd86-4fbf-81f1-187e053b074f service nova] Acquiring lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-678efdfa-0b10-43e3-8aa4-1a0fdeccf884 req-88c14d99-bd86-4fbf-81f1-187e053b074f service nova] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-678efdfa-0b10-43e3-8aa4-1a0fdeccf884 req-88c14d99-bd86-4fbf-81f1-187e053b074f service nova] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-678efdfa-0b10-43e3-8aa4-1a0fdeccf884 req-88c14d99-bd86-4fbf-81f1-187e053b074f service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] No waiting events found dispatching network-vif-plugged-9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:14 user nova-compute[74692]: WARNING nova.compute.manager [req-678efdfa-0b10-43e3-8aa4-1a0fdeccf884 req-88c14d99-bd86-4fbf-81f1-187e053b074f service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received unexpected event network-vif-plugged-9ba43cb0-30b9-43ae-8f81-3df420497fff for instance with vm_state active and task_state rebuild_spawning.
Nov 18 18:31:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d17447e1-2e91-4d25-bf3a-3705927ec122 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:31:15 user nova-compute[74692]: INFO nova.compute.manager [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] [instance: e1603038-3a10-4efb-b5f7-15495ccd3717] Took 3.77 seconds to detach 3 volumes for instance.
Nov 18 18:31:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:31:15 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Instance spawned successfully.
Nov 18 18:31:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:15 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Deleted allocations for instance e1603038-3a10-4efb-b5f7-15495ccd3717
Nov 18 18:31:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG nova.objects.instance [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74692) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-80df9ccd-474e-4e38-a25b-448f6b4f0363 tempest-TaggedBootDevicesTest-1827349967 tempest-TaggedBootDevicesTest-1827349967-project-member] Lock "e1603038-3a10-4efb-b5f7-15495ccd3717" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.150s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b94770f5-5958-40fb-835f-0137b906d4fa tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.072s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:15 user nova-compute[74692]: INFO nova.compute.manager [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] [instance: 40481706-78c9-402d-9d19-d2d00d812095] Took 3.82 seconds to detach 3 volumes for instance.
Nov 18 18:31:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:16 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:31:16 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:31:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:16 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Deleted allocations for instance 40481706-78c9-402d-9d19-d2d00d812095
Nov 18 18:31:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29f7593c-c4dd-47e4-9ee0-61f8faa217c4 tempest-TaggedBootDevicesTest_v242-158402548 tempest-TaggedBootDevicesTest_v242-158402548-project-member] Lock "40481706-78c9-402d-9d19-d2d00d812095" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.794s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:31:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:23 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:31:23 user nova-compute[74692]: INFO nova.compute.claims [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Claim successful on node user
Nov 18 18:31:23 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:31:23 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:31:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:31:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:31:23 user nova-compute[74692]: DEBUG nova.network.neutron [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:31:23 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:31:24 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG nova.policy [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3279e5607e8462caa50f6cf4ff5d98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37858e7bb5cb41d082a4b0ee86658f08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:31:24 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Creating image(s)
Nov 18 18:31:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "/opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "/opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "/opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.192s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk 1073741824" returned: 0 in 0.059s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG nova.network.neutron [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Successfully created port: b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.194s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Checking if we can resize image /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:31:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Cannot resize image /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Ensure instance console log exists: /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.network.neutron [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Successfully updated port: b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquired lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.network.neutron [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-e4ed7d2d-bb0d-49cc-addd-257c3494414c req-c027d626-7ddd-404c-8ed4-6db42c34f071 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-changed-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-e4ed7d2d-bb0d-49cc-addd-257c3494414c req-c027d626-7ddd-404c-8ed4-6db42c34f071 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Refreshing instance network info cache due to event network-changed-b1bcdb35-95f4-4010-b94b-75cfb5ec082e. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e4ed7d2d-bb0d-49cc-addd-257c3494414c req-c027d626-7ddd-404c-8ed4-6db42c34f071 service nova] Acquiring lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.network.neutron [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.network.neutron [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Updating instance_info_cache with network_info: [{"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Releasing lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Instance network_info: |[{"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e4ed7d2d-bb0d-49cc-addd-257c3494414c req-c027d626-7ddd-404c-8ed4-6db42c34f071 service nova] Acquired lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.network.neutron [req-e4ed7d2d-bb0d-49cc-addd-257c3494414c req-c027d626-7ddd-404c-8ed4-6db42c34f071 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Refreshing network info cache for port b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Start _get_guest_xml network_info=[{"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:31:25 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:31:25 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1812438622',display_name='tempest-ServerStableDeviceRescueTest-server-1812438622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1812438622',id=12,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXCGEJULwKPqzrmPp7Bsfx2IXbS6p9gZQ9/X6kg1yFYuvYoFt8pfMiAIEibdhQ14zBwHFYVMkEm/mgvVZz9WHejA2ywEe2B9BeRswQ0UHrDkkvMcoV8X7zJEUd0zFmwsg==',key_name='tempest-keypair-1872300764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37858e7bb5cb41d082a4b0ee86658f08',ramdisk_id='',reservation_id='r-ivtc64el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1647655097',owner_user_name='tempest-ServerStableDeviceRescueTest-1647655097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:31:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3279e5607e8462caa50f6cf4ff5d98e',uuid=153d4723-7ede-41b3-9f64-a0487f617ed2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Converting VIF {"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ea:27,bridge_name='br-int',has_traffic_filtering=True,id=b1bcdb35-95f4-4010-b94b-75cfb5ec082e,network=Network(52a674cd-fbb9-409f-9547-8c85726f9e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bcdb35-95') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.objects.instance [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lazy-loading 'pci_devices' on Instance uuid 153d4723-7ede-41b3-9f64-a0487f617ed2 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:31:25 user nova-compute[74692]:   <uuid>153d4723-7ede-41b3-9f64-a0487f617ed2</uuid>
Nov 18 18:31:25 user nova-compute[74692]:   <name>instance-0000000c</name>
Nov 18 18:31:25 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:31:25 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:31:25 user nova-compute[74692]:   <metadata>
Nov 18 18:31:25 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:31:25 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:31:25 user nova-compute[74692]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1812438622</nova:name>
Nov 18 18:31:25 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:31:25</nova:creationTime>
Nov 18 18:31:25 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:31:25 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:31:25 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:31:25 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:31:25 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:31:25 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:31:25 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:31:25 user nova-compute[74692]:       <nova:owner>
Nov 18 18:31:25 user nova-compute[74692]:         <nova:user uuid="f3279e5607e8462caa50f6cf4ff5d98e">tempest-ServerStableDeviceRescueTest-1647655097-project-member</nova:user>
Nov 18 18:31:25 user nova-compute[74692]:         <nova:project uuid="37858e7bb5cb41d082a4b0ee86658f08">tempest-ServerStableDeviceRescueTest-1647655097</nova:project>
Nov 18 18:31:25 user nova-compute[74692]:       </nova:owner>
Nov 18 18:31:25 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:31:25 user nova-compute[74692]:       <nova:ports>
Nov 18 18:31:25 user nova-compute[74692]:         <nova:port uuid="b1bcdb35-95f4-4010-b94b-75cfb5ec082e">
Nov 18 18:31:25 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 18:31:25 user nova-compute[74692]:         </nova:port>
Nov 18 18:31:25 user nova-compute[74692]:       </nova:ports>
Nov 18 18:31:25 user nova-compute[74692]:     </nova:instance>
Nov 18 18:31:25 user nova-compute[74692]:   </metadata>
Nov 18 18:31:25 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:31:25 user nova-compute[74692]:     <system>
Nov 18 18:31:25 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:31:25 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:31:25 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:31:25 user nova-compute[74692]:       <entry name="serial">153d4723-7ede-41b3-9f64-a0487f617ed2</entry>
Nov 18 18:31:25 user nova-compute[74692]:       <entry name="uuid">153d4723-7ede-41b3-9f64-a0487f617ed2</entry>
Nov 18 18:31:25 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:31:25 user nova-compute[74692]:     </system>
Nov 18 18:31:25 user nova-compute[74692]:   </sysinfo>
Nov 18 18:31:25 user nova-compute[74692]:   <os>
Nov 18 18:31:25 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:31:25 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:31:25 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:31:25 user nova-compute[74692]:   </os>
Nov 18 18:31:25 user nova-compute[74692]:   <features>
Nov 18 18:31:25 user nova-compute[74692]:     <acpi/>
Nov 18 18:31:25 user nova-compute[74692]:     <apic/>
Nov 18 18:31:25 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:31:25 user nova-compute[74692]:   </features>
Nov 18 18:31:25 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:31:25 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:31:25 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:31:25 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:31:25 user nova-compute[74692]:   </clock>
Nov 18 18:31:25 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:31:25 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:31:25 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:31:25 user nova-compute[74692]:   </cpu>
Nov 18 18:31:25 user nova-compute[74692]:   <devices>
Nov 18 18:31:25 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:31:25 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:31:25 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk"/>
Nov 18 18:31:25 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:31:25 user nova-compute[74692]:     </disk>
Nov 18 18:31:25 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:31:25 user nova-compute[74692]:       <mac address="fa:16:3e:fe:ea:27"/>
Nov 18 18:31:25 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:31:25 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:31:25 user nova-compute[74692]:       <target dev="tapb1bcdb35-95"/>
Nov 18 18:31:25 user nova-compute[74692]:     </interface>
Nov 18 18:31:25 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:31:25 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/console.log" append="off"/>
Nov 18 18:31:25 user nova-compute[74692]:     </serial>
Nov 18 18:31:25 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:31:25 user nova-compute[74692]:     <video>
Nov 18 18:31:25 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:31:25 user nova-compute[74692]:     </video>
Nov 18 18:31:25 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:31:25 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:31:25 user nova-compute[74692]:     </rng>
Nov 18 18:31:25 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:31:25 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:31:25 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:31:25 user nova-compute[74692]:     </memballoon>
Nov 18 18:31:25 user nova-compute[74692]:   </devices>
Nov 18 18:31:25 user nova-compute[74692]: </domain>
Nov 18 18:31:25 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1812438622',display_name='tempest-ServerStableDeviceRescueTest-server-1812438622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1812438622',id=12,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXCGEJULwKPqzrmPp7Bsfx2IXbS6p9gZQ9/X6kg1yFYuvYoFt8pfMiAIEibdhQ14zBwHFYVMkEm/mgvVZz9WHejA2ywEe2B9BeRswQ0UHrDkkvMcoV8X7zJEUd0zFmwsg==',key_name='tempest-keypair-1872300764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37858e7bb5cb41d082a4b0ee86658f08',ramdisk_id='',reservation_id='r-ivtc64el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1647655097',owner_user_name='tempest-ServerStableDeviceRescueTest-1647655097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:31:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3279e5607e8462caa50f6cf4ff5d98e',uuid=153d4723-7ede-41b3-9f64-a0487f617ed2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Converting VIF {"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ea:27,bridge_name='br-int',has_traffic_filtering=True,id=b1bcdb35-95f4-4010-b94b-75cfb5ec082e,network=Network(52a674cd-fbb9-409f-9547-8c85726f9e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bcdb35-95') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG os_vif [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ea:27,bridge_name='br-int',has_traffic_filtering=True,id=b1bcdb35-95f4-4010-b94b-75cfb5ec082e,network=Network(52a674cd-fbb9-409f-9547-8c85726f9e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bcdb35-95') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67414763-7127-5852-b040-92e0b1cc1135', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1bcdb35-95, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1bcdb35-95, col_values=(('qos', UUID('843c76bd-217f-41f0-867c-4b9d98249c91')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1bcdb35-95, col_values=(('external_ids', {'iface-id': 'b1bcdb35-95f4-4010-b94b-75cfb5ec082e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:ea:27', 'vm-uuid': '153d4723-7ede-41b3-9f64-a0487f617ed2'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:25 user nova-compute[74692]: INFO os_vif [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ea:27,bridge_name='br-int',has_traffic_filtering=True,id=b1bcdb35-95f4-4010-b94b-75cfb5ec082e,network=Network(52a674cd-fbb9-409f-9547-8c85726f9e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bcdb35-95')
Nov 18 18:31:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:31:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] No VIF found with MAC fa:16:3e:fe:ea:27, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:31:26 user nova-compute[74692]: DEBUG nova.network.neutron [req-e4ed7d2d-bb0d-49cc-addd-257c3494414c req-c027d626-7ddd-404c-8ed4-6db42c34f071 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Updated VIF entry in instance network info cache for port b1bcdb35-95f4-4010-b94b-75cfb5ec082e. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:31:26 user nova-compute[74692]: DEBUG nova.network.neutron [req-e4ed7d2d-bb0d-49cc-addd-257c3494414c req-c027d626-7ddd-404c-8ed4-6db42c34f071 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Updating instance_info_cache with network_info: [{"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e4ed7d2d-bb0d-49cc-addd-257c3494414c req-c027d626-7ddd-404c-8ed4-6db42c34f071 service nova] Releasing lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-c53b1bdb-4229-4573-9063-07cbbbef3840 req-8c391f93-a552-42be-8e2e-2a99cdd97d4b service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c53b1bdb-4229-4573-9063-07cbbbef3840 req-8c391f93-a552-42be-8e2e-2a99cdd97d4b service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c53b1bdb-4229-4573-9063-07cbbbef3840 req-8c391f93-a552-42be-8e2e-2a99cdd97d4b service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c53b1bdb-4229-4573-9063-07cbbbef3840 req-8c391f93-a552-42be-8e2e-2a99cdd97d4b service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-c53b1bdb-4229-4573-9063-07cbbbef3840 req-8c391f93-a552-42be-8e2e-2a99cdd97d4b service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:27 user nova-compute[74692]: WARNING nova.compute.manager [req-c53b1bdb-4229-4573-9063-07cbbbef3840 req-8c391f93-a552-42be-8e2e-2a99cdd97d4b service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received unexpected event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with vm_state building and task_state spawning.
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:27 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Waiting for libvirt event about the detach of device tap57868bb5-51 with device alias net1 from instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c is timed out.
Nov 18 18:31:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:42:b5:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap57868bb5-51"/></interface> {{(pid=74692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:42:b5:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap57868bb5-51"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 18 18:31:27 user nova-compute[74692]:   <name>instance-00000005</name>
Nov 18 18:31:27 user nova-compute[74692]:   <uuid>0b9551f1-bc3e-4221-95fc-3b3a4a33251c</uuid>
Nov 18 18:31:27 user nova-compute[74692]:   <metadata>
Nov 18 18:31:27 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:31:27 user nova-compute[74692]:   <nova:package version="0.0.0"/>
Nov 18 18:31:27 user nova-compute[74692]:   <nova:name>tempest-device-tagging-server-796391196</nova:name>
Nov 18 18:31:27 user nova-compute[74692]:   <nova:creationTime>2023-11-18 18:30:32</nova:creationTime>
Nov 18 18:31:27 user nova-compute[74692]:   <nova:flavor name="m1.tiny">
Nov 18 18:31:27 user nova-compute[74692]:     <nova:memory>512</nova:memory>
Nov 18 18:31:27 user nova-compute[74692]:     <nova:disk>1</nova:disk>
Nov 18 18:31:27 user nova-compute[74692]:     <nova:swap>0</nova:swap>
Nov 18 18:31:27 user nova-compute[74692]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:31:27 user nova-compute[74692]:     <nova:vcpus>1</nova:vcpus>
Nov 18 18:31:27 user nova-compute[74692]:   </nova:flavor>
Nov 18 18:31:27 user nova-compute[74692]:   <nova:owner>
Nov 18 18:31:27 user nova-compute[74692]:     <nova:user uuid="39b207b60dbe460f83bf961a995e5342">tempest-TaggedAttachmentsTest-1784015919-project-member</nova:user>
Nov 18 18:31:27 user nova-compute[74692]:     <nova:project uuid="722ae3b1a66f46c9a0679d562b22e470">tempest-TaggedAttachmentsTest-1784015919</nova:project>
Nov 18 18:31:27 user nova-compute[74692]:   </nova:owner>
Nov 18 18:31:27 user nova-compute[74692]:   <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:31:27 user nova-compute[74692]:   <nova:ports>
Nov 18 18:31:27 user nova-compute[74692]:     <nova:port uuid="9935070a-ab06-4411-afeb-9039ecbea8bc">
Nov 18 18:31:27 user nova-compute[74692]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 18:31:27 user nova-compute[74692]:     </nova:port>
Nov 18 18:31:27 user nova-compute[74692]:     <nova:port uuid="57868bb5-51e2-4d1f-b04e-6308332991b6">
Nov 18 18:31:27 user nova-compute[74692]:       <nova:ip type="fixed" address="10.10.10.100" ipVersion="4"/>
Nov 18 18:31:27 user nova-compute[74692]:     </nova:port>
Nov 18 18:31:27 user nova-compute[74692]:   </nova:ports>
Nov 18 18:31:27 user nova-compute[74692]: </nova:instance>
Nov 18 18:31:27 user nova-compute[74692]:   </metadata>
Nov 18 18:31:27 user nova-compute[74692]:   <memory unit='KiB'>524288</memory>
Nov 18 18:31:27 user nova-compute[74692]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 18 18:31:27 user nova-compute[74692]:   <vcpu placement='static'>1</vcpu>
Nov 18 18:31:27 user nova-compute[74692]:   <resource>
Nov 18 18:31:27 user nova-compute[74692]:     <partition>/machine</partition>
Nov 18 18:31:27 user nova-compute[74692]:   </resource>
Nov 18 18:31:27 user nova-compute[74692]:   <sysinfo type='smbios'>
Nov 18 18:31:27 user nova-compute[74692]:     <system>
Nov 18 18:31:27 user nova-compute[74692]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 18 18:31:27 user nova-compute[74692]:       <entry name='product'>OpenStack Nova</entry>
Nov 18 18:31:27 user nova-compute[74692]:       <entry name='version'>0.0.0</entry>
Nov 18 18:31:27 user nova-compute[74692]:       <entry name='serial'>0b9551f1-bc3e-4221-95fc-3b3a4a33251c</entry>
Nov 18 18:31:27 user nova-compute[74692]:       <entry name='uuid'>0b9551f1-bc3e-4221-95fc-3b3a4a33251c</entry>
Nov 18 18:31:27 user nova-compute[74692]:       <entry name='family'>Virtual Machine</entry>
Nov 18 18:31:27 user nova-compute[74692]:     </system>
Nov 18 18:31:27 user nova-compute[74692]:   </sysinfo>
Nov 18 18:31:27 user nova-compute[74692]:   <os>
Nov 18 18:31:27 user nova-compute[74692]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 18 18:31:27 user nova-compute[74692]:     <boot dev='hd'/>
Nov 18 18:31:27 user nova-compute[74692]:     <smbios mode='sysinfo'/>
Nov 18 18:31:27 user nova-compute[74692]:   </os>
Nov 18 18:31:27 user nova-compute[74692]:   <features>
Nov 18 18:31:27 user nova-compute[74692]:     <acpi/>
Nov 18 18:31:27 user nova-compute[74692]:     <apic/>
Nov 18 18:31:27 user nova-compute[74692]:     <vmcoreinfo state='on'/>
Nov 18 18:31:27 user nova-compute[74692]:   </features>
Nov 18 18:31:27 user nova-compute[74692]:   <cpu mode='custom' match='exact' check='full'>
Nov 18 18:31:27 user nova-compute[74692]:     <model fallback='forbid'>Nehalem</model>
Nov 18 18:31:27 user nova-compute[74692]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 18 18:31:27 user nova-compute[74692]:     <feature policy='require' name='vme'/>
Nov 18 18:31:27 user nova-compute[74692]:     <feature policy='require' name='x2apic'/>
Nov 18 18:31:27 user nova-compute[74692]:     <feature policy='require' name='hypervisor'/>
Nov 18 18:31:27 user nova-compute[74692]:   </cpu>
Nov 18 18:31:27 user nova-compute[74692]:   <clock offset='utc'>
Nov 18 18:31:27 user nova-compute[74692]:     <timer name='pit' tickpolicy='delay'/>
Nov 18 18:31:27 user nova-compute[74692]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 18 18:31:27 user nova-compute[74692]:     <timer name='hpet' present='no'/>
Nov 18 18:31:27 user nova-compute[74692]:   </clock>
Nov 18 18:31:27 user nova-compute[74692]:   <on_poweroff>destroy</on_poweroff>
Nov 18 18:31:27 user nova-compute[74692]:   <on_reboot>restart</on_reboot>
Nov 18 18:31:27 user nova-compute[74692]:   <on_crash>destroy</on_crash>
Nov 18 18:31:27 user nova-compute[74692]:   <devices>
Nov 18 18:31:27 user nova-compute[74692]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 18 18:31:27 user nova-compute[74692]:     <disk type='file' device='disk'>
Nov 18 18:31:27 user nova-compute[74692]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 18 18:31:27 user nova-compute[74692]:       <source file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk' index='2'/>
Nov 18 18:31:27 user nova-compute[74692]:       <backingStore type='file' index='3'>
Nov 18 18:31:27 user nova-compute[74692]:         <format type='raw'/>
Nov 18 18:31:27 user nova-compute[74692]:         <source file='/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701'/>
Nov 18 18:31:27 user nova-compute[74692]:         <backingStore/>
Nov 18 18:31:27 user nova-compute[74692]:       </backingStore>
Nov 18 18:31:27 user nova-compute[74692]:       <target dev='vda' bus='virtio'/>
Nov 18 18:31:27 user nova-compute[74692]:       <alias name='virtio-disk0'/>
Nov 18 18:31:27 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 18 18:31:27 user nova-compute[74692]:     </disk>
Nov 18 18:31:27 user nova-compute[74692]:     <disk type='file' device='cdrom'>
Nov 18 18:31:27 user nova-compute[74692]:       <driver name='qemu' type='raw' cache='none'/>
Nov 18 18:31:27 user nova-compute[74692]:       <source file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk.config' index='1'/>
Nov 18 18:31:27 user nova-compute[74692]:       <backingStore/>
Nov 18 18:31:27 user nova-compute[74692]:       <target dev='hda' bus='ide'/>
Nov 18 18:31:27 user nova-compute[74692]:       <readonly/>
Nov 18 18:31:27 user nova-compute[74692]:       <alias name='ide0-0-0'/>
Nov 18 18:31:27 user nova-compute[74692]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 18 18:31:27 user nova-compute[74692]:     </disk>
Nov 18 18:31:27 user nova-compute[74692]:     <controller type='usb' index='0' model='none'>
Nov 18 18:31:27 user nova-compute[74692]:       <alias name='usb'/>
Nov 18 18:31:27 user nova-compute[74692]:     </controller>
Nov 18 18:31:27 user nova-compute[74692]:     <controller type='pci' index='0' model='pci-root'>
Nov 18 18:31:27 user nova-compute[74692]:       <alias name='pci.0'/>
Nov 18 18:31:27 user nova-compute[74692]:     </controller>
Nov 18 18:31:27 user nova-compute[74692]:     <controller type='ide' index='0'>
Nov 18 18:31:27 user nova-compute[74692]:       <alias name='ide'/>
Nov 18 18:31:27 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 18 18:31:27 user nova-compute[74692]:     </controller>
Nov 18 18:31:27 user nova-compute[74692]:     <interface type='ethernet'>
Nov 18 18:31:27 user nova-compute[74692]:       <mac address='fa:16:3e:a9:05:46'/>
Nov 18 18:31:27 user nova-compute[74692]:       <target dev='tap9935070a-ab'/>
Nov 18 18:31:27 user nova-compute[74692]:       <model type='virtio'/>
Nov 18 18:31:27 user nova-compute[74692]:       <mtu size='1442'/>
Nov 18 18:31:27 user nova-compute[74692]:       <alias name='net0'/>
Nov 18 18:31:27 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 18 18:31:27 user nova-compute[74692]:     </interface>
Nov 18 18:31:27 user nova-compute[74692]:     <serial type='pty'>
Nov 18 18:31:27 user nova-compute[74692]:       <source path='/dev/pts/4'/>
Nov 18 18:31:27 user nova-compute[74692]:       <log file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/console.log' append='off'/>
Nov 18 18:31:27 user nova-compute[74692]:       <target type='isa-serial' port='0'>
Nov 18 18:31:27 user nova-compute[74692]:         <model name='isa-serial'/>
Nov 18 18:31:27 user nova-compute[74692]:       </target>
Nov 18 18:31:27 user nova-compute[74692]:       <alias name='serial0'/>
Nov 18 18:31:27 user nova-compute[74692]:     </serial>
Nov 18 18:31:27 user nova-compute[74692]:     <console type='pty' tty='/dev/pts/4'>
Nov 18 18:31:27 user nova-compute[74692]:       <source path='/dev/pts/4'/>
Nov 18 18:31:27 user nova-compute[74692]:       <log file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/console.log' append='off'/>
Nov 18 18:31:27 user nova-compute[74692]:       <target type='serial' port='0'/>
Nov 18 18:31:27 user nova-compute[74692]:       <alias name='serial0'/>
Nov 18 18:31:27 user nova-compute[74692]:     </console>
Nov 18 18:31:27 user nova-compute[74692]:     <input type='mouse' bus='ps2'>
Nov 18 18:31:27 user nova-compute[74692]:       <alias name='input0'/>
Nov 18 18:31:27 user nova-compute[74692]:     </input>
Nov 18 18:31:27 user nova-compute[74692]:     <input type='keyboard' bus='ps2'>
Nov 18 18:31:27 user nova-compute[74692]:       <alias name='input1'/>
Nov 18 18:31:27 user nova-compute[74692]:     </input>
Nov 18 18:31:27 user nova-compute[74692]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 18 18:31:27 user nova-compute[74692]:       <listen type='address' address='0.0.0.0'/>
Nov 18 18:31:27 user nova-compute[74692]:     </graphics>
Nov 18 18:31:27 user nova-compute[74692]:     <audio id='1' type='none'/>
Nov 18 18:31:27 user nova-compute[74692]:     <video>
Nov 18 18:31:27 user nova-compute[74692]:       <model type='virtio' heads='1' primary='yes'/>
Nov 18 18:31:27 user nova-compute[74692]:       <alias name='video0'/>
Nov 18 18:31:27 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 18 18:31:27 user nova-compute[74692]:     </video>
Nov 18 18:31:27 user nova-compute[74692]:     <memballoon model='virtio'>
Nov 18 18:31:27 user nova-compute[74692]:       <stats period='10'/>
Nov 18 18:31:27 user nova-compute[74692]:       <alias name='balloon0'/>
Nov 18 18:31:27 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 18 18:31:27 user nova-compute[74692]:     </memballoon>
Nov 18 18:31:27 user nova-compute[74692]:     <rng model='virtio'>
Nov 18 18:31:27 user nova-compute[74692]:       <backend model='random'>/dev/urandom</backend>
Nov 18 18:31:27 user nova-compute[74692]:       <alias name='rng0'/>
Nov 18 18:31:27 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 18 18:31:27 user nova-compute[74692]:     </rng>
Nov 18 18:31:27 user nova-compute[74692]:   </devices>
Nov 18 18:31:27 user nova-compute[74692]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 18 18:31:27 user nova-compute[74692]:     <label>libvirt-0b9551f1-bc3e-4221-95fc-3b3a4a33251c</label>
Nov 18 18:31:27 user nova-compute[74692]:     <imagelabel>libvirt-0b9551f1-bc3e-4221-95fc-3b3a4a33251c</imagelabel>
Nov 18 18:31:27 user nova-compute[74692]:   </seclabel>
Nov 18 18:31:27 user nova-compute[74692]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 18 18:31:27 user nova-compute[74692]:     <label>+64055:+108</label>
Nov 18 18:31:27 user nova-compute[74692]:     <imagelabel>+64055:+108</imagelabel>
Nov 18 18:31:27 user nova-compute[74692]:   </seclabel>
Nov 18 18:31:27 user nova-compute[74692]: </domain>
Nov 18 18:31:27 user nova-compute[74692]:  {{(pid=74692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 18 18:31:27 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Successfully detached device tap57868bb5-51 from instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c from the live domain config.
Nov 18 18:31:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-796391196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-796391196',id=5,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3gJO/TwdDSf1yN3ZchrXCyXLk6TezdqH7o7X0wfuK4mUN+34DlZO1554usfJkK2dsoaKwNDHuloE+Z5C2eKZ2s7LsvuKmsXer8Y96AOq7N/zPoRVeXal22WhpetQTiRg==',key_name='tempest-keypair-1001776154',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:28:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='722ae3b1a66f46c9a0679d562b22e470',ramdisk_id='',reservation_id='r-j9yyn7m1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1784015919',owner_user_name='tempest-TaggedAttachmentsTest-1784015919-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:28:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39b207b60dbe460f83bf961a995e5342',uuid=0b9551f1-bc3e-4221-95fc-3b3a4a33251c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57868bb5-51e2-4d1f-b04e-6308332991b6", "address": "fa:16:3e:42:b5:34", "network": {"id": "007966f5-554c-4e4a-a409-9aa0d874260b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-279700966", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57868bb5-51", "ovs_interfaceid": "57868bb5-51e2-4d1f-b04e-6308332991b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Converting VIF {"id": "57868bb5-51e2-4d1f-b04e-6308332991b6", "address": "fa:16:3e:42:b5:34", "network": {"id": "007966f5-554c-4e4a-a409-9aa0d874260b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-279700966", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57868bb5-51", "ovs_interfaceid": "57868bb5-51e2-4d1f-b04e-6308332991b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:b5:34,bridge_name='br-int',has_traffic_filtering=True,id=57868bb5-51e2-4d1f-b04e-6308332991b6,network=Network(007966f5-554c-4e4a-a409-9aa0d874260b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57868bb5-51') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG os_vif [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:b5:34,bridge_name='br-int',has_traffic_filtering=True,id=57868bb5-51e2-4d1f-b04e-6308332991b6,network=Network(007966f5-554c-4e4a-a409-9aa0d874260b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57868bb5-51') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57868bb5-51, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2ab4d4c-614e-4e56-bc80-f6bbfb331127) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:27 user nova-compute[74692]: INFO os_vif [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:b5:34,bridge_name='br-int',has_traffic_filtering=True,id=57868bb5-51e2-4d1f-b04e-6308332991b6,network=Network(007966f5-554c-4e4a-a409-9aa0d874260b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57868bb5-51')
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:31:28 user nova-compute[74692]:   <nova:package version="0.0.0"/>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:name>tempest-device-tagging-server-796391196</nova:name>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:creationTime>2023-11-18 18:31:28</nova:creationTime>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:flavor name="m1.tiny">
Nov 18 18:31:28 user nova-compute[74692]:     <nova:memory>512</nova:memory>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:disk>1</nova:disk>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:swap>0</nova:swap>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:vcpus>1</nova:vcpus>
Nov 18 18:31:28 user nova-compute[74692]:   </nova:flavor>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:owner>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:user uuid="39b207b60dbe460f83bf961a995e5342">tempest-TaggedAttachmentsTest-1784015919-project-member</nova:user>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:project uuid="722ae3b1a66f46c9a0679d562b22e470">tempest-TaggedAttachmentsTest-1784015919</nova:project>
Nov 18 18:31:28 user nova-compute[74692]:   </nova:owner>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:ports>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:port uuid="9935070a-ab06-4411-afeb-9039ecbea8bc">
Nov 18 18:31:28 user nova-compute[74692]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 18:31:28 user nova-compute[74692]:     </nova:port>
Nov 18 18:31:28 user nova-compute[74692]:   </nova:ports>
Nov 18 18:31:28 user nova-compute[74692]: </nova:instance>
Nov 18 18:31:28 user nova-compute[74692]:  {{(pid=74692) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received event network-vif-deleted-57868bb5-51e2-4d1f-b04e-6308332991b6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:28 user nova-compute[74692]: INFO nova.compute.manager [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Neutron deleted interface 57868bb5-51e2-4d1f-b04e-6308332991b6; detaching it from the instance and deleting it from the info cache
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.network.neutron [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Updating instance_info_cache with network_info: [{"id": "9935070a-ab06-4411-afeb-9039ecbea8bc", "address": "fa:16:3e:a9:05:46", "network": {"id": "da3ff499-fbcd-4f27-bd2a-6f4d23814cc6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1280089118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9935070a-ab", "ovs_interfaceid": "9935070a-ab06-4411-afeb-9039ecbea8bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquired lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.network.neutron [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.objects.instance [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] Lazy-loading 'system_metadata' on Instance uuid 0b9551f1-bc3e-4221-95fc-3b3a4a33251c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.objects.instance [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] Lazy-loading 'flavor' on Instance uuid 0b9551f1-bc3e-4221-95fc-3b3a4a33251c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.objects.base [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] Object Instance<0b9551f1-bc3e-4221-95fc-3b3a4a33251c> lazy-loaded attributes: system_metadata,flavor {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-796391196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-796391196',id=5,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3gJO/TwdDSf1yN3ZchrXCyXLk6TezdqH7o7X0wfuK4mUN+34DlZO1554usfJkK2dsoaKwNDHuloE+Z5C2eKZ2s7LsvuKmsXer8Y96AOq7N/zPoRVeXal22WhpetQTiRg==',key_name='tempest-keypair-1001776154',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:28:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='722ae3b1a66f46c9a0679d562b22e470',ramdisk_id='',reservation_id='r-j9yyn7m1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1784015919',owner_user_name='tempest-TaggedAttachmentsTest-1784015919-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:28:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39b207b60dbe460f83bf961a995e5342',uuid=0b9551f1-bc3e-4221-95fc-3b3a4a33251c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57868bb5-51e2-4d1f-b04e-6308332991b6", "address": "fa:16:3e:42:b5:34", "network": {"id": "007966f5-554c-4e4a-a409-9aa0d874260b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-279700966", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57868bb5-51", "ovs_interfaceid": "57868bb5-51e2-4d1f-b04e-6308332991b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.network.os_vif_util [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] Converting VIF {"id": "57868bb5-51e2-4d1f-b04e-6308332991b6", "address": "fa:16:3e:42:b5:34", "network": {"id": "007966f5-554c-4e4a-a409-9aa0d874260b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-279700966", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57868bb5-51", "ovs_interfaceid": "57868bb5-51e2-4d1f-b04e-6308332991b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.network.os_vif_util [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:b5:34,bridge_name='br-int',has_traffic_filtering=True,id=57868bb5-51e2-4d1f-b04e-6308332991b6,network=Network(007966f5-554c-4e4a-a409-9aa0d874260b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57868bb5-51') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:42:b5:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap57868bb5-51"/></interface> {{(pid=74692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:42:b5:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap57868bb5-51"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 18 18:31:28 user nova-compute[74692]:   <name>instance-00000005</name>
Nov 18 18:31:28 user nova-compute[74692]:   <uuid>0b9551f1-bc3e-4221-95fc-3b3a4a33251c</uuid>
Nov 18 18:31:28 user nova-compute[74692]:   <metadata>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:31:28 user nova-compute[74692]:   <nova:package version="0.0.0"/>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:name>tempest-device-tagging-server-796391196</nova:name>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:creationTime>2023-11-18 18:31:28</nova:creationTime>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:flavor name="m1.tiny">
Nov 18 18:31:28 user nova-compute[74692]:     <nova:memory>512</nova:memory>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:disk>1</nova:disk>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:swap>0</nova:swap>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:vcpus>1</nova:vcpus>
Nov 18 18:31:28 user nova-compute[74692]:   </nova:flavor>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:owner>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:user uuid="39b207b60dbe460f83bf961a995e5342">tempest-TaggedAttachmentsTest-1784015919-project-member</nova:user>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:project uuid="722ae3b1a66f46c9a0679d562b22e470">tempest-TaggedAttachmentsTest-1784015919</nova:project>
Nov 18 18:31:28 user nova-compute[74692]:   </nova:owner>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:ports>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:port uuid="9935070a-ab06-4411-afeb-9039ecbea8bc">
Nov 18 18:31:28 user nova-compute[74692]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 18:31:28 user nova-compute[74692]:     </nova:port>
Nov 18 18:31:28 user nova-compute[74692]:   </nova:ports>
Nov 18 18:31:28 user nova-compute[74692]: </nova:instance>
Nov 18 18:31:28 user nova-compute[74692]:   </metadata>
Nov 18 18:31:28 user nova-compute[74692]:   <memory unit='KiB'>524288</memory>
Nov 18 18:31:28 user nova-compute[74692]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 18 18:31:28 user nova-compute[74692]:   <vcpu placement='static'>1</vcpu>
Nov 18 18:31:28 user nova-compute[74692]:   <resource>
Nov 18 18:31:28 user nova-compute[74692]:     <partition>/machine</partition>
Nov 18 18:31:28 user nova-compute[74692]:   </resource>
Nov 18 18:31:28 user nova-compute[74692]:   <sysinfo type='smbios'>
Nov 18 18:31:28 user nova-compute[74692]:     <system>
Nov 18 18:31:28 user nova-compute[74692]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 18 18:31:28 user nova-compute[74692]:       <entry name='product'>OpenStack Nova</entry>
Nov 18 18:31:28 user nova-compute[74692]:       <entry name='version'>0.0.0</entry>
Nov 18 18:31:28 user nova-compute[74692]:       <entry name='serial'>0b9551f1-bc3e-4221-95fc-3b3a4a33251c</entry>
Nov 18 18:31:28 user nova-compute[74692]:       <entry name='uuid'>0b9551f1-bc3e-4221-95fc-3b3a4a33251c</entry>
Nov 18 18:31:28 user nova-compute[74692]:       <entry name='family'>Virtual Machine</entry>
Nov 18 18:31:28 user nova-compute[74692]:     </system>
Nov 18 18:31:28 user nova-compute[74692]:   </sysinfo>
Nov 18 18:31:28 user nova-compute[74692]:   <os>
Nov 18 18:31:28 user nova-compute[74692]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 18 18:31:28 user nova-compute[74692]:     <boot dev='hd'/>
Nov 18 18:31:28 user nova-compute[74692]:     <smbios mode='sysinfo'/>
Nov 18 18:31:28 user nova-compute[74692]:   </os>
Nov 18 18:31:28 user nova-compute[74692]:   <features>
Nov 18 18:31:28 user nova-compute[74692]:     <acpi/>
Nov 18 18:31:28 user nova-compute[74692]:     <apic/>
Nov 18 18:31:28 user nova-compute[74692]:     <vmcoreinfo state='on'/>
Nov 18 18:31:28 user nova-compute[74692]:   </features>
Nov 18 18:31:28 user nova-compute[74692]:   <cpu mode='custom' match='exact' check='full'>
Nov 18 18:31:28 user nova-compute[74692]:     <model fallback='forbid'>Nehalem</model>
Nov 18 18:31:28 user nova-compute[74692]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 18 18:31:28 user nova-compute[74692]:     <feature policy='require' name='vme'/>
Nov 18 18:31:28 user nova-compute[74692]:     <feature policy='require' name='x2apic'/>
Nov 18 18:31:28 user nova-compute[74692]:     <feature policy='require' name='hypervisor'/>
Nov 18 18:31:28 user nova-compute[74692]:   </cpu>
Nov 18 18:31:28 user nova-compute[74692]:   <clock offset='utc'>
Nov 18 18:31:28 user nova-compute[74692]:     <timer name='pit' tickpolicy='delay'/>
Nov 18 18:31:28 user nova-compute[74692]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 18 18:31:28 user nova-compute[74692]:     <timer name='hpet' present='no'/>
Nov 18 18:31:28 user nova-compute[74692]:   </clock>
Nov 18 18:31:28 user nova-compute[74692]:   <on_poweroff>destroy</on_poweroff>
Nov 18 18:31:28 user nova-compute[74692]:   <on_reboot>restart</on_reboot>
Nov 18 18:31:28 user nova-compute[74692]:   <on_crash>destroy</on_crash>
Nov 18 18:31:28 user nova-compute[74692]:   <devices>
Nov 18 18:31:28 user nova-compute[74692]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 18 18:31:28 user nova-compute[74692]:     <disk type='file' device='disk'>
Nov 18 18:31:28 user nova-compute[74692]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 18 18:31:28 user nova-compute[74692]:       <source file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk' index='2'/>
Nov 18 18:31:28 user nova-compute[74692]:       <backingStore type='file' index='3'>
Nov 18 18:31:28 user nova-compute[74692]:         <format type='raw'/>
Nov 18 18:31:28 user nova-compute[74692]:         <source file='/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701'/>
Nov 18 18:31:28 user nova-compute[74692]:         <backingStore/>
Nov 18 18:31:28 user nova-compute[74692]:       </backingStore>
Nov 18 18:31:28 user nova-compute[74692]:       <target dev='vda' bus='virtio'/>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='virtio-disk0'/>
Nov 18 18:31:28 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </disk>
Nov 18 18:31:28 user nova-compute[74692]:     <disk type='file' device='cdrom'>
Nov 18 18:31:28 user nova-compute[74692]:       <driver name='qemu' type='raw' cache='none'/>
Nov 18 18:31:28 user nova-compute[74692]:       <source file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk.config' index='1'/>
Nov 18 18:31:28 user nova-compute[74692]:       <backingStore/>
Nov 18 18:31:28 user nova-compute[74692]:       <target dev='hda' bus='ide'/>
Nov 18 18:31:28 user nova-compute[74692]:       <readonly/>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='ide0-0-0'/>
Nov 18 18:31:28 user nova-compute[74692]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </disk>
Nov 18 18:31:28 user nova-compute[74692]:     <controller type='usb' index='0' model='none'>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='usb'/>
Nov 18 18:31:28 user nova-compute[74692]:     </controller>
Nov 18 18:31:28 user nova-compute[74692]:     <controller type='pci' index='0' model='pci-root'>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='pci.0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </controller>
Nov 18 18:31:28 user nova-compute[74692]:     <controller type='ide' index='0'>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='ide'/>
Nov 18 18:31:28 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 18 18:31:28 user nova-compute[74692]:     </controller>
Nov 18 18:31:28 user nova-compute[74692]:     <interface type='ethernet'>
Nov 18 18:31:28 user nova-compute[74692]:       <mac address='fa:16:3e:a9:05:46'/>
Nov 18 18:31:28 user nova-compute[74692]:       <target dev='tap9935070a-ab'/>
Nov 18 18:31:28 user nova-compute[74692]:       <model type='virtio'/>
Nov 18 18:31:28 user nova-compute[74692]:       <mtu size='1442'/>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='net0'/>
Nov 18 18:31:28 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </interface>
Nov 18 18:31:28 user nova-compute[74692]:     <serial type='pty'>
Nov 18 18:31:28 user nova-compute[74692]:       <source path='/dev/pts/4'/>
Nov 18 18:31:28 user nova-compute[74692]:       <log file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/console.log' append='off'/>
Nov 18 18:31:28 user nova-compute[74692]:       <target type='isa-serial' port='0'>
Nov 18 18:31:28 user nova-compute[74692]:         <model name='isa-serial'/>
Nov 18 18:31:28 user nova-compute[74692]:       </target>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='serial0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </serial>
Nov 18 18:31:28 user nova-compute[74692]:     <console type='pty' tty='/dev/pts/4'>
Nov 18 18:31:28 user nova-compute[74692]:       <source path='/dev/pts/4'/>
Nov 18 18:31:28 user nova-compute[74692]:       <log file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/console.log' append='off'/>
Nov 18 18:31:28 user nova-compute[74692]:       <target type='serial' port='0'/>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='serial0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </console>
Nov 18 18:31:28 user nova-compute[74692]:     <input type='mouse' bus='ps2'>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='input0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </input>
Nov 18 18:31:28 user nova-compute[74692]:     <input type='keyboard' bus='ps2'>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='input1'/>
Nov 18 18:31:28 user nova-compute[74692]:     </input>
Nov 18 18:31:28 user nova-compute[74692]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 18 18:31:28 user nova-compute[74692]:       <listen type='address' address='0.0.0.0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </graphics>
Nov 18 18:31:28 user nova-compute[74692]:     <audio id='1' type='none'/>
Nov 18 18:31:28 user nova-compute[74692]:     <video>
Nov 18 18:31:28 user nova-compute[74692]:       <model type='virtio' heads='1' primary='yes'/>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='video0'/>
Nov 18 18:31:28 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </video>
Nov 18 18:31:28 user nova-compute[74692]:     <memballoon model='virtio'>
Nov 18 18:31:28 user nova-compute[74692]:       <stats period='10'/>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='balloon0'/>
Nov 18 18:31:28 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </memballoon>
Nov 18 18:31:28 user nova-compute[74692]:     <rng model='virtio'>
Nov 18 18:31:28 user nova-compute[74692]:       <backend model='random'>/dev/urandom</backend>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='rng0'/>
Nov 18 18:31:28 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </rng>
Nov 18 18:31:28 user nova-compute[74692]:   </devices>
Nov 18 18:31:28 user nova-compute[74692]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 18 18:31:28 user nova-compute[74692]:     <label>libvirt-0b9551f1-bc3e-4221-95fc-3b3a4a33251c</label>
Nov 18 18:31:28 user nova-compute[74692]:     <imagelabel>libvirt-0b9551f1-bc3e-4221-95fc-3b3a4a33251c</imagelabel>
Nov 18 18:31:28 user nova-compute[74692]:   </seclabel>
Nov 18 18:31:28 user nova-compute[74692]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 18 18:31:28 user nova-compute[74692]:     <label>+64055:+108</label>
Nov 18 18:31:28 user nova-compute[74692]:     <imagelabel>+64055:+108</imagelabel>
Nov 18 18:31:28 user nova-compute[74692]:   </seclabel>
Nov 18 18:31:28 user nova-compute[74692]: </domain>
Nov 18 18:31:28 user nova-compute[74692]:  {{(pid=74692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:42:b5:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap57868bb5-51"/></interface> {{(pid=74692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:42:b5:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap57868bb5-51"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 18 18:31:28 user nova-compute[74692]:   <name>instance-00000005</name>
Nov 18 18:31:28 user nova-compute[74692]:   <uuid>0b9551f1-bc3e-4221-95fc-3b3a4a33251c</uuid>
Nov 18 18:31:28 user nova-compute[74692]:   <metadata>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:31:28 user nova-compute[74692]:   <nova:package version="0.0.0"/>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:name>tempest-device-tagging-server-796391196</nova:name>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:creationTime>2023-11-18 18:31:28</nova:creationTime>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:flavor name="m1.tiny">
Nov 18 18:31:28 user nova-compute[74692]:     <nova:memory>512</nova:memory>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:disk>1</nova:disk>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:swap>0</nova:swap>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:vcpus>1</nova:vcpus>
Nov 18 18:31:28 user nova-compute[74692]:   </nova:flavor>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:owner>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:user uuid="39b207b60dbe460f83bf961a995e5342">tempest-TaggedAttachmentsTest-1784015919-project-member</nova:user>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:project uuid="722ae3b1a66f46c9a0679d562b22e470">tempest-TaggedAttachmentsTest-1784015919</nova:project>
Nov 18 18:31:28 user nova-compute[74692]:   </nova:owner>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:ports>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:port uuid="9935070a-ab06-4411-afeb-9039ecbea8bc">
Nov 18 18:31:28 user nova-compute[74692]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 18:31:28 user nova-compute[74692]:     </nova:port>
Nov 18 18:31:28 user nova-compute[74692]:   </nova:ports>
Nov 18 18:31:28 user nova-compute[74692]: </nova:instance>
Nov 18 18:31:28 user nova-compute[74692]:   </metadata>
Nov 18 18:31:28 user nova-compute[74692]:   <memory unit='KiB'>524288</memory>
Nov 18 18:31:28 user nova-compute[74692]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 18 18:31:28 user nova-compute[74692]:   <vcpu placement='static'>1</vcpu>
Nov 18 18:31:28 user nova-compute[74692]:   <resource>
Nov 18 18:31:28 user nova-compute[74692]:     <partition>/machine</partition>
Nov 18 18:31:28 user nova-compute[74692]:   </resource>
Nov 18 18:31:28 user nova-compute[74692]:   <sysinfo type='smbios'>
Nov 18 18:31:28 user nova-compute[74692]:     <system>
Nov 18 18:31:28 user nova-compute[74692]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 18 18:31:28 user nova-compute[74692]:       <entry name='product'>OpenStack Nova</entry>
Nov 18 18:31:28 user nova-compute[74692]:       <entry name='version'>0.0.0</entry>
Nov 18 18:31:28 user nova-compute[74692]:       <entry name='serial'>0b9551f1-bc3e-4221-95fc-3b3a4a33251c</entry>
Nov 18 18:31:28 user nova-compute[74692]:       <entry name='uuid'>0b9551f1-bc3e-4221-95fc-3b3a4a33251c</entry>
Nov 18 18:31:28 user nova-compute[74692]:       <entry name='family'>Virtual Machine</entry>
Nov 18 18:31:28 user nova-compute[74692]:     </system>
Nov 18 18:31:28 user nova-compute[74692]:   </sysinfo>
Nov 18 18:31:28 user nova-compute[74692]:   <os>
Nov 18 18:31:28 user nova-compute[74692]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 18 18:31:28 user nova-compute[74692]:     <boot dev='hd'/>
Nov 18 18:31:28 user nova-compute[74692]:     <smbios mode='sysinfo'/>
Nov 18 18:31:28 user nova-compute[74692]:   </os>
Nov 18 18:31:28 user nova-compute[74692]:   <features>
Nov 18 18:31:28 user nova-compute[74692]:     <acpi/>
Nov 18 18:31:28 user nova-compute[74692]:     <apic/>
Nov 18 18:31:28 user nova-compute[74692]:     <vmcoreinfo state='on'/>
Nov 18 18:31:28 user nova-compute[74692]:   </features>
Nov 18 18:31:28 user nova-compute[74692]:   <cpu mode='custom' match='exact' check='full'>
Nov 18 18:31:28 user nova-compute[74692]:     <model fallback='forbid'>Nehalem</model>
Nov 18 18:31:28 user nova-compute[74692]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 18 18:31:28 user nova-compute[74692]:     <feature policy='require' name='vme'/>
Nov 18 18:31:28 user nova-compute[74692]:     <feature policy='require' name='x2apic'/>
Nov 18 18:31:28 user nova-compute[74692]:     <feature policy='require' name='hypervisor'/>
Nov 18 18:31:28 user nova-compute[74692]:   </cpu>
Nov 18 18:31:28 user nova-compute[74692]:   <clock offset='utc'>
Nov 18 18:31:28 user nova-compute[74692]:     <timer name='pit' tickpolicy='delay'/>
Nov 18 18:31:28 user nova-compute[74692]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 18 18:31:28 user nova-compute[74692]:     <timer name='hpet' present='no'/>
Nov 18 18:31:28 user nova-compute[74692]:   </clock>
Nov 18 18:31:28 user nova-compute[74692]:   <on_poweroff>destroy</on_poweroff>
Nov 18 18:31:28 user nova-compute[74692]:   <on_reboot>restart</on_reboot>
Nov 18 18:31:28 user nova-compute[74692]:   <on_crash>destroy</on_crash>
Nov 18 18:31:28 user nova-compute[74692]:   <devices>
Nov 18 18:31:28 user nova-compute[74692]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 18 18:31:28 user nova-compute[74692]:     <disk type='file' device='disk'>
Nov 18 18:31:28 user nova-compute[74692]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 18 18:31:28 user nova-compute[74692]:       <source file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk' index='2'/>
Nov 18 18:31:28 user nova-compute[74692]:       <backingStore type='file' index='3'>
Nov 18 18:31:28 user nova-compute[74692]:         <format type='raw'/>
Nov 18 18:31:28 user nova-compute[74692]:         <source file='/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701'/>
Nov 18 18:31:28 user nova-compute[74692]:         <backingStore/>
Nov 18 18:31:28 user nova-compute[74692]:       </backingStore>
Nov 18 18:31:28 user nova-compute[74692]:       <target dev='vda' bus='virtio'/>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='virtio-disk0'/>
Nov 18 18:31:28 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </disk>
Nov 18 18:31:28 user nova-compute[74692]:     <disk type='file' device='cdrom'>
Nov 18 18:31:28 user nova-compute[74692]:       <driver name='qemu' type='raw' cache='none'/>
Nov 18 18:31:28 user nova-compute[74692]:       <source file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/disk.config' index='1'/>
Nov 18 18:31:28 user nova-compute[74692]:       <backingStore/>
Nov 18 18:31:28 user nova-compute[74692]:       <target dev='hda' bus='ide'/>
Nov 18 18:31:28 user nova-compute[74692]:       <readonly/>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='ide0-0-0'/>
Nov 18 18:31:28 user nova-compute[74692]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </disk>
Nov 18 18:31:28 user nova-compute[74692]:     <controller type='usb' index='0' model='none'>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='usb'/>
Nov 18 18:31:28 user nova-compute[74692]:     </controller>
Nov 18 18:31:28 user nova-compute[74692]:     <controller type='pci' index='0' model='pci-root'>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='pci.0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </controller>
Nov 18 18:31:28 user nova-compute[74692]:     <controller type='ide' index='0'>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='ide'/>
Nov 18 18:31:28 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 18 18:31:28 user nova-compute[74692]:     </controller>
Nov 18 18:31:28 user nova-compute[74692]:     <interface type='ethernet'>
Nov 18 18:31:28 user nova-compute[74692]:       <mac address='fa:16:3e:a9:05:46'/>
Nov 18 18:31:28 user nova-compute[74692]:       <target dev='tap9935070a-ab'/>
Nov 18 18:31:28 user nova-compute[74692]:       <model type='virtio'/>
Nov 18 18:31:28 user nova-compute[74692]:       <mtu size='1442'/>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='net0'/>
Nov 18 18:31:28 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </interface>
Nov 18 18:31:28 user nova-compute[74692]:     <serial type='pty'>
Nov 18 18:31:28 user nova-compute[74692]:       <source path='/dev/pts/4'/>
Nov 18 18:31:28 user nova-compute[74692]:       <log file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/console.log' append='off'/>
Nov 18 18:31:28 user nova-compute[74692]:       <target type='isa-serial' port='0'>
Nov 18 18:31:28 user nova-compute[74692]:         <model name='isa-serial'/>
Nov 18 18:31:28 user nova-compute[74692]:       </target>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='serial0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </serial>
Nov 18 18:31:28 user nova-compute[74692]:     <console type='pty' tty='/dev/pts/4'>
Nov 18 18:31:28 user nova-compute[74692]:       <source path='/dev/pts/4'/>
Nov 18 18:31:28 user nova-compute[74692]:       <log file='/opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c/console.log' append='off'/>
Nov 18 18:31:28 user nova-compute[74692]:       <target type='serial' port='0'/>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='serial0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </console>
Nov 18 18:31:28 user nova-compute[74692]:     <input type='mouse' bus='ps2'>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='input0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </input>
Nov 18 18:31:28 user nova-compute[74692]:     <input type='keyboard' bus='ps2'>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='input1'/>
Nov 18 18:31:28 user nova-compute[74692]:     </input>
Nov 18 18:31:28 user nova-compute[74692]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 18 18:31:28 user nova-compute[74692]:       <listen type='address' address='0.0.0.0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </graphics>
Nov 18 18:31:28 user nova-compute[74692]:     <audio id='1' type='none'/>
Nov 18 18:31:28 user nova-compute[74692]:     <video>
Nov 18 18:31:28 user nova-compute[74692]:       <model type='virtio' heads='1' primary='yes'/>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='video0'/>
Nov 18 18:31:28 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </video>
Nov 18 18:31:28 user nova-compute[74692]:     <memballoon model='virtio'>
Nov 18 18:31:28 user nova-compute[74692]:       <stats period='10'/>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='balloon0'/>
Nov 18 18:31:28 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </memballoon>
Nov 18 18:31:28 user nova-compute[74692]:     <rng model='virtio'>
Nov 18 18:31:28 user nova-compute[74692]:       <backend model='random'>/dev/urandom</backend>
Nov 18 18:31:28 user nova-compute[74692]:       <alias name='rng0'/>
Nov 18 18:31:28 user nova-compute[74692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 18 18:31:28 user nova-compute[74692]:     </rng>
Nov 18 18:31:28 user nova-compute[74692]:   </devices>
Nov 18 18:31:28 user nova-compute[74692]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 18 18:31:28 user nova-compute[74692]:     <label>libvirt-0b9551f1-bc3e-4221-95fc-3b3a4a33251c</label>
Nov 18 18:31:28 user nova-compute[74692]:     <imagelabel>libvirt-0b9551f1-bc3e-4221-95fc-3b3a4a33251c</imagelabel>
Nov 18 18:31:28 user nova-compute[74692]:   </seclabel>
Nov 18 18:31:28 user nova-compute[74692]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 18 18:31:28 user nova-compute[74692]:     <label>+64055:+108</label>
Nov 18 18:31:28 user nova-compute[74692]:     <imagelabel>+64055:+108</imagelabel>
Nov 18 18:31:28 user nova-compute[74692]:   </seclabel>
Nov 18 18:31:28 user nova-compute[74692]: </domain>
Nov 18 18:31:28 user nova-compute[74692]:  {{(pid=74692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 18 18:31:28 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Detaching interface fa:16:3e:42:b5:34 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap57868bb5-51' not found.
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-796391196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-796391196',id=5,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3gJO/TwdDSf1yN3ZchrXCyXLk6TezdqH7o7X0wfuK4mUN+34DlZO1554usfJkK2dsoaKwNDHuloE+Z5C2eKZ2s7LsvuKmsXer8Y96AOq7N/zPoRVeXal22WhpetQTiRg==',key_name='tempest-keypair-1001776154',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:28:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='722ae3b1a66f46c9a0679d562b22e470',ramdisk_id='',reservation_id='r-j9yyn7m1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1784015919',owner_user_name='tempest-TaggedAttachmentsTest-1784015919-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:28:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39b207b60dbe460f83bf961a995e5342',uuid=0b9551f1-bc3e-4221-95fc-3b3a4a33251c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57868bb5-51e2-4d1f-b04e-6308332991b6", "address": "fa:16:3e:42:b5:34", "network": {"id": "007966f5-554c-4e4a-a409-9aa0d874260b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-279700966", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57868bb5-51", "ovs_interfaceid": "57868bb5-51e2-4d1f-b04e-6308332991b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.network.os_vif_util [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] Converting VIF {"id": "57868bb5-51e2-4d1f-b04e-6308332991b6", "address": "fa:16:3e:42:b5:34", "network": {"id": "007966f5-554c-4e4a-a409-9aa0d874260b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-279700966", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57868bb5-51", "ovs_interfaceid": "57868bb5-51e2-4d1f-b04e-6308332991b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.network.os_vif_util [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:b5:34,bridge_name='br-int',has_traffic_filtering=True,id=57868bb5-51e2-4d1f-b04e-6308332991b6,network=Network(007966f5-554c-4e4a-a409-9aa0d874260b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57868bb5-51') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG os_vif [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:b5:34,bridge_name='br-int',has_traffic_filtering=True,id=57868bb5-51e2-4d1f-b04e-6308332991b6,network=Network(007966f5-554c-4e4a-a409-9aa0d874260b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57868bb5-51') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57868bb5-51, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:31:28 user nova-compute[74692]: INFO os_vif [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:b5:34,bridge_name='br-int',has_traffic_filtering=True,id=57868bb5-51e2-4d1f-b04e-6308332991b6,network=Network(007966f5-554c-4e4a-a409-9aa0d874260b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57868bb5-51')
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [req-cc2daeb0-cedd-4c52-b1d5-dd68f40dd9c2 req-b7463790-a3a0-42e4-bffa-23ad18c62215 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:31:28 user nova-compute[74692]:   <nova:package version="0.0.0"/>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:name>tempest-device-tagging-server-796391196</nova:name>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:creationTime>2023-11-18 18:31:28</nova:creationTime>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:flavor name="m1.tiny">
Nov 18 18:31:28 user nova-compute[74692]:     <nova:memory>512</nova:memory>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:disk>1</nova:disk>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:swap>0</nova:swap>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:vcpus>1</nova:vcpus>
Nov 18 18:31:28 user nova-compute[74692]:   </nova:flavor>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:owner>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:user uuid="39b207b60dbe460f83bf961a995e5342">tempest-TaggedAttachmentsTest-1784015919-project-member</nova:user>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:project uuid="722ae3b1a66f46c9a0679d562b22e470">tempest-TaggedAttachmentsTest-1784015919</nova:project>
Nov 18 18:31:28 user nova-compute[74692]:   </nova:owner>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:31:28 user nova-compute[74692]:   <nova:ports>
Nov 18 18:31:28 user nova-compute[74692]:     <nova:port uuid="9935070a-ab06-4411-afeb-9039ecbea8bc">
Nov 18 18:31:28 user nova-compute[74692]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 18:31:28 user nova-compute[74692]:     </nova:port>
Nov 18 18:31:28 user nova-compute[74692]:   </nova:ports>
Nov 18 18:31:28 user nova-compute[74692]: </nova:instance>
Nov 18 18:31:28 user nova-compute[74692]:  {{(pid=74692) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG nova.network.neutron [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Updating instance_info_cache with network_info: [{"id": "9935070a-ab06-4411-afeb-9039ecbea8bc", "address": "fa:16:3e:a9:05:46", "network": {"id": "da3ff499-fbcd-4f27-bd2a-6f4d23814cc6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1280089118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9935070a-ab", "ovs_interfaceid": "9935070a-ab06-4411-afeb-9039ecbea8bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Releasing lock "refresh_cache-0b9551f1-bc3e-4221-95fc-3b3a4a33251c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:31:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be15976b-4912-4302-b83a-c96c7fc9baa1 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "interface-0b9551f1-bc3e-4221-95fc-3b3a4a33251c-57868bb5-51e2-4d1f-b04e-6308332991b6" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.431s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:29 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:31:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:31:29 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Instance spawned successfully.
Nov 18 18:31:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:31:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:29 user nova-compute[74692]: INFO nova.compute.manager [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 18 18:31:29 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:31:29 user nova-compute[74692]: INFO nova.compute.manager [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Took 6.05 seconds to build instance.
Nov 18 18:31:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b48beff5-fabe-48fa-a4ca-f3beb2700a69 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.145s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-5475e464-3ad0-445f-8e84-b81b1387e390 req-8d6bdf48-97f4-46c7-9194-e93dbb8287f1 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5475e464-3ad0-445f-8e84-b81b1387e390 req-8d6bdf48-97f4-46c7-9194-e93dbb8287f1 service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5475e464-3ad0-445f-8e84-b81b1387e390 req-8d6bdf48-97f4-46c7-9194-e93dbb8287f1 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5475e464-3ad0-445f-8e84-b81b1387e390 req-8d6bdf48-97f4-46c7-9194-e93dbb8287f1 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-5475e464-3ad0-445f-8e84-b81b1387e390 req-8d6bdf48-97f4-46c7-9194-e93dbb8287f1 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:29 user nova-compute[74692]: WARNING nova.compute.manager [req-5475e464-3ad0-445f-8e84-b81b1387e390 req-8d6bdf48-97f4-46c7-9194-e93dbb8287f1 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received unexpected event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with vm_state active and task_state None.
Nov 18 18:31:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-67b05818-9769-4a69-b3ba-11a45cbad5a8 req-84a8e612-7cba-415e-8a7e-4297b13d8de8 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-changed-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-67b05818-9769-4a69-b3ba-11a45cbad5a8 req-84a8e612-7cba-415e-8a7e-4297b13d8de8 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Refreshing instance network info cache due to event network-changed-bdd4ef83-835c-42c0-a7e0-0432ab03618f. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-67b05818-9769-4a69-b3ba-11a45cbad5a8 req-84a8e612-7cba-415e-8a7e-4297b13d8de8 service nova] Acquiring lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-67b05818-9769-4a69-b3ba-11a45cbad5a8 req-84a8e612-7cba-415e-8a7e-4297b13d8de8 service nova] Acquired lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG nova.network.neutron [req-67b05818-9769-4a69-b3ba-11a45cbad5a8 req-84a8e612-7cba-415e-8a7e-4297b13d8de8 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Refreshing network info cache for port bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:31:34 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d17447e1-2e91-4d25-bf3a-3705927ec122 is timed out.
Nov 18 18:31:34 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Successfully detached device vdb from instance d17447e1-2e91-4d25-bf3a-3705927ec122 from the live domain config.
Nov 18 18:31:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkNgoGnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '8273228d-7d9f-4179-a45f-4eb6e5b5880b'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:31:34 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:31:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[711c5778-32c3-4739-9a9c-f81123ccbf0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:31:34 user nova-compute[74692]: No targets found.
Nov 18 18:31:34 user nova-compute[74692]: iSNS:
Nov 18 18:31:34 user nova-compute[74692]: No targets found.
Nov 18 18:31:34 user nova-compute[74692]: STATIC:
Nov 18 18:31:34 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0
Nov 18 18:31:34 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:34 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:34 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b
Nov 18 18:31:34 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:34 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:34 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:31:34 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:34 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:34 user nova-compute[74692]: FIRMWARE:
Nov 18 18:31:34 user nova-compute[74692]: No targets found.
Nov 18 18:31:34 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:31:34 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:31:34 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2ea2e9-249c-4a1e-8736-24c5558cb97a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8823d2b-3d8a-43a4-af53-24c8c7de0e17]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:34 user nova-compute[74692]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:31:34 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:34 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b (non-flash)
Nov 18 18:31:34 user nova-compute[74692]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:31:34 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:34 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a450e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b'): ({'sdc'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Removing single pathed devices sdc {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3d2d15-8c8a-45ae-9d3c-429a83e4af84]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c07d9df-0530-445a-8a78-4922f99cb050]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Flushing IO for device /dev/sdc {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d659298-b560-431b-83d1-d3ba56fa6e78]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:31:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bece4d0-1674-47e5-b1f2-863a03178b8f]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e14ac42-377d-4065-b94e-ad76fda33010]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG nova.network.neutron [req-67b05818-9769-4a69-b3ba-11a45cbad5a8 req-84a8e612-7cba-415e-8a7e-4297b13d8de8 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updated VIF entry in instance network info cache for port bdd4ef83-835c-42c0-a7e0-0432ab03618f. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG nova.network.neutron [req-67b05818-9769-4a69-b3ba-11a45cbad5a8 req-84a8e612-7cba-415e-8a7e-4297b13d8de8 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updating instance_info_cache with network_info: [{"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[547b74d4-71b7-4a0f-801b-f453172333a6]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260]
Nov 18 18:31:35 user nova-compute[74692]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b, portal: 172.16.0.220,3260] successful.
Nov 18 18:31:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8273228d-7d9f-4179-a45f-4eb6e5b5880b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[651e9818-bbde-4a94-b82d-a84906afe7f2]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] <== disconnect_volume: return (324ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-67b05818-9769-4a69-b3ba-11a45cbad5a8 req-84a8e612-7cba-415e-8a7e-4297b13d8de8 service nova] Releasing lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "7960f76b-9176-4d98-8045-03678457add7" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:35 user nova-compute[74692]: INFO nova.compute.manager [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Shelve offloading
Nov 18 18:31:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG nova.objects.instance [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lazy-loading 'flavor' on Instance uuid d17447e1-2e91-4d25-bf3a-3705927ec122 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2f1fa624-119a-463b-8622-ef6389f3a90f tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.673s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:36 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7960f76b-9176-4d98-8045-03678457add7] Instance destroyed successfully.
Nov 18 18:31:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquired lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG nova.network.neutron [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-vif-unplugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] No waiting events found dispatching network-vif-unplugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:36 user nova-compute[74692]: WARNING nova.compute.manager [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received unexpected event network-vif-unplugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f for instance with vm_state active and task_state shelving.
Nov 18 18:31:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] No waiting events found dispatching network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:36 user nova-compute[74692]: WARNING nova.compute.manager [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received unexpected event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f for instance with vm_state active and task_state shelving.
Nov 18 18:31:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] No waiting events found dispatching network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:36 user nova-compute[74692]: WARNING nova.compute.manager [req-d357a611-9b2a-451f-937b-a50347d60e5e req-5a71acdc-1fbc-4c37-be29-804f383e650d service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received unexpected event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f for instance with vm_state active and task_state shelving.
Nov 18 18:31:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG nova.network.neutron [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updating instance_info_cache with network_info: [{"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Releasing lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:37 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7960f76b-9176-4d98-8045-03678457add7] Instance destroyed successfully.
Nov 18 18:31:37 user nova-compute[74692]: DEBUG nova.objects.instance [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lazy-loading 'resources' on Instance uuid 7960f76b-9176-4d98-8045-03678457add7 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2059968008',display_name='tempest-TestShelveInstance-server-2059968008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2059968008',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqvDFaau/67R12i2PVg3zAmOTHhomyvhTqHRvkp08NpDDwRA6rjvsD7HSARckE1h3VtjUuYwEBUoGDT9lZLitru1a2otYt+5V6h8m0rpnvHGvpStzG11FTI2Dj8WqOnDw==',key_name='tempest-TestShelveInstance-1852882518',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5425715d2457463b8464c69b99c63831',ramdisk_id='',reservation_id='r-3gclmodf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-213519045',owner_user_name='tempest-TestShelveInstance-213519045-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:56Z,user_data=None,user_id='dce10cede81746b2bead51383a21b0a3',uuid=7960f76b-9176-4d98-8045-03678457add7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Converting VIF {"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=bdd4ef83-835c-42c0-a7e0-0432ab03618f,network=Network(cb98a4f1-8a2e-4b02-923f-810f47f4dccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd4ef83-83') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG os_vif [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=bdd4ef83-835c-42c0-a7e0-0432ab03618f,network=Network(cb98a4f1-8a2e-4b02-923f-810f47f4dccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd4ef83-83') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdd4ef83-83, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15f95141-80ea-4cd2-9a89-7ac9d1beff67) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:37 user nova-compute[74692]: INFO os_vif [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=bdd4ef83-835c-42c0-a7e0-0432ab03618f,network=Network(cb98a4f1-8a2e-4b02-923f-810f47f4dccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd4ef83-83')
Nov 18 18:31:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORgqFxrZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:31:37 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:31:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d46bca7-de5f-4f88-86a9-b6e596cca612]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:31:37 user nova-compute[74692]: No targets found.
Nov 18 18:31:37 user nova-compute[74692]: iSNS:
Nov 18 18:31:37 user nova-compute[74692]: No targets found.
Nov 18 18:31:37 user nova-compute[74692]: STATIC:
Nov 18 18:31:37 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0
Nov 18 18:31:37 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:37 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:37 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:31:37 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:31:37 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:31:37 user nova-compute[74692]: FIRMWARE:
Nov 18 18:31:37 user nova-compute[74692]: No targets found.
Nov 18 18:31:37 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:31:37 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:31:37 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f63bfba-b05d-42d4-9829-efcdf6c7b73c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b549306-c442-48b6-b6da-212f012671a3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:31:37 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:37 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:31:37 user nova-compute[74692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:31:37 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a455aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6'): ({'sdi'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Removing single pathed devices sdi {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9433ceaa-e413-440f-b4d4-d3089b6ae136]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6d9a4e-2cc3-4559-9080-ced89a19f9c0]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Flushing IO for device /dev/sdi {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe033412-2f38-41fa-9b60-b3e83092b145]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:37 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d1ec77-1114-4a3c-bdab-2e536b005f1d]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] SCSI volumes sdi have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fed6f1-822d-4754-bae8-f8d9bba0773f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ba8ebf-129e-4963-a107-ee1a0c5a6a8a]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260]
Nov 18 18:31:38 user nova-compute[74692]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260] successful.
Nov 18 18:31:38 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ed584e-944f-4627-b071-c09f1b20e49b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] <== disconnect_volume: return (297ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:31:38 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Deleting instance files /opt/stack/data/nova/instances/7960f76b-9176-4d98-8045-03678457add7_del
Nov 18 18:31:38 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Deletion of /opt/stack/data/nova/instances/7960f76b-9176-4d98-8045-03678457add7_del complete
Nov 18 18:31:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] No waiting events found dispatching network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:38 user nova-compute[74692]: WARNING nova.compute.manager [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received unexpected event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f for instance with vm_state active and task_state shelving.
Nov 18 18:31:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-vif-unplugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] No waiting events found dispatching network-vif-unplugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:38 user nova-compute[74692]: WARNING nova.compute.manager [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received unexpected event network-vif-unplugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f for instance with vm_state active and task_state shelving.
Nov 18 18:31:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] No waiting events found dispatching network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:38 user nova-compute[74692]: WARNING nova.compute.manager [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received unexpected event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f for instance with vm_state active and task_state shelving.
Nov 18 18:31:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-changed-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Refreshing instance network info cache due to event network-changed-bdd4ef83-835c-42c0-a7e0-0432ab03618f. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] Acquiring lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] Acquired lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:31:38 user nova-compute[74692]: DEBUG nova.network.neutron [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Refreshing network info cache for port bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:31:39 user nova-compute[74692]: DEBUG nova.network.neutron [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updated VIF entry in instance network info cache for port bdd4ef83-835c-42c0-a7e0-0432ab03618f. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:31:39 user nova-compute[74692]: DEBUG nova.network.neutron [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updating instance_info_cache with network_info: [{"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": null, "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c96ee24c-405b-412b-a5ab-e46844c72921 req-6d2ddc0b-7769-40eb-afab-ebc60da30141 service nova] Releasing lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:31:39 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Deleted allocations for instance 7960f76b-9176-4d98-8045-03678457add7
Nov 18 18:31:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:39 user nova-compute[74692]: DEBUG nova.objects.instance [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lazy-loading 'numa_topology' on Instance uuid 7960f76b-9176-4d98-8045-03678457add7 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:39 user nova-compute[74692]: DEBUG nova.objects.base [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Object Instance<7960f76b-9176-4d98-8045-03678457add7> lazy-loaded attributes: resources,numa_topology {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:31:39 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:31:39 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:31:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-73087576-2d35-451f-8526-9df820452c2a tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "7960f76b-9176-4d98-8045-03678457add7" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.305s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:41 user nova-compute[74692]: DEBUG nova.compute.manager [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:31:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:41 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:31:41 user nova-compute[74692]: INFO nova.compute.claims [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Claim successful on node user
Nov 18 18:31:41 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:31:41 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:31:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:41 user nova-compute[74692]: DEBUG nova.compute.manager [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:31:41 user nova-compute[74692]: DEBUG nova.compute.manager [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:31:41 user nova-compute[74692]: DEBUG nova.network.neutron [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:31:42 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:31:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG nova.policy [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fbcfd5f1f8949aea3a12d1cdad4fadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49de78bbe48494ca84537a8c3203c03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:31:42 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Creating image(s)
Nov 18 18:31:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "/opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "/opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.206s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG nova.network.neutron [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Successfully created port: a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk 1073741824" returned: 0 in 0.068s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.195s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:31:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Cannot resize image /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Ensure instance console log exists: /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.network.neutron [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Successfully updated port: a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "refresh_cache-2fbc1048-58dc-41ab-9e36-b7c3b0be9741" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquired lock "refresh_cache-2fbc1048-58dc-41ab-9e36-b7c3b0be9741" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.network.neutron [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.compute.manager [req-53864cc7-2fb6-479a-b227-c9faea673ed1 req-fc6cbd00-5cd3-4d3b-82ed-6c7c4210ce28 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received event network-changed-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.compute.manager [req-53864cc7-2fb6-479a-b227-c9faea673ed1 req-fc6cbd00-5cd3-4d3b-82ed-6c7c4210ce28 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Refreshing instance network info cache due to event network-changed-a80879d4-d41e-4418-9181-905a9ec118d5. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-53864cc7-2fb6-479a-b227-c9faea673ed1 req-fc6cbd00-5cd3-4d3b-82ed-6c7c4210ce28 service nova] Acquiring lock "refresh_cache-2fbc1048-58dc-41ab-9e36-b7c3b0be9741" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.network.neutron [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.network.neutron [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Updating instance_info_cache with network_info: [{"id": "a80879d4-d41e-4418-9181-905a9ec118d5", "address": "fa:16:3e:a9:c0:63", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80879d4-d4", "ovs_interfaceid": "a80879d4-d41e-4418-9181-905a9ec118d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Releasing lock "refresh_cache-2fbc1048-58dc-41ab-9e36-b7c3b0be9741" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.compute.manager [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Instance network_info: |[{"id": "a80879d4-d41e-4418-9181-905a9ec118d5", "address": "fa:16:3e:a9:c0:63", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80879d4-d4", "ovs_interfaceid": "a80879d4-d41e-4418-9181-905a9ec118d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-53864cc7-2fb6-479a-b227-c9faea673ed1 req-fc6cbd00-5cd3-4d3b-82ed-6c7c4210ce28 service nova] Acquired lock "refresh_cache-2fbc1048-58dc-41ab-9e36-b7c3b0be9741" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.network.neutron [req-53864cc7-2fb6-479a-b227-c9faea673ed1 req-fc6cbd00-5cd3-4d3b-82ed-6c7c4210ce28 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Refreshing network info cache for port a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Start _get_guest_xml network_info=[{"id": "a80879d4-d41e-4418-9181-905a9ec118d5", "address": "fa:16:3e:a9:c0:63", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80879d4-d4", "ovs_interfaceid": "a80879d4-d41e-4418-9181-905a9ec118d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:31:43 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:31:43 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1332121898',display_name='tempest-VolumesActionsTest-instance-1332121898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1332121898',id=13,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c49de78bbe48494ca84537a8c3203c03',ramdisk_id='',reservation_id='r-n1zfjzt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-948228922',owner_user_name='tempest-VolumesActionsTest-948228922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:31:42Z,user_data=None,user_id='5fbcfd5f1f8949aea3a12d1cdad4fadd',uuid=2fbc1048-58dc-41ab-9e36-b7c3b0be9741,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a80879d4-d41e-4418-9181-905a9ec118d5", "address": "fa:16:3e:a9:c0:63", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80879d4-d4", "ovs_interfaceid": "a80879d4-d41e-4418-9181-905a9ec118d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Converting VIF {"id": "a80879d4-d41e-4418-9181-905a9ec118d5", "address": "fa:16:3e:a9:c0:63", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80879d4-d4", "ovs_interfaceid": "a80879d4-d41e-4418-9181-905a9ec118d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c0:63,bridge_name='br-int',has_traffic_filtering=True,id=a80879d4-d41e-4418-9181-905a9ec118d5,network=Network(77ac5902-ef13-4b4f-b0b3-7c130c82a723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80879d4-d4') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.objects.instance [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fbc1048-58dc-41ab-9e36-b7c3b0be9741 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Acquiring lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Acquiring lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:43 user nova-compute[74692]: INFO nova.compute.manager [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Terminating instance
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:31:43 user nova-compute[74692]:   <uuid>2fbc1048-58dc-41ab-9e36-b7c3b0be9741</uuid>
Nov 18 18:31:43 user nova-compute[74692]:   <name>instance-0000000d</name>
Nov 18 18:31:43 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:31:43 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:31:43 user nova-compute[74692]:   <metadata>
Nov 18 18:31:43 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:31:43 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:31:43 user nova-compute[74692]:       <nova:name>tempest-VolumesActionsTest-instance-1332121898</nova:name>
Nov 18 18:31:43 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:31:43</nova:creationTime>
Nov 18 18:31:43 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:31:43 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:31:43 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:31:43 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:31:43 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:31:43 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:31:43 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:31:43 user nova-compute[74692]:       <nova:owner>
Nov 18 18:31:43 user nova-compute[74692]:         <nova:user uuid="5fbcfd5f1f8949aea3a12d1cdad4fadd">tempest-VolumesActionsTest-948228922-project-member</nova:user>
Nov 18 18:31:43 user nova-compute[74692]:         <nova:project uuid="c49de78bbe48494ca84537a8c3203c03">tempest-VolumesActionsTest-948228922</nova:project>
Nov 18 18:31:43 user nova-compute[74692]:       </nova:owner>
Nov 18 18:31:43 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:31:43 user nova-compute[74692]:       <nova:ports>
Nov 18 18:31:43 user nova-compute[74692]:         <nova:port uuid="a80879d4-d41e-4418-9181-905a9ec118d5">
Nov 18 18:31:43 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 18 18:31:43 user nova-compute[74692]:         </nova:port>
Nov 18 18:31:43 user nova-compute[74692]:       </nova:ports>
Nov 18 18:31:43 user nova-compute[74692]:     </nova:instance>
Nov 18 18:31:43 user nova-compute[74692]:   </metadata>
Nov 18 18:31:43 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:31:43 user nova-compute[74692]:     <system>
Nov 18 18:31:43 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:31:43 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:31:43 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:31:43 user nova-compute[74692]:       <entry name="serial">2fbc1048-58dc-41ab-9e36-b7c3b0be9741</entry>
Nov 18 18:31:43 user nova-compute[74692]:       <entry name="uuid">2fbc1048-58dc-41ab-9e36-b7c3b0be9741</entry>
Nov 18 18:31:43 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:31:43 user nova-compute[74692]:     </system>
Nov 18 18:31:43 user nova-compute[74692]:   </sysinfo>
Nov 18 18:31:43 user nova-compute[74692]:   <os>
Nov 18 18:31:43 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:31:43 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:31:43 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:31:43 user nova-compute[74692]:   </os>
Nov 18 18:31:43 user nova-compute[74692]:   <features>
Nov 18 18:31:43 user nova-compute[74692]:     <acpi/>
Nov 18 18:31:43 user nova-compute[74692]:     <apic/>
Nov 18 18:31:43 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:31:43 user nova-compute[74692]:   </features>
Nov 18 18:31:43 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:31:43 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:31:43 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:31:43 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:31:43 user nova-compute[74692]:   </clock>
Nov 18 18:31:43 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:31:43 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:31:43 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:31:43 user nova-compute[74692]:   </cpu>
Nov 18 18:31:43 user nova-compute[74692]:   <devices>
Nov 18 18:31:43 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:31:43 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:31:43 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk"/>
Nov 18 18:31:43 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:31:43 user nova-compute[74692]:     </disk>
Nov 18 18:31:43 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:31:43 user nova-compute[74692]:       <mac address="fa:16:3e:a9:c0:63"/>
Nov 18 18:31:43 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:31:43 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:31:43 user nova-compute[74692]:       <target dev="tapa80879d4-d4"/>
Nov 18 18:31:43 user nova-compute[74692]:     </interface>
Nov 18 18:31:43 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:31:43 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/console.log" append="off"/>
Nov 18 18:31:43 user nova-compute[74692]:     </serial>
Nov 18 18:31:43 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:31:43 user nova-compute[74692]:     <video>
Nov 18 18:31:43 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:31:43 user nova-compute[74692]:     </video>
Nov 18 18:31:43 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:31:43 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:31:43 user nova-compute[74692]:     </rng>
Nov 18 18:31:43 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:31:43 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:31:43 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:31:43 user nova-compute[74692]:     </memballoon>
Nov 18 18:31:43 user nova-compute[74692]:   </devices>
Nov 18 18:31:43 user nova-compute[74692]: </domain>
Nov 18 18:31:43 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1332121898',display_name='tempest-VolumesActionsTest-instance-1332121898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1332121898',id=13,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c49de78bbe48494ca84537a8c3203c03',ramdisk_id='',reservation_id='r-n1zfjzt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-948228922',owner_user_name='tempest-VolumesActionsTest-948228922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:31:42Z,user_data=None,user_id='5fbcfd5f1f8949aea3a12d1cdad4fadd',uuid=2fbc1048-58dc-41ab-9e36-b7c3b0be9741,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a80879d4-d41e-4418-9181-905a9ec118d5", "address": "fa:16:3e:a9:c0:63", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80879d4-d4", "ovs_interfaceid": "a80879d4-d41e-4418-9181-905a9ec118d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Converting VIF {"id": "a80879d4-d41e-4418-9181-905a9ec118d5", "address": "fa:16:3e:a9:c0:63", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80879d4-d4", "ovs_interfaceid": "a80879d4-d41e-4418-9181-905a9ec118d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c0:63,bridge_name='br-int',has_traffic_filtering=True,id=a80879d4-d41e-4418-9181-905a9ec118d5,network=Network(77ac5902-ef13-4b4f-b0b3-7c130c82a723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80879d4-d4') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG os_vif [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c0:63,bridge_name='br-int',has_traffic_filtering=True,id=a80879d4-d41e-4418-9181-905a9ec118d5,network=Network(77ac5902-ef13-4b4f-b0b3-7c130c82a723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80879d4-d4') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e6f42cc-9af8-5449-85eb-da161f1ec6e4', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa80879d4-d4, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa80879d4-d4, col_values=(('qos', UUID('9a8bc301-b288-4b74-b562-b29fbe4b7492')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa80879d4-d4, col_values=(('external_ids', {'iface-id': 'a80879d4-d41e-4418-9181-905a9ec118d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:c0:63', 'vm-uuid': '2fbc1048-58dc-41ab-9e36-b7c3b0be9741'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:44 user nova-compute[74692]: INFO os_vif [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c0:63,bridge_name='br-int',has_traffic_filtering=True,id=a80879d4-d41e-4418-9181-905a9ec118d5,network=Network(77ac5902-ef13-4b4f-b0b3-7c130c82a723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80879d4-d4')
Nov 18 18:31:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:31:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] No VIF found with MAC fa:16:3e:a9:c0:63, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:31:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:44 user nova-compute[74692]: DEBUG nova.network.neutron [req-53864cc7-2fb6-479a-b227-c9faea673ed1 req-fc6cbd00-5cd3-4d3b-82ed-6c7c4210ce28 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Updated VIF entry in instance network info cache for port a80879d4-d41e-4418-9181-905a9ec118d5. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:31:44 user nova-compute[74692]: DEBUG nova.network.neutron [req-53864cc7-2fb6-479a-b227-c9faea673ed1 req-fc6cbd00-5cd3-4d3b-82ed-6c7c4210ce28 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Updating instance_info_cache with network_info: [{"id": "a80879d4-d41e-4418-9181-905a9ec118d5", "address": "fa:16:3e:a9:c0:63", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80879d4-d4", "ovs_interfaceid": "a80879d4-d41e-4418-9181-905a9ec118d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-53864cc7-2fb6-479a-b227-c9faea673ed1 req-fc6cbd00-5cd3-4d3b-82ed-6c7c4210ce28 service nova] Releasing lock "refresh_cache-2fbc1048-58dc-41ab-9e36-b7c3b0be9741" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:31:45 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Instance destroyed successfully.
Nov 18 18:31:45 user nova-compute[74692]: DEBUG nova.objects.instance [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lazy-loading 'resources' on Instance uuid d40a1c6a-a5c1-46ff-ae2f-70819a1903b0 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1422328198',display_name='tempest-VolumesAssistedSnapshotsTest-server-1422328198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1422328198',id=7,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIelp7JxZL/0NC/EGjKtpX3EI8hNRLPBHY6vu24bc3biA1FUP8nO3qOLw9lq8pK2pKhhYDTkjczFaPE6byX1WWRCjcs54Ij9Lc49mORhI4Zzzq7Ah2baur6YUOibdk3Nw==',key_name='tempest-keypair-1324152243',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e80926040f74a899bc7af0af8cc7343',ramdisk_id='',reservation_id='r-uiiiaw0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1853371017',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1853371017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:29:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9c96bec473f4f869266a850ec3d2540',uuid=d40a1c6a-a5c1-46ff-ae2f-70819a1903b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "address": "fa:16:3e:7b:25:65", "network": {"id": "5181b213-08d4-4a73-9a77-cbf83dea1a3e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1859216473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e80926040f74a899bc7af0af8cc7343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec7a2cf-bc", "ovs_interfaceid": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Converting VIF {"id": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "address": "fa:16:3e:7b:25:65", "network": {"id": "5181b213-08d4-4a73-9a77-cbf83dea1a3e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1859216473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e80926040f74a899bc7af0af8cc7343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec7a2cf-bc", "ovs_interfaceid": "aec7a2cf-bc00-43f3-819b-fc6e0471448f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:25:65,bridge_name='br-int',has_traffic_filtering=True,id=aec7a2cf-bc00-43f3-819b-fc6e0471448f,network=Network(5181b213-08d4-4a73-9a77-cbf83dea1a3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaec7a2cf-bc') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG os_vif [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:25:65,bridge_name='br-int',has_traffic_filtering=True,id=aec7a2cf-bc00-43f3-819b-fc6e0471448f,network=Network(5181b213-08d4-4a73-9a77-cbf83dea1a3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaec7a2cf-bc') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaec7a2cf-bc, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=014b016f-4359-48c6-bb64-8c56dd6853eb) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:45 user nova-compute[74692]: INFO os_vif [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:25:65,bridge_name='br-int',has_traffic_filtering=True,id=aec7a2cf-bc00-43f3-819b-fc6e0471448f,network=Network(5181b213-08d4-4a73-9a77-cbf83dea1a3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaec7a2cf-bc')
Nov 18 18:31:45 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Deleting instance files /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0_del
Nov 18 18:31:45 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Deletion of /opt/stack/data/nova/instances/d40a1c6a-a5c1-46ff-ae2f-70819a1903b0_del complete
Nov 18 18:31:45 user nova-compute[74692]: INFO nova.compute.manager [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 18 18:31:45 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG nova.compute.manager [req-8c14cb6d-5893-4d04-ac6f-3048a5f35a45 req-30d27020-7f74-4ca0-8cf6-0ef0ff87ac98 service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Received event network-vif-unplugged-aec7a2cf-bc00-43f3-819b-fc6e0471448f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8c14cb6d-5893-4d04-ac6f-3048a5f35a45 req-30d27020-7f74-4ca0-8cf6-0ef0ff87ac98 service nova] Acquiring lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8c14cb6d-5893-4d04-ac6f-3048a5f35a45 req-30d27020-7f74-4ca0-8cf6-0ef0ff87ac98 service nova] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8c14cb6d-5893-4d04-ac6f-3048a5f35a45 req-30d27020-7f74-4ca0-8cf6-0ef0ff87ac98 service nova] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG nova.compute.manager [req-8c14cb6d-5893-4d04-ac6f-3048a5f35a45 req-30d27020-7f74-4ca0-8cf6-0ef0ff87ac98 service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] No waiting events found dispatching network-vif-unplugged-aec7a2cf-bc00-43f3-819b-fc6e0471448f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG nova.compute.manager [req-8c14cb6d-5893-4d04-ac6f-3048a5f35a45 req-30d27020-7f74-4ca0-8cf6-0ef0ff87ac98 service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Received event network-vif-unplugged-aec7a2cf-bc00-43f3-819b-fc6e0471448f for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG nova.compute.manager [req-8c14cb6d-5893-4d04-ac6f-3048a5f35a45 req-30d27020-7f74-4ca0-8cf6-0ef0ff87ac98 service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Received event network-vif-plugged-aec7a2cf-bc00-43f3-819b-fc6e0471448f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8c14cb6d-5893-4d04-ac6f-3048a5f35a45 req-30d27020-7f74-4ca0-8cf6-0ef0ff87ac98 service nova] Acquiring lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8c14cb6d-5893-4d04-ac6f-3048a5f35a45 req-30d27020-7f74-4ca0-8cf6-0ef0ff87ac98 service nova] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8c14cb6d-5893-4d04-ac6f-3048a5f35a45 req-30d27020-7f74-4ca0-8cf6-0ef0ff87ac98 service nova] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG nova.compute.manager [req-8c14cb6d-5893-4d04-ac6f-3048a5f35a45 req-30d27020-7f74-4ca0-8cf6-0ef0ff87ac98 service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] No waiting events found dispatching network-vif-plugged-aec7a2cf-bc00-43f3-819b-fc6e0471448f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:45 user nova-compute[74692]: WARNING nova.compute.manager [req-8c14cb6d-5893-4d04-ac6f-3048a5f35a45 req-30d27020-7f74-4ca0-8cf6-0ef0ff87ac98 service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Received unexpected event network-vif-plugged-aec7a2cf-bc00-43f3-819b-fc6e0471448f for instance with vm_state active and task_state deleting.
Nov 18 18:31:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-01ee63bb-83f2-4c0e-8502-f7770788f8a3 req-8c747835-c185-40a2-afd6-dc1bb0259595 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received event network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-01ee63bb-83f2-4c0e-8502-f7770788f8a3 req-8c747835-c185-40a2-afd6-dc1bb0259595 service nova] Acquiring lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-01ee63bb-83f2-4c0e-8502-f7770788f8a3 req-8c747835-c185-40a2-afd6-dc1bb0259595 service nova] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-01ee63bb-83f2-4c0e-8502-f7770788f8a3 req-8c747835-c185-40a2-afd6-dc1bb0259595 service nova] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-01ee63bb-83f2-4c0e-8502-f7770788f8a3 req-8c747835-c185-40a2-afd6-dc1bb0259595 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] No waiting events found dispatching network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:46 user nova-compute[74692]: WARNING nova.compute.manager [req-01ee63bb-83f2-4c0e-8502-f7770788f8a3 req-8c747835-c185-40a2-afd6-dc1bb0259595 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received unexpected event network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 for instance with vm_state building and task_state spawning.
Nov 18 18:31:46 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:31:46 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Took 1.07 seconds to deallocate network for instance.
Nov 18 18:31:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:46 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:31:46 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:31:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:46 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Deleted allocations for instance d40a1c6a-a5c1-46ff-ae2f-70819a1903b0
Nov 18 18:31:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9f9db1-00b2-41e6-b7da-1516764dd1b2 tempest-VolumesAssistedSnapshotsTest-1853371017 tempest-VolumesAssistedSnapshotsTest-1853371017-project-member] Lock "d40a1c6a-a5c1-46ff-ae2f-70819a1903b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.944s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:47 user nova-compute[74692]: DEBUG nova.compute.manager [req-81994eb1-6aca-4326-a0e9-0a5b4773db03 req-f5fd9ee3-7b99-4f3c-bc82-1775477da379 service nova] [instance: d40a1c6a-a5c1-46ff-ae2f-70819a1903b0] Received event network-vif-deleted-aec7a2cf-bc00-43f3-819b-fc6e0471448f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:48 user nova-compute[74692]: DEBUG nova.compute.manager [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:31:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:31:48 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Instance spawned successfully.
Nov 18 18:31:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:31:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-799d9317-1cd6-415a-b00c-898ead1dddae req-98492662-5ee0-4219-a3d5-94b38b785f28 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received event network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-799d9317-1cd6-415a-b00c-898ead1dddae req-98492662-5ee0-4219-a3d5-94b38b785f28 service nova] Acquiring lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-799d9317-1cd6-415a-b00c-898ead1dddae req-98492662-5ee0-4219-a3d5-94b38b785f28 service nova] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-799d9317-1cd6-415a-b00c-898ead1dddae req-98492662-5ee0-4219-a3d5-94b38b785f28 service nova] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-799d9317-1cd6-415a-b00c-898ead1dddae req-98492662-5ee0-4219-a3d5-94b38b785f28 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] No waiting events found dispatching network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:48 user nova-compute[74692]: WARNING nova.compute.manager [req-799d9317-1cd6-415a-b00c-898ead1dddae req-98492662-5ee0-4219-a3d5-94b38b785f28 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received unexpected event network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 for instance with vm_state building and task_state spawning.
Nov 18 18:31:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:31:48 user nova-compute[74692]: INFO nova.compute.manager [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 18 18:31:48 user nova-compute[74692]: DEBUG nova.compute.manager [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:31:48 user nova-compute[74692]: INFO nova.compute.manager [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Took 6.61 seconds to build instance.
Nov 18 18:31:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-be11c09b-5a6f-40f6-998b-21ac5d8a2045 tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.894s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:58 user nova-compute[74692]: INFO nova.compute.manager [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Terminating instance
Nov 18 18:31:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:31:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:58 user nova-compute[74692]: DEBUG nova.compute.manager [req-75165711-f1f0-4160-9d14-3abee31b6c9c req-7a388573-1a51-4c03-a2d1-503b272a5f20 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received event network-vif-unplugged-9935070a-ab06-4411-afeb-9039ecbea8bc {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:31:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-75165711-f1f0-4160-9d14-3abee31b6c9c req-7a388573-1a51-4c03-a2d1-503b272a5f20 service nova] Acquiring lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:31:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-75165711-f1f0-4160-9d14-3abee31b6c9c req-7a388573-1a51-4c03-a2d1-503b272a5f20 service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:31:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-75165711-f1f0-4160-9d14-3abee31b6c9c req-7a388573-1a51-4c03-a2d1-503b272a5f20 service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:31:58 user nova-compute[74692]: DEBUG nova.compute.manager [req-75165711-f1f0-4160-9d14-3abee31b6c9c req-7a388573-1a51-4c03-a2d1-503b272a5f20 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] No waiting events found dispatching network-vif-unplugged-9935070a-ab06-4411-afeb-9039ecbea8bc {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:31:58 user nova-compute[74692]: DEBUG nova.compute.manager [req-75165711-f1f0-4160-9d14-3abee31b6c9c req-7a388573-1a51-4c03-a2d1-503b272a5f20 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received event network-vif-unplugged-9935070a-ab06-4411-afeb-9039ecbea8bc for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:31:59 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Instance destroyed successfully.
Nov 18 18:31:59 user nova-compute[74692]: DEBUG nova.objects.instance [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lazy-loading 'resources' on Instance uuid 0b9551f1-bc3e-4221-95fc-3b3a4a33251c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:31:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T18:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-796391196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-796391196',id=5,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3gJO/TwdDSf1yN3ZchrXCyXLk6TezdqH7o7X0wfuK4mUN+34DlZO1554usfJkK2dsoaKwNDHuloE+Z5C2eKZ2s7LsvuKmsXer8Y96AOq7N/zPoRVeXal22WhpetQTiRg==',key_name='tempest-keypair-1001776154',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:28:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='722ae3b1a66f46c9a0679d562b22e470',ramdisk_id='',reservation_id='r-j9yyn7m1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1784015919',owner_user_name='tempest-TaggedAttachmentsTest-1784015919-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:28:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39b207b60dbe460f83bf961a995e5342',uuid=0b9551f1-bc3e-4221-95fc-3b3a4a33251c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9935070a-ab06-4411-afeb-9039ecbea8bc", "address": "fa:16:3e:a9:05:46", "network": {"id": "da3ff499-fbcd-4f27-bd2a-6f4d23814cc6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1280089118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9935070a-ab", "ovs_interfaceid": "9935070a-ab06-4411-afeb-9039ecbea8bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:31:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Converting VIF {"id": "9935070a-ab06-4411-afeb-9039ecbea8bc", "address": "fa:16:3e:a9:05:46", "network": {"id": "da3ff499-fbcd-4f27-bd2a-6f4d23814cc6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1280089118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722ae3b1a66f46c9a0679d562b22e470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9935070a-ab", "ovs_interfaceid": "9935070a-ab06-4411-afeb-9039ecbea8bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:31:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:05:46,bridge_name='br-int',has_traffic_filtering=True,id=9935070a-ab06-4411-afeb-9039ecbea8bc,network=Network(da3ff499-fbcd-4f27-bd2a-6f4d23814cc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9935070a-ab') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:31:59 user nova-compute[74692]: DEBUG os_vif [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:05:46,bridge_name='br-int',has_traffic_filtering=True,id=9935070a-ab06-4411-afeb-9039ecbea8bc,network=Network(da3ff499-fbcd-4f27-bd2a-6f4d23814cc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9935070a-ab') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:31:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9935070a-ab, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1bbc12f-7ac9-4e81-b39d-5078c138b5bb) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:31:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:31:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:31:59 user nova-compute[74692]: INFO os_vif [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:05:46,bridge_name='br-int',has_traffic_filtering=True,id=9935070a-ab06-4411-afeb-9039ecbea8bc,network=Network(da3ff499-fbcd-4f27-bd2a-6f4d23814cc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9935070a-ab')
Nov 18 18:31:59 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Deleting instance files /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c_del
Nov 18 18:31:59 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Deletion of /opt/stack/data/nova/instances/0b9551f1-bc3e-4221-95fc-3b3a4a33251c_del complete
Nov 18 18:31:59 user nova-compute[74692]: INFO nova.compute.manager [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 18 18:31:59 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:31:59 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:31:59 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:32:00 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:32:00 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Took 0.93 seconds to deallocate network for instance.
Nov 18 18:32:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-6ba64f64-c510-431c-b00a-12c46f6d39ca req-a7b353f5-06cc-4dcf-aa77-0db06a304f4b service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received event network-vif-deleted-9935070a-ab06-4411-afeb-9039ecbea8bc {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:00 user nova-compute[74692]: INFO nova.compute.manager [req-6ba64f64-c510-431c-b00a-12c46f6d39ca req-a7b353f5-06cc-4dcf-aa77-0db06a304f4b service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Neutron deleted interface 9935070a-ab06-4411-afeb-9039ecbea8bc; detaching it from the instance and deleting it from the info cache
Nov 18 18:32:00 user nova-compute[74692]: DEBUG nova.network.neutron [req-6ba64f64-c510-431c-b00a-12c46f6d39ca req-a7b353f5-06cc-4dcf-aa77-0db06a304f4b service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:32:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-6ba64f64-c510-431c-b00a-12c46f6d39ca req-a7b353f5-06cc-4dcf-aa77-0db06a304f4b service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Detach interface failed, port_id=9935070a-ab06-4411-afeb-9039ecbea8bc, reason: Instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:32:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:00 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:32:00 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:32:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:00 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Deleted allocations for instance 0b9551f1-bc3e-4221-95fc-3b3a4a33251c
Nov 18 18:32:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9bcb9ffc-a3f5-4be2-a302-6f17b83519c0 tempest-TaggedAttachmentsTest-1784015919 tempest-TaggedAttachmentsTest-1784015919-project-member] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.244s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-15b1cd50-2169-4252-a3cb-988776584484 req-7b91ca84-9a95-40c2-8c08-65f47c878070 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received event network-vif-plugged-9935070a-ab06-4411-afeb-9039ecbea8bc {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-15b1cd50-2169-4252-a3cb-988776584484 req-7b91ca84-9a95-40c2-8c08-65f47c878070 service nova] Acquiring lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-15b1cd50-2169-4252-a3cb-988776584484 req-7b91ca84-9a95-40c2-8c08-65f47c878070 service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-15b1cd50-2169-4252-a3cb-988776584484 req-7b91ca84-9a95-40c2-8c08-65f47c878070 service nova] Lock "0b9551f1-bc3e-4221-95fc-3b3a4a33251c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-15b1cd50-2169-4252-a3cb-988776584484 req-7b91ca84-9a95-40c2-8c08-65f47c878070 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] No waiting events found dispatching network-vif-plugged-9935070a-ab06-4411-afeb-9039ecbea8bc {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:32:00 user nova-compute[74692]: WARNING nova.compute.manager [req-15b1cd50-2169-4252-a3cb-988776584484 req-7b91ca84-9a95-40c2-8c08-65f47c878070 service nova] [instance: 0b9551f1-bc3e-4221-95fc-3b3a4a33251c] Received unexpected event network-vif-plugged-9935070a-ab06-4411-afeb-9039ecbea8bc for instance with vm_state deleted and task_state None.
Nov 18 18:32:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquiring lock "d17447e1-2e91-4d25-bf3a-3705927ec122" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquiring lock "d17447e1-2e91-4d25-bf3a-3705927ec122-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:04 user nova-compute[74692]: INFO nova.compute.manager [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Terminating instance
Nov 18 18:32:04 user nova-compute[74692]: DEBUG nova.compute.manager [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:32:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:04 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:32:04 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-3329b6a3-c884-462d-8e0e-8a2d6420a95f req-f5722c55-16fd-417e-9346-935a60d1789f service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Received event network-vif-unplugged-11c1b5b3-4d09-4461-9d7f-d879f706805c {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3329b6a3-c884-462d-8e0e-8a2d6420a95f req-f5722c55-16fd-417e-9346-935a60d1789f service nova] Acquiring lock "d17447e1-2e91-4d25-bf3a-3705927ec122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3329b6a3-c884-462d-8e0e-8a2d6420a95f req-f5722c55-16fd-417e-9346-935a60d1789f service nova] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3329b6a3-c884-462d-8e0e-8a2d6420a95f req-f5722c55-16fd-417e-9346-935a60d1789f service nova] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-3329b6a3-c884-462d-8e0e-8a2d6420a95f req-f5722c55-16fd-417e-9346-935a60d1789f service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] No waiting events found dispatching network-vif-unplugged-11c1b5b3-4d09-4461-9d7f-d879f706805c {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-3329b6a3-c884-462d-8e0e-8a2d6420a95f req-f5722c55-16fd-417e-9346-935a60d1789f service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Received event network-vif-unplugged-11c1b5b3-4d09-4461-9d7f-d879f706805c for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:32:05 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Instance destroyed successfully.
Nov 18 18:32:05 user nova-compute[74692]: DEBUG nova.objects.instance [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lazy-loading 'resources' on Instance uuid d17447e1-2e91-4d25-bf3a-3705927ec122 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:28:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-249703929',display_name='tempest-TestVolumeSwap-server-249703929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-249703929',id=4,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQ7ErB8zROeG+FGRKKvlR1IkYXszX5weiDoTQKIhfh4EXQdCxcRtkr8WfKfna809njSowyZfpj3fDwytT1EfqSL6kmSNh1FuyPnTDPu/UsR3ulvIFAENerxWH8sm/2x2w==',key_name='tempest-keypair-376439620',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:28:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7ac758bb60347ad8ea3b4f2bf9292cf',ramdisk_id='',reservation_id='r-prbtc42f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-553284986',owner_user_name='tempest-TestVolumeSwap-553284986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:28:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4c515db29f14ce1a90391bc0c05cb05',uuid=d17447e1-2e91-4d25-bf3a-3705927ec122,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "address": "fa:16:3e:1c:ef:47", "network": {"id": "dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1097989855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ac758bb60347ad8ea3b4f2bf9292cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c1b5b3-4d", "ovs_interfaceid": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Converting VIF {"id": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "address": "fa:16:3e:1c:ef:47", "network": {"id": "dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1097989855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ac758bb60347ad8ea3b4f2bf9292cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c1b5b3-4d", "ovs_interfaceid": "11c1b5b3-4d09-4461-9d7f-d879f706805c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ef:47,bridge_name='br-int',has_traffic_filtering=True,id=11c1b5b3-4d09-4461-9d7f-d879f706805c,network=Network(dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c1b5b3-4d') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG os_vif [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ef:47,bridge_name='br-int',has_traffic_filtering=True,id=11c1b5b3-4d09-4461-9d7f-d879f706805c,network=Network(dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c1b5b3-4d') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11c1b5b3-4d, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19392b63-814c-4a5b-9f16-f2a749fb0b48) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:32:05 user nova-compute[74692]: INFO os_vif [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ef:47,bridge_name='br-int',has_traffic_filtering=True,id=11c1b5b3-4d09-4461-9d7f-d879f706805c,network=Network(dc7efc28-d51a-4b17-9672-a0ffe1e1cb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c1b5b3-4d')
Nov 18 18:32:05 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Deleting instance files /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122_del
Nov 18 18:32:05 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Deletion of /opt/stack/data/nova/instances/d17447e1-2e91-4d25-bf3a-3705927ec122_del complete
Nov 18 18:32:05 user nova-compute[74692]: INFO nova.compute.manager [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 18 18:32:05 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:32:05 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:32:06 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:32:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:06 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:32:07 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Took 1.37 seconds to deallocate network for instance.
Nov 18 18:32:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG nova.compute.manager [req-67e8c8fa-d447-42bd-adea-1a5cf79f6c12 req-734f9dca-ec0b-452a-b4b8-6d46818db053 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Received event network-vif-plugged-11c1b5b3-4d09-4461-9d7f-d879f706805c {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-67e8c8fa-d447-42bd-adea-1a5cf79f6c12 req-734f9dca-ec0b-452a-b4b8-6d46818db053 service nova] Acquiring lock "d17447e1-2e91-4d25-bf3a-3705927ec122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-67e8c8fa-d447-42bd-adea-1a5cf79f6c12 req-734f9dca-ec0b-452a-b4b8-6d46818db053 service nova] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-67e8c8fa-d447-42bd-adea-1a5cf79f6c12 req-734f9dca-ec0b-452a-b4b8-6d46818db053 service nova] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG nova.compute.manager [req-67e8c8fa-d447-42bd-adea-1a5cf79f6c12 req-734f9dca-ec0b-452a-b4b8-6d46818db053 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] No waiting events found dispatching network-vif-plugged-11c1b5b3-4d09-4461-9d7f-d879f706805c {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:32:07 user nova-compute[74692]: WARNING nova.compute.manager [req-67e8c8fa-d447-42bd-adea-1a5cf79f6c12 req-734f9dca-ec0b-452a-b4b8-6d46818db053 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Received unexpected event network-vif-plugged-11c1b5b3-4d09-4461-9d7f-d879f706805c for instance with vm_state deleted and task_state None.
Nov 18 18:32:07 user nova-compute[74692]: DEBUG nova.compute.manager [req-67e8c8fa-d447-42bd-adea-1a5cf79f6c12 req-734f9dca-ec0b-452a-b4b8-6d46818db053 service nova] [instance: d17447e1-2e91-4d25-bf3a-3705927ec122] Received event network-vif-deleted-11c1b5b3-4d09-4461-9d7f-d879f706805c {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:07 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Deleted allocations for instance d17447e1-2e91-4d25-bf3a-3705927ec122
Nov 18 18:32:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ddd70c21-9c3e-46f9-b2b6-dbea6115eadf tempest-TestVolumeSwap-553284986 tempest-TestVolumeSwap-553284986-project-member] Lock "d17447e1-2e91-4d25-bf3a-3705927ec122" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.030s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:32:08 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:32:08 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:32:08 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8258MB free_disk=25.585628509521484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:32:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:08 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 76506747-4a6b-40bd-b812-bf114be5e8b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:32:08 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 153d4723-7ede-41b3-9f64-a0487f617ed2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:32:08 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 2fbc1048-58dc-41ab-9e36-b7c3b0be9741 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:32:08 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:32:08 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:32:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "bebb6344-183e-4367-bb0b-b575b70adfbc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:08 user nova-compute[74692]: INFO nova.compute.manager [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Unshelving
Nov 18 18:32:08 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:32:08 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:32:08 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:32:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:08 user nova-compute[74692]: INFO nova.virt.block_device [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Booting with volume 38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 at /dev/vdc
Nov 18 18:32:09 user nova-compute[74692]: DEBUG os_brick.utils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.120s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[546a81d3-8f54-4bf0-a7d8-679d440469b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90b6161-e08d-4fcf-9512-d37701bc7cc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a55400-be2c-44d6-9c8b-e9383af7f000]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[56af9f61-0872-4a9e-9a0d-0fc964530052]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:32:09 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:32:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bc8738-3032-4eb5-ad91-f17285ad3ffd]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG os_brick.utils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] <== get_connector_properties: return (254ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:32:09 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updating existing volume attachment record: 098afb12-07eb-41ad-a3d8-72391b8e1544 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:32:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:10 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:32:10 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:32:10 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:32:10 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:32:10 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:32:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:14 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:32:14 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:32:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-76506747-4a6b-40bd-b812-bf114be5e8b4" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:32:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-76506747-4a6b-40bd-b812-bf114be5e8b4" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:32:15 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:32:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:15 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'pci_requests' on Instance uuid bebb6344-183e-4367-bb0b-b575b70adfbc {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:32:15 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'numa_topology' on Instance uuid bebb6344-183e-4367-bb0b-b575b70adfbc {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:32:15 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:32:15 user nova-compute[74692]: INFO nova.compute.claims [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Claim successful on node user
Nov 18 18:32:15 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:32:15 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:32:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:15 user nova-compute[74692]: INFO nova.network.neutron [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updating port 3ea5c349-f13f-453c-81e5-388c93e6dfa4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquired lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG nova.network.neutron [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-459ed63d-3cc9-4209-91c2-1ef875cfbd37 req-375bed78-d10d-4bf3-8f93-32a1d2fe1bc1 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received event network-changed-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-459ed63d-3cc9-4209-91c2-1ef875cfbd37 req-375bed78-d10d-4bf3-8f93-32a1d2fe1bc1 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Refreshing instance network info cache due to event network-changed-3ea5c349-f13f-453c-81e5-388c93e6dfa4. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-459ed63d-3cc9-4209-91c2-1ef875cfbd37 req-375bed78-d10d-4bf3-8f93-32a1d2fe1bc1 service nova] Acquiring lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Updating instance_info_cache with network_info: [{"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-76506747-4a6b-40bd-b812-bf114be5e8b4" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG nova.network.neutron [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updating instance_info_cache with network_info: [{"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Releasing lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:32:16 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Creating image(s)
Nov 18 18:32:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "/opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "/opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "/opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'trusted_certs' on Instance uuid bebb6344-183e-4367-bb0b-b575b70adfbc {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-459ed63d-3cc9-4209-91c2-1ef875cfbd37 req-375bed78-d10d-4bf3-8f93-32a1d2fe1bc1 service nova] Acquired lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG nova.network.neutron [req-459ed63d-3cc9-4209-91c2-1ef875cfbd37 req-375bed78-d10d-4bf3-8f93-32a1d2fe1bc1 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Refreshing network info cache for port 3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG nova.objects.base [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Object Instance<bebb6344-183e-4367-bb0b-b575b70adfbc> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "94a7a3685e3312f3dcbdcebd95146b31549f3e4d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "94a7a3685e3312f3dcbdcebd95146b31549f3e4d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d.part --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d.part --force-share --output=json" returned: 0 in 0.217s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:18 user nova-compute[74692]: DEBUG nova.virt.images [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] b9d765e0-1746-42a0-8e83-25846f14c7e1 was qcow2, converting to raw {{(pid=74692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 18:32:18 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:32:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d.part /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d.converted {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d.part /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d.converted" returned: 0 in 0.403s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d.converted --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:18 user nova-compute[74692]: DEBUG nova.network.neutron [req-459ed63d-3cc9-4209-91c2-1ef875cfbd37 req-375bed78-d10d-4bf3-8f93-32a1d2fe1bc1 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updated VIF entry in instance network info cache for port 3ea5c349-f13f-453c-81e5-388c93e6dfa4. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:32:18 user nova-compute[74692]: DEBUG nova.network.neutron [req-459ed63d-3cc9-4209-91c2-1ef875cfbd37 req-375bed78-d10d-4bf3-8f93-32a1d2fe1bc1 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updating instance_info_cache with network_info: [{"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:32:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-459ed63d-3cc9-4209-91c2-1ef875cfbd37 req-375bed78-d10d-4bf3-8f93-32a1d2fe1bc1 service nova] Releasing lock "refresh_cache-bebb6344-183e-4367-bb0b-b575b70adfbc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:32:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "94a7a3685e3312f3dcbdcebd95146b31549f3e4d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.932s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d --force-share --output=json" returned: 0 in 0.208s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "94a7a3685e3312f3dcbdcebd95146b31549f3e4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "94a7a3685e3312f3dcbdcebd95146b31549f3e4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d,backing_fmt=raw /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d,backing_fmt=raw /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk 1073741824" returned: 0 in 0.056s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "94a7a3685e3312f3dcbdcebd95146b31549f3e4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:19 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'migration_context' on Instance uuid bebb6344-183e-4367-bb0b-b575b70adfbc {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:32:19 user nova-compute[74692]: DEBUG nova.objects.base [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Object Instance<bebb6344-183e-4367-bb0b-b575b70adfbc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:32:19 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Rebasing disk image.
Nov 18 18:32:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 -F raw /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 -F raw /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk" returned: 0 in 2.448s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Ensure instance console log exists: /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Start _get_guest_xml network_info=[{"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='22858183336944ab75061e72bda82758',container_format='bare',created_at=2023-11-18T18:30:16Z,direct_url=<?>,disk_format='qcow2',id=b9d765e0-1746-42a0-8e83-25846f14c7e1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1074163696-shelved',owner='1f169f28da1640d9b03b4ba44b4e7b7c',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-18T18:30:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcZMsyfk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'bebb6344-183e-4367-bb0b-b575b70adfbc', 'attached_at': '', 'detached_at': '', 'volume_id': '38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48', 'serial': '38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48'}, 'attachment_id': '098afb12-07eb-41ad-a3d8-72391b8e1544', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:32:22 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:32:22 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='22858183336944ab75061e72bda82758',container_format='bare',created_at=2023-11-18T18:30:16Z,direct_url=<?>,disk_format='qcow2',id=b9d765e0-1746-42a0-8e83-25846f14c7e1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1074163696-shelved',owner='1f169f28da1640d9b03b4ba44b4e7b7c',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-18T18:30:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'vcpu_model' on Instance uuid bebb6344-183e-4367-bb0b-b575b70adfbc {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.objects.base [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Object Instance<bebb6344-183e-4367-bb0b-b575b70adfbc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcZMsyfk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:32:22 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:32:22 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:32:22 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[15938c86-4f2b-4453-82f2-de4bc4879066]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:32:22 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[52efccbb-8892-4486-b3ca-da5dbbdfcaaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48] added
Nov 18 18:32:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[02921226-bb1b-4658-8d02-8c05e14a172d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24a6e92-0e74-4120-8196-0b9ec3f0b933]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcZMsyfk {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcZMsyfk" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0572c7a-5f9c-4df4-9b0e-a322917663b9]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CcZMsyfk'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f95c7d5-ff36-43f2-86c3-e276a0133a6a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea23d01f-3efb-4a7c-94f6-0a32670c7a4d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:32:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:32:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd2abc1-a70d-4ff8-a264-1b71d4554077]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48, portal: 172.16.0.220,3260]
Nov 18 18:32:22 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48, portal: 172.16.0.220,3260] successful.
Nov 18 18:32:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df42587-765c-43d1-8913-ec8505a74068]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f18960a-70ec-47ba-9ebd-08f7f64057a5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:32:22 user nova-compute[74692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 (non-flash)
Nov 18 18:32:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:32:22 user nova-compute[74692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 (non-flash)
Nov 18 18:32:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ce138b-7531-4979-84a1-8321f60dc252]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:32:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcZMsyfk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23031346231373937', 'path': '/dev/sdc'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031346231373937', 'path': '/dev/sdc'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T18:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1074163696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1074163696',id=2,image_ref='b9d765e0-1746-42a0-8e83-25846f14c7e1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1821240249',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1f169f28da1640d9b03b4ba44b4e7b7c',ramdisk_id='',reservation_id='r-s1ly0l0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1768400085',owner_user_name='tempest-AttachVolumeShelveTestJSON-1768400085-project-member',shelved_at='2023-11-18T18:30:20.752089',shelved_host='user',shelved_image_id='b9d765e0-1746-42a0-8e83-25846f14c7e1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a005c7c46c46ad9217578412ec906f',uuid=bebb6344-183e-4367-bb0b-b575b70adfbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converting VIF {"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:98:ed,bridge_name='br-int',has_traffic_filtering=True,id=3ea5c349-f13f-453c-81e5-388c93e6dfa4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea5c349-f1') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'pci_devices' on Instance uuid bebb6344-183e-4367-bb0b-b575b70adfbc {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG nova.objects.base [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Object Instance<bebb6344-183e-4367-bb0b-b575b70adfbc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:32:23 user nova-compute[74692]:   <uuid>bebb6344-183e-4367-bb0b-b575b70adfbc</uuid>
Nov 18 18:32:23 user nova-compute[74692]:   <name>instance-00000002</name>
Nov 18 18:32:23 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:32:23 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:32:23 user nova-compute[74692]:   <metadata>
Nov 18 18:32:23 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:32:23 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:32:23 user nova-compute[74692]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1074163696</nova:name>
Nov 18 18:32:23 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:32:22</nova:creationTime>
Nov 18 18:32:23 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:32:23 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:32:23 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:32:23 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:32:23 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:32:23 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:32:23 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:32:23 user nova-compute[74692]:       <nova:owner>
Nov 18 18:32:23 user nova-compute[74692]:         <nova:user uuid="c0a005c7c46c46ad9217578412ec906f">tempest-AttachVolumeShelveTestJSON-1768400085-project-member</nova:user>
Nov 18 18:32:23 user nova-compute[74692]:         <nova:project uuid="1f169f28da1640d9b03b4ba44b4e7b7c">tempest-AttachVolumeShelveTestJSON-1768400085</nova:project>
Nov 18 18:32:23 user nova-compute[74692]:       </nova:owner>
Nov 18 18:32:23 user nova-compute[74692]:       <nova:root type="image" uuid="b9d765e0-1746-42a0-8e83-25846f14c7e1"/>
Nov 18 18:32:23 user nova-compute[74692]:       <nova:ports>
Nov 18 18:32:23 user nova-compute[74692]:         <nova:port uuid="3ea5c349-f13f-453c-81e5-388c93e6dfa4">
Nov 18 18:32:23 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 18:32:23 user nova-compute[74692]:         </nova:port>
Nov 18 18:32:23 user nova-compute[74692]:       </nova:ports>
Nov 18 18:32:23 user nova-compute[74692]:     </nova:instance>
Nov 18 18:32:23 user nova-compute[74692]:   </metadata>
Nov 18 18:32:23 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:32:23 user nova-compute[74692]:     <system>
Nov 18 18:32:23 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:32:23 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:32:23 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:32:23 user nova-compute[74692]:       <entry name="serial">bebb6344-183e-4367-bb0b-b575b70adfbc</entry>
Nov 18 18:32:23 user nova-compute[74692]:       <entry name="uuid">bebb6344-183e-4367-bb0b-b575b70adfbc</entry>
Nov 18 18:32:23 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:32:23 user nova-compute[74692]:     </system>
Nov 18 18:32:23 user nova-compute[74692]:   </sysinfo>
Nov 18 18:32:23 user nova-compute[74692]:   <os>
Nov 18 18:32:23 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:32:23 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:32:23 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:32:23 user nova-compute[74692]:   </os>
Nov 18 18:32:23 user nova-compute[74692]:   <features>
Nov 18 18:32:23 user nova-compute[74692]:     <acpi/>
Nov 18 18:32:23 user nova-compute[74692]:     <apic/>
Nov 18 18:32:23 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:32:23 user nova-compute[74692]:   </features>
Nov 18 18:32:23 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:32:23 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:32:23 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:32:23 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:32:23 user nova-compute[74692]:   </clock>
Nov 18 18:32:23 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:32:23 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:32:23 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:32:23 user nova-compute[74692]:   </cpu>
Nov 18 18:32:23 user nova-compute[74692]:   <devices>
Nov 18 18:32:23 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:32:23 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:32:23 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk"/>
Nov 18 18:32:23 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:32:23 user nova-compute[74692]:     </disk>
Nov 18 18:32:23 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:32:23 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:32:23 user nova-compute[74692]:       <source dev="/dev/sdc"/>
Nov 18 18:32:23 user nova-compute[74692]:       <target dev="vdc" bus="virtio"/>
Nov 18 18:32:23 user nova-compute[74692]:       <serial>38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48</serial>
Nov 18 18:32:23 user nova-compute[74692]:     </disk>
Nov 18 18:32:23 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:32:23 user nova-compute[74692]:       <mac address="fa:16:3e:d3:98:ed"/>
Nov 18 18:32:23 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:32:23 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:32:23 user nova-compute[74692]:       <target dev="tap3ea5c349-f1"/>
Nov 18 18:32:23 user nova-compute[74692]:     </interface>
Nov 18 18:32:23 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:32:23 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/console.log" append="off"/>
Nov 18 18:32:23 user nova-compute[74692]:     </serial>
Nov 18 18:32:23 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:32:23 user nova-compute[74692]:     <video>
Nov 18 18:32:23 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:32:23 user nova-compute[74692]:     </video>
Nov 18 18:32:23 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:32:23 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:32:23 user nova-compute[74692]:     </rng>
Nov 18 18:32:23 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:32:23 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:32:23 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:32:23 user nova-compute[74692]:     </memballoon>
Nov 18 18:32:23 user nova-compute[74692]:   </devices>
Nov 18 18:32:23 user nova-compute[74692]: </domain>
Nov 18 18:32:23 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T18:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1074163696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1074163696',id=2,image_ref='b9d765e0-1746-42a0-8e83-25846f14c7e1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1821240249',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1f169f28da1640d9b03b4ba44b4e7b7c',ramdisk_id='',reservation_id='r-s1ly0l0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1768400085',owner_user_name='tempest-AttachVolumeShelveTestJSON-1768400085-project-member',shelved_at='2023-11-18T18:30:20.752089',shelved_host='user',shelved_image_id='b9d765e0-1746-42a0-8e83-25846f14c7e1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a005c7c46c46ad9217578412ec906f',uuid=bebb6344-183e-4367-bb0b-b575b70adfbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converting VIF {"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:98:ed,bridge_name='br-int',has_traffic_filtering=True,id=3ea5c349-f13f-453c-81e5-388c93e6dfa4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea5c349-f1') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG os_vif [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:98:ed,bridge_name='br-int',has_traffic_filtering=True,id=3ea5c349-f13f-453c-81e5-388c93e6dfa4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea5c349-f1') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e4ed527-386d-5681-85d8-98ef4c173eb7', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ea5c349-f1, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ea5c349-f1, col_values=(('qos', UUID('081b703a-ee85-41c3-871f-c84293304254')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ea5c349-f1, col_values=(('external_ids', {'iface-id': '3ea5c349-f13f-453c-81e5-388c93e6dfa4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:98:ed', 'vm-uuid': 'bebb6344-183e-4367-bb0b-b575b70adfbc'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:23 user nova-compute[74692]: INFO os_vif [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:98:ed,bridge_name='br-int',has_traffic_filtering=True,id=3ea5c349-f13f-453c-81e5-388c93e6dfa4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea5c349-f1')
Nov 18 18:32:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:32:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] No VIF found with MAC fa:16:3e:d3:98:ed, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:32:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:24 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:32:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:32:24 user nova-compute[74692]: INFO nova.compute.claims [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Claim successful on node user
Nov 18 18:32:25 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:25 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:32:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG nova.policy [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c418956015544fb8ac0a8acb6af6aacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fead685ad47d4e96bb7c5225029f82ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:32:25 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Creating image(s)
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "/opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "/opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "/opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.214s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-4326441f-8351-4c53-942e-fa9d2f009686 req-803633ae-ada6-4f1c-8166-4cf75f7e5a22 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received event network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4326441f-8351-4c53-942e-fa9d2f009686 req-803633ae-ada6-4f1c-8166-4cf75f7e5a22 service nova] Acquiring lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4326441f-8351-4c53-942e-fa9d2f009686 req-803633ae-ada6-4f1c-8166-4cf75f7e5a22 service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4326441f-8351-4c53-942e-fa9d2f009686 req-803633ae-ada6-4f1c-8166-4cf75f7e5a22 service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-4326441f-8351-4c53-942e-fa9d2f009686 req-803633ae-ada6-4f1c-8166-4cf75f7e5a22 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] No waiting events found dispatching network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:32:25 user nova-compute[74692]: WARNING nova.compute.manager [req-4326441f-8351-4c53-942e-fa9d2f009686 req-803633ae-ada6-4f1c-8166-4cf75f7e5a22 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received unexpected event network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "d949d403-0a45-48bc-b64a-f63b114d1944" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "d949d403-0a45-48bc-b64a-f63b114d1944" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.194s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:32:25 user nova-compute[74692]: INFO nova.compute.claims [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Claim successful on node user
Nov 18 18:32:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk 1073741824" returned: 0 in 0.077s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.355s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Cannot resize image /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Ensure instance console log exists: /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.028s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:32:27 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:32:27 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Successfully created port: 256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:32:27 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Creating image(s)
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "/opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "/opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "/opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG nova.policy [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c418956015544fb8ac0a8acb6af6aacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fead685ad47d4e96bb7c5225029f82ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.203s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.187s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk 1073741824" returned: 0 in 0.054s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-5af8575a-7f26-46f9-9ff6-28e7007e33bb req-99b470e9-96bf-4c33-8328-56567bba90a6 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received event network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5af8575a-7f26-46f9-9ff6-28e7007e33bb req-99b470e9-96bf-4c33-8328-56567bba90a6 service nova] Acquiring lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5af8575a-7f26-46f9-9ff6-28e7007e33bb req-99b470e9-96bf-4c33-8328-56567bba90a6 service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5af8575a-7f26-46f9-9ff6-28e7007e33bb req-99b470e9-96bf-4c33-8328-56567bba90a6 service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-5af8575a-7f26-46f9-9ff6-28e7007e33bb req-99b470e9-96bf-4c33-8328-56567bba90a6 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] No waiting events found dispatching network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:32:27 user nova-compute[74692]: WARNING nova.compute.manager [req-5af8575a-7f26-46f9-9ff6-28e7007e33bb req-99b470e9-96bf-4c33-8328-56567bba90a6 service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received unexpected event network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 18:32:27 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Successfully updated port: 256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.209s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquired lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:32:27 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Cannot resize image /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Ensure instance console log exists: /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:32:28 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Instance spawned successfully.
Nov 18 18:32:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "76506747-4a6b-40bd-b812-bf114be5e8b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:28 user nova-compute[74692]: INFO nova.compute.manager [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Terminating instance
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8f38b33f-49e2-4b5b-89bb-fb9d3e96bf55 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.989s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Updating instance_info_cache with network_info: [{"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Releasing lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Instance network_info: |[{"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Start _get_guest_xml network_info=[{"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:32:28 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:32:28 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-165218259',display_name='tempest-ServerRescueNegativeTestJSON-server-165218259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-165218259',id=14,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fead685ad47d4e96bb7c5225029f82ce',ramdisk_id='',reservation_id='r-w164i9re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-88342386',owner_user_name='tempest-ServerRescueNegativeTestJSON-88342386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:32:25Z,user_data=None,user_id='c418956015544fb8ac0a8acb6af6aacd',uuid=7540540c-af3e-4992-8756-3497a3bd4bf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converting VIF {"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=256c4bff-9e08-4f42-9a9a-ba78ede662e8,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256c4bff-9e') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'pci_devices' on Instance uuid 7540540c-af3e-4992-8756-3497a3bd4bf6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:32:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:32:28 user nova-compute[74692]:   <uuid>7540540c-af3e-4992-8756-3497a3bd4bf6</uuid>
Nov 18 18:32:28 user nova-compute[74692]:   <name>instance-0000000e</name>
Nov 18 18:32:28 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:32:28 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:32:28 user nova-compute[74692]:   <metadata>
Nov 18 18:32:28 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:32:28 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:32:28 user nova-compute[74692]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-165218259</nova:name>
Nov 18 18:32:28 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:32:28</nova:creationTime>
Nov 18 18:32:28 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:32:28 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:32:28 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:32:28 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:32:28 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:32:28 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:32:28 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:32:28 user nova-compute[74692]:       <nova:owner>
Nov 18 18:32:28 user nova-compute[74692]:         <nova:user uuid="c418956015544fb8ac0a8acb6af6aacd">tempest-ServerRescueNegativeTestJSON-88342386-project-member</nova:user>
Nov 18 18:32:28 user nova-compute[74692]:         <nova:project uuid="fead685ad47d4e96bb7c5225029f82ce">tempest-ServerRescueNegativeTestJSON-88342386</nova:project>
Nov 18 18:32:28 user nova-compute[74692]:       </nova:owner>
Nov 18 18:32:28 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:32:28 user nova-compute[74692]:       <nova:ports>
Nov 18 18:32:28 user nova-compute[74692]:         <nova:port uuid="256c4bff-9e08-4f42-9a9a-ba78ede662e8">
Nov 18 18:32:28 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 18 18:32:28 user nova-compute[74692]:         </nova:port>
Nov 18 18:32:28 user nova-compute[74692]:       </nova:ports>
Nov 18 18:32:28 user nova-compute[74692]:     </nova:instance>
Nov 18 18:32:28 user nova-compute[74692]:   </metadata>
Nov 18 18:32:28 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:32:28 user nova-compute[74692]:     <system>
Nov 18 18:32:28 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:32:28 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:32:28 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:32:28 user nova-compute[74692]:       <entry name="serial">7540540c-af3e-4992-8756-3497a3bd4bf6</entry>
Nov 18 18:32:28 user nova-compute[74692]:       <entry name="uuid">7540540c-af3e-4992-8756-3497a3bd4bf6</entry>
Nov 18 18:32:28 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:32:28 user nova-compute[74692]:     </system>
Nov 18 18:32:28 user nova-compute[74692]:   </sysinfo>
Nov 18 18:32:28 user nova-compute[74692]:   <os>
Nov 18 18:32:28 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:32:28 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:32:28 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:32:28 user nova-compute[74692]:   </os>
Nov 18 18:32:28 user nova-compute[74692]:   <features>
Nov 18 18:32:28 user nova-compute[74692]:     <acpi/>
Nov 18 18:32:28 user nova-compute[74692]:     <apic/>
Nov 18 18:32:28 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:32:28 user nova-compute[74692]:   </features>
Nov 18 18:32:28 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:32:28 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:32:28 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:32:28 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:32:28 user nova-compute[74692]:   </clock>
Nov 18 18:32:28 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:32:28 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:32:28 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:32:28 user nova-compute[74692]:   </cpu>
Nov 18 18:32:28 user nova-compute[74692]:   <devices>
Nov 18 18:32:28 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:32:28 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:32:28 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk"/>
Nov 18 18:32:28 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:32:28 user nova-compute[74692]:     </disk>
Nov 18 18:32:28 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:32:28 user nova-compute[74692]:       <mac address="fa:16:3e:05:a8:7e"/>
Nov 18 18:32:28 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:32:28 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:32:28 user nova-compute[74692]:       <target dev="tap256c4bff-9e"/>
Nov 18 18:32:28 user nova-compute[74692]:     </interface>
Nov 18 18:32:28 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:32:28 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/console.log" append="off"/>
Nov 18 18:32:28 user nova-compute[74692]:     </serial>
Nov 18 18:32:28 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:32:28 user nova-compute[74692]:     <video>
Nov 18 18:32:28 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:32:28 user nova-compute[74692]:     </video>
Nov 18 18:32:28 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:32:28 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:32:28 user nova-compute[74692]:     </rng>
Nov 18 18:32:28 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:32:28 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:32:28 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:32:28 user nova-compute[74692]:     </memballoon>
Nov 18 18:32:28 user nova-compute[74692]:   </devices>
Nov 18 18:32:28 user nova-compute[74692]: </domain>
Nov 18 18:32:28 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-165218259',display_name='tempest-ServerRescueNegativeTestJSON-server-165218259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-165218259',id=14,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fead685ad47d4e96bb7c5225029f82ce',ramdisk_id='',reservation_id='r-w164i9re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-88342386',owner_user_name='tempest-ServerRescueNegativeTestJSON-88342386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:32:25Z,user_data=None,user_id='c418956015544fb8ac0a8acb6af6aacd',uuid=7540540c-af3e-4992-8756-3497a3bd4bf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converting VIF {"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=256c4bff-9e08-4f42-9a9a-ba78ede662e8,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256c4bff-9e') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG os_vif [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=256c4bff-9e08-4f42-9a9a-ba78ede662e8,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256c4bff-9e') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fad116e9-6aab-58b5-87f9-751434c059ec', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap256c4bff-9e, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap256c4bff-9e, col_values=(('qos', UUID('93f0f7b8-acd2-4541-94af-5c6405cea496')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap256c4bff-9e, col_values=(('external_ids', {'iface-id': '256c4bff-9e08-4f42-9a9a-ba78ede662e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:a8:7e', 'vm-uuid': '7540540c-af3e-4992-8756-3497a3bd4bf6'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:29 user nova-compute[74692]: INFO os_vif [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=256c4bff-9e08-4f42-9a9a-ba78ede662e8,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256c4bff-9e')
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No VIF found with MAC fa:16:3e:05:a8:7e, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Successfully created port: e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:32:29 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Instance destroyed successfully.
Nov 18 18:32:29 user nova-compute[74692]: DEBUG nova.objects.instance [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lazy-loading 'resources' on Instance uuid 76506747-4a6b-40bd-b812-bf114be5e8b4 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T18:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-531822998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-626426105',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTHSxq3l9P151CfI0F18PIKGxWORN+tyCeI14rp0SJ3N9oq0TLT9ZnzNpxntJM2DuX3cToXTszKRjjVF26/nMLI0+HVGYhPNvxTS05iN12eMktmp14rfpm1F3GFT67jMA==',key_name='tempest-keypair-503198552',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:31:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='210268bb72854d749ca0e5865b441377',ramdisk_id='',reservation_id='r-0j9378kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-812059553',owner_user_name='tempest-ServerActionsV293TestJSON-812059553-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:31:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0babd17983e74a4792e3c72b70e4298b',uuid=76506747-4a6b-40bd-b812-bf114be5e8b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Converting VIF {"id": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "address": "fa:16:3e:5b:c2:39", "network": {"id": "9f685a03-85ba-4cab-bccb-8862ef230237", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1901186780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210268bb72854d749ca0e5865b441377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba43cb0-30", "ovs_interfaceid": "9ba43cb0-30b9-43ae-8f81-3df420497fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:c2:39,bridge_name='br-int',has_traffic_filtering=True,id=9ba43cb0-30b9-43ae-8f81-3df420497fff,network=Network(9f685a03-85ba-4cab-bccb-8862ef230237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba43cb0-30') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG os_vif [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:c2:39,bridge_name='br-int',has_traffic_filtering=True,id=9ba43cb0-30b9-43ae-8f81-3df420497fff,network=Network(9f685a03-85ba-4cab-bccb-8862ef230237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba43cb0-30') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-ac1f01fb-eabb-4456-9cf8-2f689928c45c req-5c507354-c9f9-4405-8f3e-040abe0798a5 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-changed-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-ac1f01fb-eabb-4456-9cf8-2f689928c45c req-5c507354-c9f9-4405-8f3e-040abe0798a5 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Refreshing instance network info cache due to event network-changed-256c4bff-9e08-4f42-9a9a-ba78ede662e8. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ac1f01fb-eabb-4456-9cf8-2f689928c45c req-5c507354-c9f9-4405-8f3e-040abe0798a5 service nova] Acquiring lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ac1f01fb-eabb-4456-9cf8-2f689928c45c req-5c507354-c9f9-4405-8f3e-040abe0798a5 service nova] Acquired lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG nova.network.neutron [req-ac1f01fb-eabb-4456-9cf8-2f689928c45c req-5c507354-c9f9-4405-8f3e-040abe0798a5 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Refreshing network info cache for port 256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ba43cb0-30, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eec77fc0-a700-459f-9de9-5056d1527f4b) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:29 user nova-compute[74692]: INFO os_vif [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:c2:39,bridge_name='br-int',has_traffic_filtering=True,id=9ba43cb0-30b9-43ae-8f81-3df420497fff,network=Network(9f685a03-85ba-4cab-bccb-8862ef230237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba43cb0-30')
Nov 18 18:32:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqQgpinc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:32:29 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:32:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:32:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a1c9f5-e1a3-42b5-bcf6-a26a70a6fe16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:32:30 user nova-compute[74692]: No targets found.
Nov 18 18:32:30 user nova-compute[74692]: iSNS:
Nov 18 18:32:30 user nova-compute[74692]: No targets found.
Nov 18 18:32:30 user nova-compute[74692]: STATIC:
Nov 18 18:32:30 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48
Nov 18 18:32:30 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:32:30 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:32:30 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0
Nov 18 18:32:30 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:32:30 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:32:30 user nova-compute[74692]: FIRMWARE:
Nov 18 18:32:30 user nova-compute[74692]: No targets found.
Nov 18 18:32:30 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:32:30 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:32:30 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d02f07e-4e8a-4263-89a6-74feff4c0ae5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[46788847-a88b-493b-bdf9-38b74ffa59af]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:32:30 user nova-compute[74692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 (non-flash)
Nov 18 18:32:30 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 (non-flash)
Nov 18 18:32:30 user nova-compute[74692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 (non-flash)
Nov 18 18:32:30 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a4568430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.054s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[438259fb-061d-4779-b93f-ac86c71346b2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f188d531-2406-4341-8694-69f048a6dbb3]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2a8ddd-61c7-46ec-87aa-dc1eee2b5c84]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a5fd7b-b3d9-4bb6-9e65-af2712d0f757]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf1bdec-2b7d-4077-ae27-a4e3c97d46f8]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1f68f3-b588-4dbe-9734-c17138a45192]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260]
Nov 18 18:32:30 user nova-compute[74692]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0, portal: 172.16.0.220,3260] successful.
Nov 18 18:32:30 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2912de2-b649-4082-bc87-4b46b3981cd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcbd93b-c4de-45e9-a9bc-86fbc014a271]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] <== disconnect_volume: return (416ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:32:30 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Deleting instance files /opt/stack/data/nova/instances/76506747-4a6b-40bd-b812-bf114be5e8b4_del
Nov 18 18:32:30 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Deletion of /opt/stack/data/nova/instances/76506747-4a6b-40bd-b812-bf114be5e8b4_del complete
Nov 18 18:32:30 user nova-compute[74692]: INFO nova.compute.manager [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Took 1.81 seconds to destroy the instance on the hypervisor.
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG nova.network.neutron [req-ac1f01fb-eabb-4456-9cf8-2f689928c45c req-5c507354-c9f9-4405-8f3e-040abe0798a5 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Updated VIF entry in instance network info cache for port 256c4bff-9e08-4f42-9a9a-ba78ede662e8. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG nova.network.neutron [req-ac1f01fb-eabb-4456-9cf8-2f689928c45c req-5c507354-c9f9-4405-8f3e-040abe0798a5 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Updating instance_info_cache with network_info: [{"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ac1f01fb-eabb-4456-9cf8-2f689928c45c req-5c507354-c9f9-4405-8f3e-040abe0798a5 service nova] Releasing lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Successfully updated port: e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "refresh_cache-d949d403-0a45-48bc-b64a-f63b114d1944" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquired lock "refresh_cache-d949d403-0a45-48bc-b64a-f63b114d1944" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-07d49e58-2172-4366-b35d-04420ca46fc1 req-464e80e8-5994-45ed-a504-5c0e1c5b8ae1 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received event network-changed-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-07d49e58-2172-4366-b35d-04420ca46fc1 req-464e80e8-5994-45ed-a504-5c0e1c5b8ae1 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Refreshing instance network info cache due to event network-changed-e8afbd9d-a907-4180-9db9-9eee0652b0f9. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-07d49e58-2172-4366-b35d-04420ca46fc1 req-464e80e8-5994-45ed-a504-5c0e1c5b8ae1 service nova] Acquiring lock "refresh_cache-d949d403-0a45-48bc-b64a-f63b114d1944" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:32:30 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Updating instance_info_cache with network_info: [{"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Releasing lock "refresh_cache-d949d403-0a45-48bc-b64a-f63b114d1944" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Instance network_info: |[{"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-07d49e58-2172-4366-b35d-04420ca46fc1 req-464e80e8-5994-45ed-a504-5c0e1c5b8ae1 service nova] Acquired lock "refresh_cache-d949d403-0a45-48bc-b64a-f63b114d1944" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.network.neutron [req-07d49e58-2172-4366-b35d-04420ca46fc1 req-464e80e8-5994-45ed-a504-5c0e1c5b8ae1 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Refreshing network info cache for port e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Start _get_guest_xml network_info=[{"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:32:31 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:32:31 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-32162393',display_name='tempest-ServerRescueNegativeTestJSON-server-32162393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-32162393',id=15,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fead685ad47d4e96bb7c5225029f82ce',ramdisk_id='',reservation_id='r-7p8a4cme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-88342386',owner_user_name='tempest-ServerRescueNegativeTestJSON-88342386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:32:27Z,user_data=None,user_id='c418956015544fb8ac0a8acb6af6aacd',uuid=d949d403-0a45-48bc-b64a-f63b114d1944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converting VIF {"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:41:ab,bridge_name='br-int',has_traffic_filtering=True,id=e8afbd9d-a907-4180-9db9-9eee0652b0f9,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8afbd9d-a9') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.objects.instance [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'pci_devices' on Instance uuid d949d403-0a45-48bc-b64a-f63b114d1944 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:32:31 user nova-compute[74692]:   <uuid>d949d403-0a45-48bc-b64a-f63b114d1944</uuid>
Nov 18 18:32:31 user nova-compute[74692]:   <name>instance-0000000f</name>
Nov 18 18:32:31 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:32:31 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:32:31 user nova-compute[74692]:   <metadata>
Nov 18 18:32:31 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:32:31 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:32:31 user nova-compute[74692]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-32162393</nova:name>
Nov 18 18:32:31 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:32:31</nova:creationTime>
Nov 18 18:32:31 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:32:31 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:32:31 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:32:31 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:32:31 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:32:31 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:32:31 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:32:31 user nova-compute[74692]:       <nova:owner>
Nov 18 18:32:31 user nova-compute[74692]:         <nova:user uuid="c418956015544fb8ac0a8acb6af6aacd">tempest-ServerRescueNegativeTestJSON-88342386-project-member</nova:user>
Nov 18 18:32:31 user nova-compute[74692]:         <nova:project uuid="fead685ad47d4e96bb7c5225029f82ce">tempest-ServerRescueNegativeTestJSON-88342386</nova:project>
Nov 18 18:32:31 user nova-compute[74692]:       </nova:owner>
Nov 18 18:32:31 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:32:31 user nova-compute[74692]:       <nova:ports>
Nov 18 18:32:31 user nova-compute[74692]:         <nova:port uuid="e8afbd9d-a907-4180-9db9-9eee0652b0f9">
Nov 18 18:32:31 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 18 18:32:31 user nova-compute[74692]:         </nova:port>
Nov 18 18:32:31 user nova-compute[74692]:       </nova:ports>
Nov 18 18:32:31 user nova-compute[74692]:     </nova:instance>
Nov 18 18:32:31 user nova-compute[74692]:   </metadata>
Nov 18 18:32:31 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:32:31 user nova-compute[74692]:     <system>
Nov 18 18:32:31 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:32:31 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:32:31 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:32:31 user nova-compute[74692]:       <entry name="serial">d949d403-0a45-48bc-b64a-f63b114d1944</entry>
Nov 18 18:32:31 user nova-compute[74692]:       <entry name="uuid">d949d403-0a45-48bc-b64a-f63b114d1944</entry>
Nov 18 18:32:31 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:32:31 user nova-compute[74692]:     </system>
Nov 18 18:32:31 user nova-compute[74692]:   </sysinfo>
Nov 18 18:32:31 user nova-compute[74692]:   <os>
Nov 18 18:32:31 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:32:31 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:32:31 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:32:31 user nova-compute[74692]:   </os>
Nov 18 18:32:31 user nova-compute[74692]:   <features>
Nov 18 18:32:31 user nova-compute[74692]:     <acpi/>
Nov 18 18:32:31 user nova-compute[74692]:     <apic/>
Nov 18 18:32:31 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:32:31 user nova-compute[74692]:   </features>
Nov 18 18:32:31 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:32:31 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:32:31 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:32:31 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:32:31 user nova-compute[74692]:   </clock>
Nov 18 18:32:31 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:32:31 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:32:31 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:32:31 user nova-compute[74692]:   </cpu>
Nov 18 18:32:31 user nova-compute[74692]:   <devices>
Nov 18 18:32:31 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:32:31 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:32:31 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk"/>
Nov 18 18:32:31 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:32:31 user nova-compute[74692]:     </disk>
Nov 18 18:32:31 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:32:31 user nova-compute[74692]:       <mac address="fa:16:3e:cc:41:ab"/>
Nov 18 18:32:31 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:32:31 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:32:31 user nova-compute[74692]:       <target dev="tape8afbd9d-a9"/>
Nov 18 18:32:31 user nova-compute[74692]:     </interface>
Nov 18 18:32:31 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:32:31 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/console.log" append="off"/>
Nov 18 18:32:31 user nova-compute[74692]:     </serial>
Nov 18 18:32:31 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:32:31 user nova-compute[74692]:     <video>
Nov 18 18:32:31 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:32:31 user nova-compute[74692]:     </video>
Nov 18 18:32:31 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:32:31 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:32:31 user nova-compute[74692]:     </rng>
Nov 18 18:32:31 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:32:31 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:32:31 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:32:31 user nova-compute[74692]:     </memballoon>
Nov 18 18:32:31 user nova-compute[74692]:   </devices>
Nov 18 18:32:31 user nova-compute[74692]: </domain>
Nov 18 18:32:31 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-32162393',display_name='tempest-ServerRescueNegativeTestJSON-server-32162393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-32162393',id=15,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fead685ad47d4e96bb7c5225029f82ce',ramdisk_id='',reservation_id='r-7p8a4cme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-88342386',owner_user_name='tempest-ServerRescueNegativeTestJSON-88342386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:32:27Z,user_data=None,user_id='c418956015544fb8ac0a8acb6af6aacd',uuid=d949d403-0a45-48bc-b64a-f63b114d1944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converting VIF {"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:41:ab,bridge_name='br-int',has_traffic_filtering=True,id=e8afbd9d-a907-4180-9db9-9eee0652b0f9,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8afbd9d-a9') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG os_vif [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:41:ab,bridge_name='br-int',has_traffic_filtering=True,id=e8afbd9d-a907-4180-9db9-9eee0652b0f9,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8afbd9d-a9') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a391863f-9384-5900-ab50-a30ad0588901', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8afbd9d-a9, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8afbd9d-a9, col_values=(('qos', UUID('efd1e4a6-2afb-430b-a532-b4ab5632dd39')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8afbd9d-a9, col_values=(('external_ids', {'iface-id': 'e8afbd9d-a907-4180-9db9-9eee0652b0f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:41:ab', 'vm-uuid': 'd949d403-0a45-48bc-b64a-f63b114d1944'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:31 user nova-compute[74692]: INFO os_vif [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:41:ab,bridge_name='br-int',has_traffic_filtering=True,id=e8afbd9d-a907-4180-9db9-9eee0652b0f9,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8afbd9d-a9')
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No VIF found with MAC fa:16:3e:cc:41:ab, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.network.neutron [req-07d49e58-2172-4366-b35d-04420ca46fc1 req-464e80e8-5994-45ed-a504-5c0e1c5b8ae1 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Updated VIF entry in instance network info cache for port e8afbd9d-a907-4180-9db9-9eee0652b0f9. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.network.neutron [req-07d49e58-2172-4366-b35d-04420ca46fc1 req-464e80e8-5994-45ed-a504-5c0e1c5b8ae1 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Updating instance_info_cache with network_info: [{"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-07d49e58-2172-4366-b35d-04420ca46fc1 req-464e80e8-5994-45ed-a504-5c0e1c5b8ae1 service nova] Releasing lock "refresh_cache-d949d403-0a45-48bc-b64a-f63b114d1944" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:32:31 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Took 1.33 seconds to deallocate network for instance.
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-bc293ff5-0d0f-4451-b789-7538e0b83b71 req-2c3c32fc-c7f7-4ba7-88c0-d0c50aca4a80 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Received event network-vif-deleted-9ba43cb0-30b9-43ae-8f81-3df420497fff {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:31 user nova-compute[74692]: INFO nova.compute.manager [req-bc293ff5-0d0f-4451-b789-7538e0b83b71 req-2c3c32fc-c7f7-4ba7-88c0-d0c50aca4a80 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Neutron deleted interface 9ba43cb0-30b9-43ae-8f81-3df420497fff; detaching it from the instance and deleting it from the info cache
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.network.neutron [req-bc293ff5-0d0f-4451-b789-7538e0b83b71 req-2c3c32fc-c7f7-4ba7-88c0-d0c50aca4a80 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-bc293ff5-0d0f-4451-b789-7538e0b83b71 req-2c3c32fc-c7f7-4ba7-88c0-d0c50aca4a80 service nova] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Detach interface failed, port_id=9ba43cb0-30b9-43ae-8f81-3df420497fff, reason: Instance 76506747-4a6b-40bd-b812-bf114be5e8b4 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1653a52-64b9-4291-8d0f-9416e8bafec3 req-b7159da1-f1a4-4e75-9661-cdf4039cd2f1 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1653a52-64b9-4291-8d0f-9416e8bafec3 req-b7159da1-f1a4-4e75-9661-cdf4039cd2f1 service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1653a52-64b9-4291-8d0f-9416e8bafec3 req-b7159da1-f1a4-4e75-9661-cdf4039cd2f1 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1653a52-64b9-4291-8d0f-9416e8bafec3 req-b7159da1-f1a4-4e75-9661-cdf4039cd2f1 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1653a52-64b9-4291-8d0f-9416e8bafec3 req-b7159da1-f1a4-4e75-9661-cdf4039cd2f1 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:32:31 user nova-compute[74692]: WARNING nova.compute.manager [req-b1653a52-64b9-4291-8d0f-9416e8bafec3 req-b7159da1-f1a4-4e75-9661-cdf4039cd2f1 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received unexpected event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with vm_state building and task_state spawning.
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1653a52-64b9-4291-8d0f-9416e8bafec3 req-b7159da1-f1a4-4e75-9661-cdf4039cd2f1 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1653a52-64b9-4291-8d0f-9416e8bafec3 req-b7159da1-f1a4-4e75-9661-cdf4039cd2f1 service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1653a52-64b9-4291-8d0f-9416e8bafec3 req-b7159da1-f1a4-4e75-9661-cdf4039cd2f1 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b1653a52-64b9-4291-8d0f-9416e8bafec3 req-b7159da1-f1a4-4e75-9661-cdf4039cd2f1 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-b1653a52-64b9-4291-8d0f-9416e8bafec3 req-b7159da1-f1a4-4e75-9661-cdf4039cd2f1 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:32:31 user nova-compute[74692]: WARNING nova.compute.manager [req-b1653a52-64b9-4291-8d0f-9416e8bafec3 req-b7159da1-f1a4-4e75-9661-cdf4039cd2f1 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received unexpected event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with vm_state building and task_state spawning.
Nov 18 18:32:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:32 user nova-compute[74692]: INFO nova.compute.manager [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Took 0.94 seconds to detach 1 volumes for instance.
Nov 18 18:32:32 user nova-compute[74692]: DEBUG nova.compute.manager [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] [instance: 76506747-4a6b-40bd-b812-bf114be5e8b4] Deleting volume: a2912de2-b649-4082-bc87-4b46b3981cd0 {{(pid=74692) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 18:32:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:33 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:32:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:33 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:32:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "c9c2ea43-093a-48ea-a464-373482eb1638" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c9c2ea43-093a-48ea-a464-373482eb1638" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:33 user nova-compute[74692]: DEBUG nova.compute.manager [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:32:33 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Deleted allocations for instance 76506747-4a6b-40bd-b812-bf114be5e8b4
Nov 18 18:32:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:33 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:32:33 user nova-compute[74692]: INFO nova.compute.claims [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Claim successful on node user
Nov 18 18:32:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06041d82-e189-49b4-9da2-d39fc1e5b168 tempest-ServerActionsV293TestJSON-812059553 tempest-ServerActionsV293TestJSON-812059553-project-member] Lock "76506747-4a6b-40bd-b812-bf114be5e8b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.901s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:33 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:32:33 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:32:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:33 user nova-compute[74692]: DEBUG nova.compute.manager [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.network.neutron [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-fc7289b7-bd8d-4652-ab93-cbeb3dd658ac req-49903073-5520-4bf0-9049-132a6876aeef service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received event network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fc7289b7-bd8d-4652-ab93-cbeb3dd658ac req-49903073-5520-4bf0-9049-132a6876aeef service nova] Acquiring lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fc7289b7-bd8d-4652-ab93-cbeb3dd658ac req-49903073-5520-4bf0-9049-132a6876aeef service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fc7289b7-bd8d-4652-ab93-cbeb3dd658ac req-49903073-5520-4bf0-9049-132a6876aeef service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-fc7289b7-bd8d-4652-ab93-cbeb3dd658ac req-49903073-5520-4bf0-9049-132a6876aeef service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] No waiting events found dispatching network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:32:34 user nova-compute[74692]: WARNING nova.compute.manager [req-fc7289b7-bd8d-4652-ab93-cbeb3dd658ac req-49903073-5520-4bf0-9049-132a6876aeef service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received unexpected event network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 for instance with vm_state building and task_state spawning.
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-fc7289b7-bd8d-4652-ab93-cbeb3dd658ac req-49903073-5520-4bf0-9049-132a6876aeef service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received event network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fc7289b7-bd8d-4652-ab93-cbeb3dd658ac req-49903073-5520-4bf0-9049-132a6876aeef service nova] Acquiring lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fc7289b7-bd8d-4652-ab93-cbeb3dd658ac req-49903073-5520-4bf0-9049-132a6876aeef service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fc7289b7-bd8d-4652-ab93-cbeb3dd658ac req-49903073-5520-4bf0-9049-132a6876aeef service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-fc7289b7-bd8d-4652-ab93-cbeb3dd658ac req-49903073-5520-4bf0-9049-132a6876aeef service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] No waiting events found dispatching network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:32:34 user nova-compute[74692]: WARNING nova.compute.manager [req-fc7289b7-bd8d-4652-ab93-cbeb3dd658ac req-49903073-5520-4bf0-9049-132a6876aeef service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received unexpected event network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 for instance with vm_state building and task_state spawning.
Nov 18 18:32:34 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.policy [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a97cd00e39c84616a0d114827b66687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1029d1e2110746d3af205df825090efa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:32:34 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Creating image(s)
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "/opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "/opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.236s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk 1073741824" returned: 0 in 0.068s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:34 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Instance spawned successfully.
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:35 user nova-compute[74692]: INFO nova.compute.manager [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Took 9.54 seconds to spawn the instance on the hypervisor.
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.262s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.network.neutron [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Successfully created port: fe82ba82-5046-473f-b0a7-7212a924e5de {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:32:35 user nova-compute[74692]: INFO nova.compute.manager [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Took 10.52 seconds to build instance.
Nov 18 18:32:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c5d89790-01d7-4fa7-89ab-a00592bf3986 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.651s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Cannot resize image /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Ensure instance console log exists: /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:32:35 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Instance spawned successfully.
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:35 user nova-compute[74692]: INFO nova.compute.manager [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Took 8.58 seconds to spawn the instance on the hypervisor.
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:32:35 user nova-compute[74692]: INFO nova.compute.manager [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Took 10.01 seconds to build instance.
Nov 18 18:32:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6443de63-ec74-46e0-b750-07a7d3beb397 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "d949d403-0a45-48bc-b64a-f63b114d1944" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.131s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.network.neutron [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Successfully updated port: fe82ba82-5046-473f-b0a7-7212a924e5de {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "refresh_cache-c9c2ea43-093a-48ea-a464-373482eb1638" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquired lock "refresh_cache-c9c2ea43-093a-48ea-a464-373482eb1638" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:32:35 user nova-compute[74692]: DEBUG nova.network.neutron [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-5e24d804-857e-43a8-8e2d-e62a8b2dbfe6 req-c5010b9f-8d97-4f33-9643-008a3b4db47a service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Received event network-changed-fe82ba82-5046-473f-b0a7-7212a924e5de {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-5e24d804-857e-43a8-8e2d-e62a8b2dbfe6 req-c5010b9f-8d97-4f33-9643-008a3b4db47a service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Refreshing instance network info cache due to event network-changed-fe82ba82-5046-473f-b0a7-7212a924e5de. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5e24d804-857e-43a8-8e2d-e62a8b2dbfe6 req-c5010b9f-8d97-4f33-9643-008a3b4db47a service nova] Acquiring lock "refresh_cache-c9c2ea43-093a-48ea-a464-373482eb1638" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.network.neutron [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.network.neutron [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Updating instance_info_cache with network_info: [{"id": "fe82ba82-5046-473f-b0a7-7212a924e5de", "address": "fa:16:3e:f3:04:2c", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe82ba82-50", "ovs_interfaceid": "fe82ba82-5046-473f-b0a7-7212a924e5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Releasing lock "refresh_cache-c9c2ea43-093a-48ea-a464-373482eb1638" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Instance network_info: |[{"id": "fe82ba82-5046-473f-b0a7-7212a924e5de", "address": "fa:16:3e:f3:04:2c", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe82ba82-50", "ovs_interfaceid": "fe82ba82-5046-473f-b0a7-7212a924e5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5e24d804-857e-43a8-8e2d-e62a8b2dbfe6 req-c5010b9f-8d97-4f33-9643-008a3b4db47a service nova] Acquired lock "refresh_cache-c9c2ea43-093a-48ea-a464-373482eb1638" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.network.neutron [req-5e24d804-857e-43a8-8e2d-e62a8b2dbfe6 req-c5010b9f-8d97-4f33-9643-008a3b4db47a service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Refreshing network info cache for port fe82ba82-5046-473f-b0a7-7212a924e5de {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Start _get_guest_xml network_info=[{"id": "fe82ba82-5046-473f-b0a7-7212a924e5de", "address": "fa:16:3e:f3:04:2c", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe82ba82-50", "ovs_interfaceid": "fe82ba82-5046-473f-b0a7-7212a924e5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:32:36 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:32:36 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1186102364',display_name='tempest-VolumesAdminNegativeTest-server-1186102364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1186102364',id=16,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAF2Ywzij3VucBz1XLsbwKcgHwEsTK0Irec0nyxrif+FcUy4bo0LAMKR8naJ4FgnEke1cr9SguD/JRU4MFhyFldVLAtYbbeulntOYL3dMRM6QzqEIAV3IGludvP9//8kbw==',key_name='tempest-keypair-1475509525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1029d1e2110746d3af205df825090efa',ramdisk_id='',reservation_id='r-q6ivqvhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1838367509',owner_user_name='tempest-VolumesAdminNegativeTest-1838367509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:32:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a97cd00e39c84616a0d114827b66687a',uuid=c9c2ea43-093a-48ea-a464-373482eb1638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe82ba82-5046-473f-b0a7-7212a924e5de", "address": "fa:16:3e:f3:04:2c", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe82ba82-50", "ovs_interfaceid": "fe82ba82-5046-473f-b0a7-7212a924e5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Converting VIF {"id": "fe82ba82-5046-473f-b0a7-7212a924e5de", "address": "fa:16:3e:f3:04:2c", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe82ba82-50", "ovs_interfaceid": "fe82ba82-5046-473f-b0a7-7212a924e5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:04:2c,bridge_name='br-int',has_traffic_filtering=True,id=fe82ba82-5046-473f-b0a7-7212a924e5de,network=Network(8f7fd586-cc31-4828-bd1b-b9c67e164813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe82ba82-50') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.objects.instance [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lazy-loading 'pci_devices' on Instance uuid c9c2ea43-093a-48ea-a464-373482eb1638 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:32:36 user nova-compute[74692]:   <uuid>c9c2ea43-093a-48ea-a464-373482eb1638</uuid>
Nov 18 18:32:36 user nova-compute[74692]:   <name>instance-00000010</name>
Nov 18 18:32:36 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:32:36 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:32:36 user nova-compute[74692]:   <metadata>
Nov 18 18:32:36 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:32:36 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:32:36 user nova-compute[74692]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1186102364</nova:name>
Nov 18 18:32:36 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:32:36</nova:creationTime>
Nov 18 18:32:36 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:32:36 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:32:36 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:32:36 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:32:36 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:32:36 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:32:36 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:32:36 user nova-compute[74692]:       <nova:owner>
Nov 18 18:32:36 user nova-compute[74692]:         <nova:user uuid="a97cd00e39c84616a0d114827b66687a">tempest-VolumesAdminNegativeTest-1838367509-project-member</nova:user>
Nov 18 18:32:36 user nova-compute[74692]:         <nova:project uuid="1029d1e2110746d3af205df825090efa">tempest-VolumesAdminNegativeTest-1838367509</nova:project>
Nov 18 18:32:36 user nova-compute[74692]:       </nova:owner>
Nov 18 18:32:36 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:32:36 user nova-compute[74692]:       <nova:ports>
Nov 18 18:32:36 user nova-compute[74692]:         <nova:port uuid="fe82ba82-5046-473f-b0a7-7212a924e5de">
Nov 18 18:32:36 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 18:32:36 user nova-compute[74692]:         </nova:port>
Nov 18 18:32:36 user nova-compute[74692]:       </nova:ports>
Nov 18 18:32:36 user nova-compute[74692]:     </nova:instance>
Nov 18 18:32:36 user nova-compute[74692]:   </metadata>
Nov 18 18:32:36 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:32:36 user nova-compute[74692]:     <system>
Nov 18 18:32:36 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:32:36 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:32:36 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:32:36 user nova-compute[74692]:       <entry name="serial">c9c2ea43-093a-48ea-a464-373482eb1638</entry>
Nov 18 18:32:36 user nova-compute[74692]:       <entry name="uuid">c9c2ea43-093a-48ea-a464-373482eb1638</entry>
Nov 18 18:32:36 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:32:36 user nova-compute[74692]:     </system>
Nov 18 18:32:36 user nova-compute[74692]:   </sysinfo>
Nov 18 18:32:36 user nova-compute[74692]:   <os>
Nov 18 18:32:36 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:32:36 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:32:36 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:32:36 user nova-compute[74692]:   </os>
Nov 18 18:32:36 user nova-compute[74692]:   <features>
Nov 18 18:32:36 user nova-compute[74692]:     <acpi/>
Nov 18 18:32:36 user nova-compute[74692]:     <apic/>
Nov 18 18:32:36 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:32:36 user nova-compute[74692]:   </features>
Nov 18 18:32:36 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:32:36 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:32:36 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:32:36 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:32:36 user nova-compute[74692]:   </clock>
Nov 18 18:32:36 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:32:36 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:32:36 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:32:36 user nova-compute[74692]:   </cpu>
Nov 18 18:32:36 user nova-compute[74692]:   <devices>
Nov 18 18:32:36 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:32:36 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:32:36 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk"/>
Nov 18 18:32:36 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:32:36 user nova-compute[74692]:     </disk>
Nov 18 18:32:36 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:32:36 user nova-compute[74692]:       <mac address="fa:16:3e:f3:04:2c"/>
Nov 18 18:32:36 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:32:36 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:32:36 user nova-compute[74692]:       <target dev="tapfe82ba82-50"/>
Nov 18 18:32:36 user nova-compute[74692]:     </interface>
Nov 18 18:32:36 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:32:36 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/console.log" append="off"/>
Nov 18 18:32:36 user nova-compute[74692]:     </serial>
Nov 18 18:32:36 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:32:36 user nova-compute[74692]:     <video>
Nov 18 18:32:36 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:32:36 user nova-compute[74692]:     </video>
Nov 18 18:32:36 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:32:36 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:32:36 user nova-compute[74692]:     </rng>
Nov 18 18:32:36 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:32:36 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:32:36 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:32:36 user nova-compute[74692]:     </memballoon>
Nov 18 18:32:36 user nova-compute[74692]:   </devices>
Nov 18 18:32:36 user nova-compute[74692]: </domain>
Nov 18 18:32:36 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1186102364',display_name='tempest-VolumesAdminNegativeTest-server-1186102364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1186102364',id=16,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAF2Ywzij3VucBz1XLsbwKcgHwEsTK0Irec0nyxrif+FcUy4bo0LAMKR8naJ4FgnEke1cr9SguD/JRU4MFhyFldVLAtYbbeulntOYL3dMRM6QzqEIAV3IGludvP9//8kbw==',key_name='tempest-keypair-1475509525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1029d1e2110746d3af205df825090efa',ramdisk_id='',reservation_id='r-q6ivqvhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1838367509',owner_user_name='tempest-VolumesAdminNegativeTest-1838367509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:32:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a97cd00e39c84616a0d114827b66687a',uuid=c9c2ea43-093a-48ea-a464-373482eb1638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe82ba82-5046-473f-b0a7-7212a924e5de", "address": "fa:16:3e:f3:04:2c", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe82ba82-50", "ovs_interfaceid": "fe82ba82-5046-473f-b0a7-7212a924e5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Converting VIF {"id": "fe82ba82-5046-473f-b0a7-7212a924e5de", "address": "fa:16:3e:f3:04:2c", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe82ba82-50", "ovs_interfaceid": "fe82ba82-5046-473f-b0a7-7212a924e5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:04:2c,bridge_name='br-int',has_traffic_filtering=True,id=fe82ba82-5046-473f-b0a7-7212a924e5de,network=Network(8f7fd586-cc31-4828-bd1b-b9c67e164813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe82ba82-50') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG os_vif [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:04:2c,bridge_name='br-int',has_traffic_filtering=True,id=fe82ba82-5046-473f-b0a7-7212a924e5de,network=Network(8f7fd586-cc31-4828-bd1b-b9c67e164813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe82ba82-50') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c06ae9c1-732b-5703-b0e3-5d6add033b8b', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe82ba82-50, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe82ba82-50, col_values=(('qos', UUID('a77b2709-4410-4e1f-937e-d8c2da297b45')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe82ba82-50, col_values=(('external_ids', {'iface-id': 'fe82ba82-5046-473f-b0a7-7212a924e5de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:04:2c', 'vm-uuid': 'c9c2ea43-093a-48ea-a464-373482eb1638'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:36 user nova-compute[74692]: INFO os_vif [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:04:2c,bridge_name='br-int',has_traffic_filtering=True,id=fe82ba82-5046-473f-b0a7-7212a924e5de,network=Network(8f7fd586-cc31-4828-bd1b-b9c67e164813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe82ba82-50')
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:32:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] No VIF found with MAC fa:16:3e:f3:04:2c, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:32:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:37 user nova-compute[74692]: DEBUG nova.network.neutron [req-5e24d804-857e-43a8-8e2d-e62a8b2dbfe6 req-c5010b9f-8d97-4f33-9643-008a3b4db47a service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Updated VIF entry in instance network info cache for port fe82ba82-5046-473f-b0a7-7212a924e5de. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:32:37 user nova-compute[74692]: DEBUG nova.network.neutron [req-5e24d804-857e-43a8-8e2d-e62a8b2dbfe6 req-c5010b9f-8d97-4f33-9643-008a3b4db47a service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Updating instance_info_cache with network_info: [{"id": "fe82ba82-5046-473f-b0a7-7212a924e5de", "address": "fa:16:3e:f3:04:2c", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe82ba82-50", "ovs_interfaceid": "fe82ba82-5046-473f-b0a7-7212a924e5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:32:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5e24d804-857e-43a8-8e2d-e62a8b2dbfe6 req-c5010b9f-8d97-4f33-9643-008a3b4db47a service nova] Releasing lock "refresh_cache-c9c2ea43-093a-48ea-a464-373482eb1638" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:32:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-72f596cc-8a30-4c9b-a20b-4fc7e0906246 req-8121f88b-6e8a-4489-82a1-5c8ef1f999c0 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Received event network-vif-plugged-fe82ba82-5046-473f-b0a7-7212a924e5de {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-72f596cc-8a30-4c9b-a20b-4fc7e0906246 req-8121f88b-6e8a-4489-82a1-5c8ef1f999c0 service nova] Acquiring lock "c9c2ea43-093a-48ea-a464-373482eb1638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-72f596cc-8a30-4c9b-a20b-4fc7e0906246 req-8121f88b-6e8a-4489-82a1-5c8ef1f999c0 service nova] Lock "c9c2ea43-093a-48ea-a464-373482eb1638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-72f596cc-8a30-4c9b-a20b-4fc7e0906246 req-8121f88b-6e8a-4489-82a1-5c8ef1f999c0 service nova] Lock "c9c2ea43-093a-48ea-a464-373482eb1638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-72f596cc-8a30-4c9b-a20b-4fc7e0906246 req-8121f88b-6e8a-4489-82a1-5c8ef1f999c0 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] No waiting events found dispatching network-vif-plugged-fe82ba82-5046-473f-b0a7-7212a924e5de {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:32:38 user nova-compute[74692]: WARNING nova.compute.manager [req-72f596cc-8a30-4c9b-a20b-4fc7e0906246 req-8121f88b-6e8a-4489-82a1-5c8ef1f999c0 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Received unexpected event network-vif-plugged-fe82ba82-5046-473f-b0a7-7212a924e5de for instance with vm_state building and task_state spawning.
Nov 18 18:32:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-7faca1d1-f47b-41e5-9e82-26861af37909 req-d3b824ad-7178-45bf-9a30-748c9c42d2e8 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Received event network-vif-plugged-fe82ba82-5046-473f-b0a7-7212a924e5de {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:32:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7faca1d1-f47b-41e5-9e82-26861af37909 req-d3b824ad-7178-45bf-9a30-748c9c42d2e8 service nova] Acquiring lock "c9c2ea43-093a-48ea-a464-373482eb1638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:32:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7faca1d1-f47b-41e5-9e82-26861af37909 req-d3b824ad-7178-45bf-9a30-748c9c42d2e8 service nova] Lock "c9c2ea43-093a-48ea-a464-373482eb1638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:32:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7faca1d1-f47b-41e5-9e82-26861af37909 req-d3b824ad-7178-45bf-9a30-748c9c42d2e8 service nova] Lock "c9c2ea43-093a-48ea-a464-373482eb1638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-7faca1d1-f47b-41e5-9e82-26861af37909 req-d3b824ad-7178-45bf-9a30-748c9c42d2e8 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] No waiting events found dispatching network-vif-plugged-fe82ba82-5046-473f-b0a7-7212a924e5de {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:32:40 user nova-compute[74692]: WARNING nova.compute.manager [req-7faca1d1-f47b-41e5-9e82-26861af37909 req-d3b824ad-7178-45bf-9a30-748c9c42d2e8 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Received unexpected event network-vif-plugged-fe82ba82-5046-473f-b0a7-7212a924e5de for instance with vm_state building and task_state spawning.
Nov 18 18:32:40 user nova-compute[74692]: DEBUG nova.compute.manager [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:32:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:32:40 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Instance spawned successfully.
Nov 18 18:32:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:32:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:32:41 user nova-compute[74692]: INFO nova.compute.manager [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Took 6.89 seconds to spawn the instance on the hypervisor.
Nov 18 18:32:41 user nova-compute[74692]: DEBUG nova.compute.manager [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:32:41 user nova-compute[74692]: INFO nova.compute.manager [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Took 7.81 seconds to build instance.
Nov 18 18:32:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ac735074-ff9b-4241-8908-18a7ef817d8a tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c9c2ea43-093a-48ea-a464-373482eb1638" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.967s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:32:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:32:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:33:00 user nova-compute[74692]: INFO nova.compute.claims [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Claim successful on node user
Nov 18 18:33:00 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG nova.network.neutron [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:33:00 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:33:00 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG nova.policy [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9dad2e2f1d541bf803b5d923db5242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da05b2ed39a3489db70da40991bc8e48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:33:00 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Creating image(s)
Nov 18 18:33:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "/opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "/opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "/opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.428s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk 1073741824" returned: 0 in 0.050s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Cannot resize image /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Ensure instance console log exists: /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG nova.network.neutron [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Successfully created port: 9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:33:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:02 user nova-compute[74692]: DEBUG nova.network.neutron [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Successfully updated port: 9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:33:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:33:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquired lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:33:02 user nova-compute[74692]: DEBUG nova.network.neutron [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:33:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-36b40e93-f690-4c88-a274-b3b426f5be54 req-c7b0424c-b9cc-4c22-805c-8ec48b3ce233 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-changed-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-36b40e93-f690-4c88-a274-b3b426f5be54 req-c7b0424c-b9cc-4c22-805c-8ec48b3ce233 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Refreshing instance network info cache due to event network-changed-9753f583-4360-48e8-a59f-43b16198aa36. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:33:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-36b40e93-f690-4c88-a274-b3b426f5be54 req-c7b0424c-b9cc-4c22-805c-8ec48b3ce233 service nova] Acquiring lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:33:02 user nova-compute[74692]: DEBUG nova.network.neutron [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.network.neutron [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Updating instance_info_cache with network_info: [{"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Releasing lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Instance network_info: |[{"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-36b40e93-f690-4c88-a274-b3b426f5be54 req-c7b0424c-b9cc-4c22-805c-8ec48b3ce233 service nova] Acquired lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.network.neutron [req-36b40e93-f690-4c88-a274-b3b426f5be54 req-c7b0424c-b9cc-4c22-805c-8ec48b3ce233 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Refreshing network info cache for port 9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Start _get_guest_xml network_info=[{"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:33:03 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:33:03 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1934677203',display_name='tempest-AttachVolumeTestJSON-server-1934677203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1934677203',id=17,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWoJ1g21ysWeKm0aCaq0iDAu6GFhJ4Kgqa/cYa4mb67PyeCSQSB1+k/re9L+dOqnhT2aQmCtGqB0zHW7DLxwgFWBB78ohK6z8iaUSg7A5I+FxwvxJ5cm1dB7niInB9aXw==',key_name='tempest-keypair-29977122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da05b2ed39a3489db70da40991bc8e48',ramdisk_id='',reservation_id='r-xspl17l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-858172900',owner_user_name='tempest-AttachVolumeTestJSON-858172900-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:33:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9dad2e2f1d541bf803b5d923db5242b',uuid=96c70a3c-82db-4adf-8f9b-4e7c1a37b519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converting VIF {"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.objects.instance [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'pci_devices' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:33:03 user nova-compute[74692]:   <uuid>96c70a3c-82db-4adf-8f9b-4e7c1a37b519</uuid>
Nov 18 18:33:03 user nova-compute[74692]:   <name>instance-00000011</name>
Nov 18 18:33:03 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:33:03 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:33:03 user nova-compute[74692]:   <metadata>
Nov 18 18:33:03 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:33:03 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:33:03 user nova-compute[74692]:       <nova:name>tempest-AttachVolumeTestJSON-server-1934677203</nova:name>
Nov 18 18:33:03 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:33:03</nova:creationTime>
Nov 18 18:33:03 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:33:03 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:33:03 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:33:03 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:33:03 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:33:03 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:33:03 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:33:03 user nova-compute[74692]:       <nova:owner>
Nov 18 18:33:03 user nova-compute[74692]:         <nova:user uuid="f9dad2e2f1d541bf803b5d923db5242b">tempest-AttachVolumeTestJSON-858172900-project-member</nova:user>
Nov 18 18:33:03 user nova-compute[74692]:         <nova:project uuid="da05b2ed39a3489db70da40991bc8e48">tempest-AttachVolumeTestJSON-858172900</nova:project>
Nov 18 18:33:03 user nova-compute[74692]:       </nova:owner>
Nov 18 18:33:03 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:33:03 user nova-compute[74692]:       <nova:ports>
Nov 18 18:33:03 user nova-compute[74692]:         <nova:port uuid="9753f583-4360-48e8-a59f-43b16198aa36">
Nov 18 18:33:03 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 18:33:03 user nova-compute[74692]:         </nova:port>
Nov 18 18:33:03 user nova-compute[74692]:       </nova:ports>
Nov 18 18:33:03 user nova-compute[74692]:     </nova:instance>
Nov 18 18:33:03 user nova-compute[74692]:   </metadata>
Nov 18 18:33:03 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:33:03 user nova-compute[74692]:     <system>
Nov 18 18:33:03 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:33:03 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:33:03 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:33:03 user nova-compute[74692]:       <entry name="serial">96c70a3c-82db-4adf-8f9b-4e7c1a37b519</entry>
Nov 18 18:33:03 user nova-compute[74692]:       <entry name="uuid">96c70a3c-82db-4adf-8f9b-4e7c1a37b519</entry>
Nov 18 18:33:03 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:33:03 user nova-compute[74692]:     </system>
Nov 18 18:33:03 user nova-compute[74692]:   </sysinfo>
Nov 18 18:33:03 user nova-compute[74692]:   <os>
Nov 18 18:33:03 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:33:03 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:33:03 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:33:03 user nova-compute[74692]:   </os>
Nov 18 18:33:03 user nova-compute[74692]:   <features>
Nov 18 18:33:03 user nova-compute[74692]:     <acpi/>
Nov 18 18:33:03 user nova-compute[74692]:     <apic/>
Nov 18 18:33:03 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:33:03 user nova-compute[74692]:   </features>
Nov 18 18:33:03 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:33:03 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:33:03 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:33:03 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:33:03 user nova-compute[74692]:   </clock>
Nov 18 18:33:03 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:33:03 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:33:03 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:33:03 user nova-compute[74692]:   </cpu>
Nov 18 18:33:03 user nova-compute[74692]:   <devices>
Nov 18 18:33:03 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:33:03 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:33:03 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk"/>
Nov 18 18:33:03 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:33:03 user nova-compute[74692]:     </disk>
Nov 18 18:33:03 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:33:03 user nova-compute[74692]:       <mac address="fa:16:3e:bb:07:0d"/>
Nov 18 18:33:03 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:33:03 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:33:03 user nova-compute[74692]:       <target dev="tap9753f583-43"/>
Nov 18 18:33:03 user nova-compute[74692]:     </interface>
Nov 18 18:33:03 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:33:03 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/console.log" append="off"/>
Nov 18 18:33:03 user nova-compute[74692]:     </serial>
Nov 18 18:33:03 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:33:03 user nova-compute[74692]:     <video>
Nov 18 18:33:03 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:33:03 user nova-compute[74692]:     </video>
Nov 18 18:33:03 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:33:03 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:33:03 user nova-compute[74692]:     </rng>
Nov 18 18:33:03 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:33:03 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:33:03 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:33:03 user nova-compute[74692]:     </memballoon>
Nov 18 18:33:03 user nova-compute[74692]:   </devices>
Nov 18 18:33:03 user nova-compute[74692]: </domain>
Nov 18 18:33:03 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1934677203',display_name='tempest-AttachVolumeTestJSON-server-1934677203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1934677203',id=17,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWoJ1g21ysWeKm0aCaq0iDAu6GFhJ4Kgqa/cYa4mb67PyeCSQSB1+k/re9L+dOqnhT2aQmCtGqB0zHW7DLxwgFWBB78ohK6z8iaUSg7A5I+FxwvxJ5cm1dB7niInB9aXw==',key_name='tempest-keypair-29977122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da05b2ed39a3489db70da40991bc8e48',ramdisk_id='',reservation_id='r-xspl17l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-858172900',owner_user_name='tempest-AttachVolumeTestJSON-858172900-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:33:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9dad2e2f1d541bf803b5d923db5242b',uuid=96c70a3c-82db-4adf-8f9b-4e7c1a37b519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converting VIF {"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG os_vif [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d88f4da-8f63-58ae-8bc7-979312d8dcdd', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9753f583-43, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9753f583-43, col_values=(('qos', UUID('eb90cc82-c04e-4125-bfa0-684d81b6f536')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9753f583-43, col_values=(('external_ids', {'iface-id': '9753f583-4360-48e8-a59f-43b16198aa36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:07:0d', 'vm-uuid': '96c70a3c-82db-4adf-8f9b-4e7c1a37b519'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:03 user nova-compute[74692]: INFO os_vif [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43')
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] No VIF found with MAC fa:16:3e:bb:07:0d, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.network.neutron [req-36b40e93-f690-4c88-a274-b3b426f5be54 req-c7b0424c-b9cc-4c22-805c-8ec48b3ce233 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Updated VIF entry in instance network info cache for port 9753f583-4360-48e8-a59f-43b16198aa36. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG nova.network.neutron [req-36b40e93-f690-4c88-a274-b3b426f5be54 req-c7b0424c-b9cc-4c22-805c-8ec48b3ce233 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Updating instance_info_cache with network_info: [{"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:33:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-36b40e93-f690-4c88-a274-b3b426f5be54 req-c7b0424c-b9cc-4c22-805c-8ec48b3ce233 service nova] Releasing lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:33:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:04 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:33:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-1ae5e366-759f-497b-beee-87e51aa4ce0e req-f9a2a192-18c5-41cf-adba-67c4976f4a37 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1ae5e366-759f-497b-beee-87e51aa4ce0e req-f9a2a192-18c5-41cf-adba-67c4976f4a37 service nova] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1ae5e366-759f-497b-beee-87e51aa4ce0e req-f9a2a192-18c5-41cf-adba-67c4976f4a37 service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1ae5e366-759f-497b-beee-87e51aa4ce0e req-f9a2a192-18c5-41cf-adba-67c4976f4a37 service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-1ae5e366-759f-497b-beee-87e51aa4ce0e req-f9a2a192-18c5-41cf-adba-67c4976f4a37 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] No waiting events found dispatching network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:33:05 user nova-compute[74692]: WARNING nova.compute.manager [req-1ae5e366-759f-497b-beee-87e51aa4ce0e req-f9a2a192-18c5-41cf-adba-67c4976f4a37 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received unexpected event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 for instance with vm_state building and task_state spawning.
Nov 18 18:33:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:05 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:33:06 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:33:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:06 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG nova.compute.manager [req-a882f0b6-6318-466e-a5cb-367b33ccce61 req-8aca7451-96e1-4db4-babf-23b8d5ac3b5f service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a882f0b6-6318-466e-a5cb-367b33ccce61 req-8aca7451-96e1-4db4-babf-23b8d5ac3b5f service nova] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a882f0b6-6318-466e-a5cb-367b33ccce61 req-8aca7451-96e1-4db4-babf-23b8d5ac3b5f service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a882f0b6-6318-466e-a5cb-367b33ccce61 req-8aca7451-96e1-4db4-babf-23b8d5ac3b5f service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG nova.compute.manager [req-a882f0b6-6318-466e-a5cb-367b33ccce61 req-8aca7451-96e1-4db4-babf-23b8d5ac3b5f service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] No waiting events found dispatching network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:33:07 user nova-compute[74692]: WARNING nova.compute.manager [req-a882f0b6-6318-466e-a5cb-367b33ccce61 req-8aca7451-96e1-4db4-babf-23b8d5ac3b5f service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received unexpected event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 for instance with vm_state building and task_state spawning.
Nov 18 18:33:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:33:07 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Instance spawned successfully.
Nov 18 18:33:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:07 user nova-compute[74692]: INFO nova.compute.manager [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Took 6.88 seconds to spawn the instance on the hypervisor.
Nov 18 18:33:07 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:07 user nova-compute[74692]: INFO nova.compute.manager [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Took 7.65 seconds to build instance.
Nov 18 18:33:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b49e3a1a-ca11-44e9-8d37-3f27a5da1612 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.803s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:33:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:10 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:33:10 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:33:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7766MB free_disk=25.45565414428711GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:33:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 153d4723-7ede-41b3-9f64-a0487f617ed2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:33:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 2fbc1048-58dc-41ab-9e36-b7c3b0be9741 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:33:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance bebb6344-183e-4367-bb0b-b575b70adfbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:33:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:33:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:33:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance c9c2ea43-093a-48ea-a464-373482eb1638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:33:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:33:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:33:10 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:33:11 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:33:11 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:33:11 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:33:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.513s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:13 user nova-compute[74692]: DEBUG nova.compute.manager [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:33:14 user nova-compute[74692]: INFO nova.compute.claims [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Claim successful on node user
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG nova.compute.manager [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG nova.compute.manager [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG nova.network.neutron [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:33:14 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:33:14 user nova-compute[74692]: DEBUG nova.compute.manager [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG nova.compute.manager [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:33:14 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Creating image(s)
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "/opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "/opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-f710b558-f270-454b-a1d6-b2a410b4a672 req-145d8434-32a4-48ef-83f3-4f7f1f84399e service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-changed-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-f710b558-f270-454b-a1d6-b2a410b4a672 req-145d8434-32a4-48ef-83f3-4f7f1f84399e service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Refreshing instance network info cache due to event network-changed-b1bcdb35-95f4-4010-b94b-75cfb5ec082e. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f710b558-f270-454b-a1d6-b2a410b4a672 req-145d8434-32a4-48ef-83f3-4f7f1f84399e service nova] Acquiring lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f710b558-f270-454b-a1d6-b2a410b4a672 req-145d8434-32a4-48ef-83f3-4f7f1f84399e service nova] Acquired lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG nova.network.neutron [req-f710b558-f270-454b-a1d6-b2a410b4a672 req-145d8434-32a4-48ef-83f3-4f7f1f84399e service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Refreshing network info cache for port b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.190s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:14 user nova-compute[74692]: DEBUG nova.policy [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1233b31e12dc4d5796a60327d93c3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704ef46081d04fc7a0ed88456cbe9fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk 1073741824" returned: 0 in 0.053s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.211s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG nova.network.neutron [req-f710b558-f270-454b-a1d6-b2a410b4a672 req-145d8434-32a4-48ef-83f3-4f7f1f84399e service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Updated VIF entry in instance network info cache for port b1bcdb35-95f4-4010-b94b-75cfb5ec082e. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG nova.network.neutron [req-f710b558-f270-454b-a1d6-b2a410b4a672 req-145d8434-32a4-48ef-83f3-4f7f1f84399e service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Updating instance_info_cache with network_info: [{"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f710b558-f270-454b-a1d6-b2a410b4a672 req-145d8434-32a4-48ef-83f3-4f7f1f84399e service nova] Releasing lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Cannot resize image /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Ensure instance console log exists: /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:15 user nova-compute[74692]: DEBUG nova.network.neutron [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Successfully created port: c879593e-46f0-444c-9bce-fdd7d77a8e4b {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:33:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:33:16 user nova-compute[74692]: INFO nova.compute.manager [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] instance snapshotting
Nov 18 18:33:16 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Beginning live snapshot process
Nov 18 18:33:16 user nova-compute[74692]: DEBUG nova.network.neutron [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Successfully updated port: c879593e-46f0-444c-9bce-fdd7d77a8e4b {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:33:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "refresh_cache-dd434b0c-593a-47ad-9109-0f8b5f545b6c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:33:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquired lock "refresh_cache-dd434b0c-593a-47ad-9109-0f8b5f545b6c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:33:16 user nova-compute[74692]: DEBUG nova.network.neutron [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:33:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-4828f235-2e5f-4d15-9575-ef30ce051f78 req-7434cdf2-f171-49f3-b435-a6b7bdf87aec service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Received event network-changed-c879593e-46f0-444c-9bce-fdd7d77a8e4b {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-4828f235-2e5f-4d15-9575-ef30ce051f78 req-7434cdf2-f171-49f3-b435-a6b7bdf87aec service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Refreshing instance network info cache due to event network-changed-c879593e-46f0-444c-9bce-fdd7d77a8e4b. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:33:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4828f235-2e5f-4d15-9575-ef30ce051f78 req-7434cdf2-f171-49f3-b435-a6b7bdf87aec service nova] Acquiring lock "refresh_cache-dd434b0c-593a-47ad-9109-0f8b5f545b6c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:33:16 user nova-compute[74692]: DEBUG nova.network.neutron [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:33:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json -f qcow2 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json -f qcow2" returned: 0 in 0.204s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json -f qcow2 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:16 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:33:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Didn't find any instances for network info cache update. {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.166s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1ciavat5/b5e8d7ef587b40e698ba0f0704b29ec2.delta 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1ciavat5/b5e8d7ef587b40e698ba0f0704b29ec2.delta 1073741824" returned: 0 in 0.045s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:17 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.network.neutron [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Updating instance_info_cache with network_info: [{"id": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "address": "fa:16:3e:93:8d:60", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc879593e-46", "ovs_interfaceid": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Releasing lock "refresh_cache-dd434b0c-593a-47ad-9109-0f8b5f545b6c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.compute.manager [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Instance network_info: |[{"id": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "address": "fa:16:3e:93:8d:60", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc879593e-46", "ovs_interfaceid": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4828f235-2e5f-4d15-9575-ef30ce051f78 req-7434cdf2-f171-49f3-b435-a6b7bdf87aec service nova] Acquired lock "refresh_cache-dd434b0c-593a-47ad-9109-0f8b5f545b6c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.network.neutron [req-4828f235-2e5f-4d15-9575-ef30ce051f78 req-7434cdf2-f171-49f3-b435-a6b7bdf87aec service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Refreshing network info cache for port c879593e-46f0-444c-9bce-fdd7d77a8e4b {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Start _get_guest_xml network_info=[{"id": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "address": "fa:16:3e:93:8d:60", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc879593e-46", "ovs_interfaceid": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:33:17 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:33:17 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:33:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1007732731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1007732731',id=18,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='704ef46081d04fc7a0ed88456cbe9fe8',ramdisk_id='',reservation_id='r-qkle8bok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-199647198',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:33:15Z,user_data=None,user_id='1233b31e12dc4d5796a60327d93c3bfb',uuid=dd434b0c-593a-47ad-9109-0f8b5f545b6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "address": "fa:16:3e:93:8d:60", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc879593e-46", "ovs_interfaceid": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converting VIF {"id": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "address": "fa:16:3e:93:8d:60", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc879593e-46", "ovs_interfaceid": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:60,bridge_name='br-int',has_traffic_filtering=True,id=c879593e-46f0-444c-9bce-fdd7d77a8e4b,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc879593e-46') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.objects.instance [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'pci_devices' on Instance uuid dd434b0c-593a-47ad-9109-0f8b5f545b6c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:33:17 user nova-compute[74692]:   <uuid>dd434b0c-593a-47ad-9109-0f8b5f545b6c</uuid>
Nov 18 18:33:17 user nova-compute[74692]:   <name>instance-00000012</name>
Nov 18 18:33:17 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:33:17 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:33:17 user nova-compute[74692]:   <metadata>
Nov 18 18:33:17 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:33:17 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:33:17 user nova-compute[74692]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1007732731</nova:name>
Nov 18 18:33:17 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:33:17</nova:creationTime>
Nov 18 18:33:17 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:33:17 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:33:17 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:33:17 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:33:17 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:33:17 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:33:17 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:33:17 user nova-compute[74692]:       <nova:owner>
Nov 18 18:33:17 user nova-compute[74692]:         <nova:user uuid="1233b31e12dc4d5796a60327d93c3bfb">tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member</nova:user>
Nov 18 18:33:17 user nova-compute[74692]:         <nova:project uuid="704ef46081d04fc7a0ed88456cbe9fe8">tempest-ServerBootFromVolumeStableRescueTest-199647198</nova:project>
Nov 18 18:33:17 user nova-compute[74692]:       </nova:owner>
Nov 18 18:33:17 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:33:17 user nova-compute[74692]:       <nova:ports>
Nov 18 18:33:17 user nova-compute[74692]:         <nova:port uuid="c879593e-46f0-444c-9bce-fdd7d77a8e4b">
Nov 18 18:33:17 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 18:33:17 user nova-compute[74692]:         </nova:port>
Nov 18 18:33:17 user nova-compute[74692]:       </nova:ports>
Nov 18 18:33:17 user nova-compute[74692]:     </nova:instance>
Nov 18 18:33:17 user nova-compute[74692]:   </metadata>
Nov 18 18:33:17 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:33:17 user nova-compute[74692]:     <system>
Nov 18 18:33:17 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:33:17 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:33:17 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:33:17 user nova-compute[74692]:       <entry name="serial">dd434b0c-593a-47ad-9109-0f8b5f545b6c</entry>
Nov 18 18:33:17 user nova-compute[74692]:       <entry name="uuid">dd434b0c-593a-47ad-9109-0f8b5f545b6c</entry>
Nov 18 18:33:17 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:33:17 user nova-compute[74692]:     </system>
Nov 18 18:33:17 user nova-compute[74692]:   </sysinfo>
Nov 18 18:33:17 user nova-compute[74692]:   <os>
Nov 18 18:33:17 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:33:17 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:33:17 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:33:17 user nova-compute[74692]:   </os>
Nov 18 18:33:17 user nova-compute[74692]:   <features>
Nov 18 18:33:17 user nova-compute[74692]:     <acpi/>
Nov 18 18:33:17 user nova-compute[74692]:     <apic/>
Nov 18 18:33:17 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:33:17 user nova-compute[74692]:   </features>
Nov 18 18:33:17 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:33:17 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:33:17 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:33:17 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:33:17 user nova-compute[74692]:   </clock>
Nov 18 18:33:17 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:33:17 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:33:17 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:33:17 user nova-compute[74692]:   </cpu>
Nov 18 18:33:17 user nova-compute[74692]:   <devices>
Nov 18 18:33:17 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:33:17 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:33:17 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk"/>
Nov 18 18:33:17 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:33:17 user nova-compute[74692]:     </disk>
Nov 18 18:33:17 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:33:17 user nova-compute[74692]:       <mac address="fa:16:3e:93:8d:60"/>
Nov 18 18:33:17 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:33:17 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:33:17 user nova-compute[74692]:       <target dev="tapc879593e-46"/>
Nov 18 18:33:17 user nova-compute[74692]:     </interface>
Nov 18 18:33:17 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:33:17 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/console.log" append="off"/>
Nov 18 18:33:17 user nova-compute[74692]:     </serial>
Nov 18 18:33:17 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:33:17 user nova-compute[74692]:     <video>
Nov 18 18:33:17 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:33:17 user nova-compute[74692]:     </video>
Nov 18 18:33:17 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:33:17 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:33:17 user nova-compute[74692]:     </rng>
Nov 18 18:33:17 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:33:17 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:33:17 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:33:17 user nova-compute[74692]:     </memballoon>
Nov 18 18:33:17 user nova-compute[74692]:   </devices>
Nov 18 18:33:17 user nova-compute[74692]: </domain>
Nov 18 18:33:17 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:33:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1007732731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1007732731',id=18,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='704ef46081d04fc7a0ed88456cbe9fe8',ramdisk_id='',reservation_id='r-qkle8bok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-199647198',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:33:15Z,user_data=None,user_id='1233b31e12dc4d5796a60327d93c3bfb',uuid=dd434b0c-593a-47ad-9109-0f8b5f545b6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "address": "fa:16:3e:93:8d:60", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc879593e-46", "ovs_interfaceid": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converting VIF {"id": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "address": "fa:16:3e:93:8d:60", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc879593e-46", "ovs_interfaceid": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:60,bridge_name='br-int',has_traffic_filtering=True,id=c879593e-46f0-444c-9bce-fdd7d77a8e4b,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc879593e-46') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG os_vif [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:60,bridge_name='br-int',has_traffic_filtering=True,id=c879593e-46f0-444c-9bce-fdd7d77a8e4b,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc879593e-46') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc219c7d-5009-562b-a0e1-4dfe73a8ac04', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc879593e-46, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc879593e-46, col_values=(('qos', UUID('cc00651b-79c7-4152-8251-2efdb5363008')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc879593e-46, col_values=(('external_ids', {'iface-id': 'c879593e-46f0-444c-9bce-fdd7d77a8e4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:8d:60', 'vm-uuid': 'dd434b0c-593a-47ad-9109-0f8b5f545b6c'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:17 user nova-compute[74692]: INFO os_vif [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:60,bridge_name='br-int',has_traffic_filtering=True,id=c879593e-46f0-444c-9bce-fdd7d77a8e4b,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc879593e-46')
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] No VIF found with MAC fa:16:3e:93:8d:60, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.network.neutron [req-4828f235-2e5f-4d15-9575-ef30ce051f78 req-7434cdf2-f171-49f3-b435-a6b7bdf87aec service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Updated VIF entry in instance network info cache for port c879593e-46f0-444c-9bce-fdd7d77a8e4b. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG nova.network.neutron [req-4828f235-2e5f-4d15-9575-ef30ce051f78 req-7434cdf2-f171-49f3-b435-a6b7bdf87aec service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Updating instance_info_cache with network_info: [{"id": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "address": "fa:16:3e:93:8d:60", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc879593e-46", "ovs_interfaceid": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:33:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4828f235-2e5f-4d15-9575-ef30ce051f78 req-7434cdf2-f171-49f3-b435-a6b7bdf87aec service nova] Releasing lock "refresh_cache-dd434b0c-593a-47ad-9109-0f8b5f545b6c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:33:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:18 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:33:18 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:33:18 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 18 18:33:18 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:33:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1ciavat5/b5e8d7ef587b40e698ba0f0704b29ec2.delta /opt/stack/data/nova/instances/snapshots/tmp1ciavat5/b5e8d7ef587b40e698ba0f0704b29ec2 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1ciavat5/b5e8d7ef587b40e698ba0f0704b29ec2.delta /opt/stack/data/nova/instances/snapshots/tmp1ciavat5/b5e8d7ef587b40e698ba0f0704b29ec2" returned: 0 in 0.589s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:19 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Snapshot extracted, beginning image upload
Nov 18 18:33:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-5fcf9ebe-1146-46ec-bdf9-7c5eaa7d4c57 req-9d01b8d5-17a0-492c-aa8f-7501a0e2cfcf service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Received event network-vif-plugged-c879593e-46f0-444c-9bce-fdd7d77a8e4b {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5fcf9ebe-1146-46ec-bdf9-7c5eaa7d4c57 req-9d01b8d5-17a0-492c-aa8f-7501a0e2cfcf service nova] Acquiring lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5fcf9ebe-1146-46ec-bdf9-7c5eaa7d4c57 req-9d01b8d5-17a0-492c-aa8f-7501a0e2cfcf service nova] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5fcf9ebe-1146-46ec-bdf9-7c5eaa7d4c57 req-9d01b8d5-17a0-492c-aa8f-7501a0e2cfcf service nova] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-5fcf9ebe-1146-46ec-bdf9-7c5eaa7d4c57 req-9d01b8d5-17a0-492c-aa8f-7501a0e2cfcf service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] No waiting events found dispatching network-vif-plugged-c879593e-46f0-444c-9bce-fdd7d77a8e4b {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:33:19 user nova-compute[74692]: WARNING nova.compute.manager [req-5fcf9ebe-1146-46ec-bdf9-7c5eaa7d4c57 req-9d01b8d5-17a0-492c-aa8f-7501a0e2cfcf service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Received unexpected event network-vif-plugged-c879593e-46f0-444c-9bce-fdd7d77a8e4b for instance with vm_state building and task_state spawning.
Nov 18 18:33:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:21 user nova-compute[74692]: DEBUG nova.compute.manager [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:33:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:33:21 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Instance spawned successfully.
Nov 18 18:33:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:33:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:21 user nova-compute[74692]: DEBUG nova.compute.manager [req-042421ca-45f1-4b3d-9b15-827808a52ab4 req-11d01593-7474-47d9-b617-411fe3bf99ef service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Received event network-vif-plugged-c879593e-46f0-444c-9bce-fdd7d77a8e4b {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-042421ca-45f1-4b3d-9b15-827808a52ab4 req-11d01593-7474-47d9-b617-411fe3bf99ef service nova] Acquiring lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-042421ca-45f1-4b3d-9b15-827808a52ab4 req-11d01593-7474-47d9-b617-411fe3bf99ef service nova] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-042421ca-45f1-4b3d-9b15-827808a52ab4 req-11d01593-7474-47d9-b617-411fe3bf99ef service nova] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:21 user nova-compute[74692]: DEBUG nova.compute.manager [req-042421ca-45f1-4b3d-9b15-827808a52ab4 req-11d01593-7474-47d9-b617-411fe3bf99ef service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] No waiting events found dispatching network-vif-plugged-c879593e-46f0-444c-9bce-fdd7d77a8e4b {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:33:21 user nova-compute[74692]: WARNING nova.compute.manager [req-042421ca-45f1-4b3d-9b15-827808a52ab4 req-11d01593-7474-47d9-b617-411fe3bf99ef service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Received unexpected event network-vif-plugged-c879593e-46f0-444c-9bce-fdd7d77a8e4b for instance with vm_state building and task_state spawning.
Nov 18 18:33:21 user nova-compute[74692]: INFO nova.compute.manager [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Took 7.25 seconds to spawn the instance on the hypervisor.
Nov 18 18:33:21 user nova-compute[74692]: DEBUG nova.compute.manager [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:33:22 user nova-compute[74692]: INFO nova.compute.manager [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Took 8.11 seconds to build instance.
Nov 18 18:33:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-46499a96-2e99-4f35-834e-5f8dbdb8e582 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.233s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:23 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Snapshot image upload complete
Nov 18 18:33:23 user nova-compute[74692]: INFO nova.compute.manager [None req-5c6fb743-e5c2-415e-8636-5fd6f44600f0 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Took 6.71 seconds to snapshot the instance on the hypervisor.
Nov 18 18:33:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "7960f76b-9176-4d98-8045-03678457add7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:26 user nova-compute[74692]: INFO nova.compute.manager [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Unshelving
Nov 18 18:33:26 user nova-compute[74692]: INFO nova.virt.block_device [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Booting with volume 3eeda74a-6f86-4797-8c30-fb05c69e7bd6 at /dev/vda
Nov 18 18:33:27 user nova-compute[74692]: DEBUG os_brick.utils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f525fd06-a1d6-41ea-abfd-208dd5d2ae47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[883571c5-7a9a-424f-b95e-dab939398d7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[640ae717-6a3a-4877-97fb-13feed541a86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8737356e-b0b3-408c-a06b-b37caf930008]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:33:27 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:33:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e897e048-8319-4567-bdea-a76d5b616a15]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG os_brick.utils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updating existing volume attachment record: 3572ef02-529c-4f4c-9327-8c42a505d604 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "3fd9a073-962e-44de-9252-2d5e339093bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "3fd9a073-962e-44de-9252-2d5e339093bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:33:28 user nova-compute[74692]: INFO nova.compute.claims [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Claim successful on node user
Nov 18 18:33:28 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG nova.network.neutron [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:33:28 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:33:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG nova.policy [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd126349e69864417bb5e02666efd534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb006c6267b42fab703cfc24d93052e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:33:28 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Creating image(s)
Nov 18 18:33:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "/opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "/opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.190s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.199s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk 1073741824" returned: 0 in 0.087s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG nova.network.neutron [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Successfully created port: 42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Cannot resize image /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Ensure instance console log exists: /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:30 user nova-compute[74692]: DEBUG nova.network.neutron [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Successfully updated port: 42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:33:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:33:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquired lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:33:30 user nova-compute[74692]: DEBUG nova.network.neutron [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:33:30 user nova-compute[74692]: DEBUG nova.network.neutron [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-a364e140-9d64-44b8-8e9d-3f6b8d35a0b0 req-09807031-efe7-4174-8a6e-8845d9a093b5 service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Received event network-changed-42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-a364e140-9d64-44b8-8e9d-3f6b8d35a0b0 req-09807031-efe7-4174-8a6e-8845d9a093b5 service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Refreshing instance network info cache due to event network-changed-42c3c7e8-f568-4a60-9613-152317e0543a. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a364e140-9d64-44b8-8e9d-3f6b8d35a0b0 req-09807031-efe7-4174-8a6e-8845d9a093b5 service nova] Acquiring lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:33:31 user nova-compute[74692]: INFO nova.compute.claims [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Claim successful on node user
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.network.neutron [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Updating instance_info_cache with network_info: [{"id": "42c3c7e8-f568-4a60-9613-152317e0543a", "address": "fa:16:3e:13:1b:f6", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42c3c7e8-f5", "ovs_interfaceid": "42c3c7e8-f568-4a60-9613-152317e0543a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Releasing lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Instance network_info: |[{"id": "42c3c7e8-f568-4a60-9613-152317e0543a", "address": "fa:16:3e:13:1b:f6", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42c3c7e8-f5", "ovs_interfaceid": "42c3c7e8-f568-4a60-9613-152317e0543a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a364e140-9d64-44b8-8e9d-3f6b8d35a0b0 req-09807031-efe7-4174-8a6e-8845d9a093b5 service nova] Acquired lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.network.neutron [req-a364e140-9d64-44b8-8e9d-3f6b8d35a0b0 req-09807031-efe7-4174-8a6e-8845d9a093b5 service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Refreshing network info cache for port 42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Start _get_guest_xml network_info=[{"id": "42c3c7e8-f568-4a60-9613-152317e0543a", "address": "fa:16:3e:13:1b:f6", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42c3c7e8-f5", "ovs_interfaceid": "42c3c7e8-f568-4a60-9613-152317e0543a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:33:31 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:33:31 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-210749516',display_name='tempest-ServerActionsTestOtherA-server-210749516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-210749516',id=19,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaznf7JGrfMrJRV86vaxqKuCfM3AcEaoWdApdT43PQu2+VRfP7TdWdgnZDzhSHo94Y2Q6y7Dc8YLTCn+JC1yHxyJqY3YZNW3EenEWfmQ3/zXDAHD9n+p1yEmT0Bxd5Ldw==',key_name='tempest-keypair-1438330061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb006c6267b42fab703cfc24d93052e',ramdisk_id='',reservation_id='r-rvvvfvlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2047740053',owner_user_name='tempest-ServerActionsTestOtherA-2047740053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d126349e69864417bb5e02666efd534c',uuid=3fd9a073-962e-44de-9252-2d5e339093bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42c3c7e8-f568-4a60-9613-152317e0543a", "address": "fa:16:3e:13:1b:f6", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42c3c7e8-f5", "ovs_interfaceid": "42c3c7e8-f568-4a60-9613-152317e0543a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converting VIF {"id": "42c3c7e8-f568-4a60-9613-152317e0543a", "address": "fa:16:3e:13:1b:f6", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42c3c7e8-f5", "ovs_interfaceid": "42c3c7e8-f568-4a60-9613-152317e0543a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:1b:f6,bridge_name='br-int',has_traffic_filtering=True,id=42c3c7e8-f568-4a60-9613-152317e0543a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42c3c7e8-f5') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.objects.instance [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fd9a073-962e-44de-9252-2d5e339093bc {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:33:31 user nova-compute[74692]:   <uuid>3fd9a073-962e-44de-9252-2d5e339093bc</uuid>
Nov 18 18:33:31 user nova-compute[74692]:   <name>instance-00000013</name>
Nov 18 18:33:31 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:33:31 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:33:31 user nova-compute[74692]:   <metadata>
Nov 18 18:33:31 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:33:31 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:33:31 user nova-compute[74692]:       <nova:name>tempest-ServerActionsTestOtherA-server-210749516</nova:name>
Nov 18 18:33:31 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:33:31</nova:creationTime>
Nov 18 18:33:31 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:33:31 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:33:31 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:33:31 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:33:31 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:33:31 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:33:31 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:33:31 user nova-compute[74692]:       <nova:owner>
Nov 18 18:33:31 user nova-compute[74692]:         <nova:user uuid="d126349e69864417bb5e02666efd534c">tempest-ServerActionsTestOtherA-2047740053-project-member</nova:user>
Nov 18 18:33:31 user nova-compute[74692]:         <nova:project uuid="fdb006c6267b42fab703cfc24d93052e">tempest-ServerActionsTestOtherA-2047740053</nova:project>
Nov 18 18:33:31 user nova-compute[74692]:       </nova:owner>
Nov 18 18:33:31 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:33:31 user nova-compute[74692]:       <nova:ports>
Nov 18 18:33:31 user nova-compute[74692]:         <nova:port uuid="42c3c7e8-f568-4a60-9613-152317e0543a">
Nov 18 18:33:31 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 18:33:31 user nova-compute[74692]:         </nova:port>
Nov 18 18:33:31 user nova-compute[74692]:       </nova:ports>
Nov 18 18:33:31 user nova-compute[74692]:     </nova:instance>
Nov 18 18:33:31 user nova-compute[74692]:   </metadata>
Nov 18 18:33:31 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:33:31 user nova-compute[74692]:     <system>
Nov 18 18:33:31 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:33:31 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:33:31 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:33:31 user nova-compute[74692]:       <entry name="serial">3fd9a073-962e-44de-9252-2d5e339093bc</entry>
Nov 18 18:33:31 user nova-compute[74692]:       <entry name="uuid">3fd9a073-962e-44de-9252-2d5e339093bc</entry>
Nov 18 18:33:31 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:33:31 user nova-compute[74692]:     </system>
Nov 18 18:33:31 user nova-compute[74692]:   </sysinfo>
Nov 18 18:33:31 user nova-compute[74692]:   <os>
Nov 18 18:33:31 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:33:31 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:33:31 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:33:31 user nova-compute[74692]:   </os>
Nov 18 18:33:31 user nova-compute[74692]:   <features>
Nov 18 18:33:31 user nova-compute[74692]:     <acpi/>
Nov 18 18:33:31 user nova-compute[74692]:     <apic/>
Nov 18 18:33:31 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:33:31 user nova-compute[74692]:   </features>
Nov 18 18:33:31 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:33:31 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:33:31 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:33:31 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:33:31 user nova-compute[74692]:   </clock>
Nov 18 18:33:31 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:33:31 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:33:31 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:33:31 user nova-compute[74692]:   </cpu>
Nov 18 18:33:31 user nova-compute[74692]:   <devices>
Nov 18 18:33:31 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:33:31 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:33:31 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk"/>
Nov 18 18:33:31 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:33:31 user nova-compute[74692]:     </disk>
Nov 18 18:33:31 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:33:31 user nova-compute[74692]:       <mac address="fa:16:3e:13:1b:f6"/>
Nov 18 18:33:31 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:33:31 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:33:31 user nova-compute[74692]:       <target dev="tap42c3c7e8-f5"/>
Nov 18 18:33:31 user nova-compute[74692]:     </interface>
Nov 18 18:33:31 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:33:31 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/console.log" append="off"/>
Nov 18 18:33:31 user nova-compute[74692]:     </serial>
Nov 18 18:33:31 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:33:31 user nova-compute[74692]:     <video>
Nov 18 18:33:31 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:33:31 user nova-compute[74692]:     </video>
Nov 18 18:33:31 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:33:31 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:33:31 user nova-compute[74692]:     </rng>
Nov 18 18:33:31 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:33:31 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:33:31 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:33:31 user nova-compute[74692]:     </memballoon>
Nov 18 18:33:31 user nova-compute[74692]:   </devices>
Nov 18 18:33:31 user nova-compute[74692]: </domain>
Nov 18 18:33:31 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-210749516',display_name='tempest-ServerActionsTestOtherA-server-210749516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-210749516',id=19,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaznf7JGrfMrJRV86vaxqKuCfM3AcEaoWdApdT43PQu2+VRfP7TdWdgnZDzhSHo94Y2Q6y7Dc8YLTCn+JC1yHxyJqY3YZNW3EenEWfmQ3/zXDAHD9n+p1yEmT0Bxd5Ldw==',key_name='tempest-keypair-1438330061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb006c6267b42fab703cfc24d93052e',ramdisk_id='',reservation_id='r-rvvvfvlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2047740053',owner_user_name='tempest-ServerActionsTestOtherA-2047740053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d126349e69864417bb5e02666efd534c',uuid=3fd9a073-962e-44de-9252-2d5e339093bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42c3c7e8-f568-4a60-9613-152317e0543a", "address": "fa:16:3e:13:1b:f6", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42c3c7e8-f5", "ovs_interfaceid": "42c3c7e8-f568-4a60-9613-152317e0543a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converting VIF {"id": "42c3c7e8-f568-4a60-9613-152317e0543a", "address": "fa:16:3e:13:1b:f6", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42c3c7e8-f5", "ovs_interfaceid": "42c3c7e8-f568-4a60-9613-152317e0543a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:1b:f6,bridge_name='br-int',has_traffic_filtering=True,id=42c3c7e8-f568-4a60-9613-152317e0543a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42c3c7e8-f5') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG os_vif [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:1b:f6,bridge_name='br-int',has_traffic_filtering=True,id=42c3c7e8-f568-4a60-9613-152317e0543a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42c3c7e8-f5') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f26dce9-875b-5e26-bb23-a82d2c36f655', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42c3c7e8-f5, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42c3c7e8-f5, col_values=(('qos', UUID('95f98f1e-ec81-459b-97a1-99c21ecece38')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42c3c7e8-f5, col_values=(('external_ids', {'iface-id': '42c3c7e8-f568-4a60-9613-152317e0543a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:1b:f6', 'vm-uuid': '3fd9a073-962e-44de-9252-2d5e339093bc'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:31 user nova-compute[74692]: INFO os_vif [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:1b:f6,bridge_name='br-int',has_traffic_filtering=True,id=42c3c7e8-f568-4a60-9613-152317e0543a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42c3c7e8-f5')
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] No VIF found with MAC fa:16:3e:13:1b:f6, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.network.neutron [req-a364e140-9d64-44b8-8e9d-3f6b8d35a0b0 req-09807031-efe7-4174-8a6e-8845d9a093b5 service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Updated VIF entry in instance network info cache for port 42c3c7e8-f568-4a60-9613-152317e0543a. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.network.neutron [req-a364e140-9d64-44b8-8e9d-3f6b8d35a0b0 req-09807031-efe7-4174-8a6e-8845d9a093b5 service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Updating instance_info_cache with network_info: [{"id": "42c3c7e8-f568-4a60-9613-152317e0543a", "address": "fa:16:3e:13:1b:f6", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42c3c7e8-f5", "ovs_interfaceid": "42c3c7e8-f568-4a60-9613-152317e0543a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:33:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a364e140-9d64-44b8-8e9d-3f6b8d35a0b0 req-09807031-efe7-4174-8a6e-8845d9a093b5 service nova] Releasing lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:33:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:33:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG nova.policy [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06701e65ca164dcc9156a1b0980c2456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c72c980ad5b43bfb3e021d8c945a72c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:32 user nova-compute[74692]: INFO nova.compute.manager [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Terminating instance
Nov 18 18:33:32 user nova-compute[74692]: DEBUG nova.compute.manager [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:33:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Creating image(s)
Nov 18 18:33:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "/opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "/opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "/opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.217s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.198s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk 1073741824" returned: 0 in 0.062s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-c1d03df8-653c-4d23-b597-5506544f30c7 req-7e5da3cf-01da-49f2-b62c-d7e053373cd2 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received event network-vif-unplugged-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c1d03df8-653c-4d23-b597-5506544f30c7 req-7e5da3cf-01da-49f2-b62c-d7e053373cd2 service nova] Acquiring lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c1d03df8-653c-4d23-b597-5506544f30c7 req-7e5da3cf-01da-49f2-b62c-d7e053373cd2 service nova] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c1d03df8-653c-4d23-b597-5506544f30c7 req-7e5da3cf-01da-49f2-b62c-d7e053373cd2 service nova] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-c1d03df8-653c-4d23-b597-5506544f30c7 req-7e5da3cf-01da-49f2-b62c-d7e053373cd2 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] No waiting events found dispatching network-vif-unplugged-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-c1d03df8-653c-4d23-b597-5506544f30c7 req-7e5da3cf-01da-49f2-b62c-d7e053373cd2 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received event network-vif-unplugged-a80879d4-d41e-4418-9181-905a9ec118d5 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.203s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-9084c243-9bc4-4f4c-b085-4f53da5a709e req-a3c4744e-d833-4117-93a7-28963c945a73 service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Received event network-vif-plugged-42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9084c243-9bc4-4f4c-b085-4f53da5a709e req-a3c4744e-d833-4117-93a7-28963c945a73 service nova] Acquiring lock "3fd9a073-962e-44de-9252-2d5e339093bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9084c243-9bc4-4f4c-b085-4f53da5a709e req-a3c4744e-d833-4117-93a7-28963c945a73 service nova] Lock "3fd9a073-962e-44de-9252-2d5e339093bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9084c243-9bc4-4f4c-b085-4f53da5a709e req-a3c4744e-d833-4117-93a7-28963c945a73 service nova] Lock "3fd9a073-962e-44de-9252-2d5e339093bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-9084c243-9bc4-4f4c-b085-4f53da5a709e req-a3c4744e-d833-4117-93a7-28963c945a73 service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] No waiting events found dispatching network-vif-plugged-42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:33:33 user nova-compute[74692]: WARNING nova.compute.manager [req-9084c243-9bc4-4f4c-b085-4f53da5a709e req-a3c4744e-d833-4117-93a7-28963c945a73 service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Received unexpected event network-vif-plugged-42c3c7e8-f568-4a60-9613-152317e0543a for instance with vm_state building and task_state spawning.
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Successfully created port: 48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Cannot resize image /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Ensure instance console log exists: /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.objects.instance [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lazy-loading 'pci_requests' on Instance uuid 7960f76b-9176-4d98-8045-03678457add7 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:33:33 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Instance destroyed successfully.
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.objects.instance [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lazy-loading 'resources' on Instance uuid 2fbc1048-58dc-41ab-9e36-b7c3b0be9741 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1332121898',display_name='tempest-VolumesActionsTest-instance-1332121898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1332121898',id=13,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:31:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c49de78bbe48494ca84537a8c3203c03',ramdisk_id='',reservation_id='r-n1zfjzt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-948228922',owner_user_name='tempest-VolumesActionsTest-948228922-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:31:48Z,user_data=None,user_id='5fbcfd5f1f8949aea3a12d1cdad4fadd',uuid=2fbc1048-58dc-41ab-9e36-b7c3b0be9741,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a80879d4-d41e-4418-9181-905a9ec118d5", "address": "fa:16:3e:a9:c0:63", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80879d4-d4", "ovs_interfaceid": "a80879d4-d41e-4418-9181-905a9ec118d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Converting VIF {"id": "a80879d4-d41e-4418-9181-905a9ec118d5", "address": "fa:16:3e:a9:c0:63", "network": {"id": "77ac5902-ef13-4b4f-b0b3-7c130c82a723", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007393304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49de78bbe48494ca84537a8c3203c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80879d4-d4", "ovs_interfaceid": "a80879d4-d41e-4418-9181-905a9ec118d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c0:63,bridge_name='br-int',has_traffic_filtering=True,id=a80879d4-d41e-4418-9181-905a9ec118d5,network=Network(77ac5902-ef13-4b4f-b0b3-7c130c82a723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80879d4-d4') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG os_vif [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c0:63,bridge_name='br-int',has_traffic_filtering=True,id=a80879d4-d41e-4418-9181-905a9ec118d5,network=Network(77ac5902-ef13-4b4f-b0b3-7c130c82a723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80879d4-d4') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.objects.instance [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lazy-loading 'numa_topology' on Instance uuid 7960f76b-9176-4d98-8045-03678457add7 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa80879d4-d4, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:33:33 user nova-compute[74692]: INFO nova.compute.claims [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Claim successful on node user
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a8bc301-b288-4b74-b562-b29fbe4b7492) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:33:33 user nova-compute[74692]: INFO os_vif [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c0:63,bridge_name='br-int',has_traffic_filtering=True,id=a80879d4-d41e-4418-9181-905a9ec118d5,network=Network(77ac5902-ef13-4b4f-b0b3-7c130c82a723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80879d4-d4')
Nov 18 18:33:33 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Deleting instance files /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741_del
Nov 18 18:33:33 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Deletion of /opt/stack/data/nova/instances/2fbc1048-58dc-41ab-9e36-b7c3b0be9741_del complete
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:33 user nova-compute[74692]: INFO nova.compute.manager [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Took 1.55 seconds to destroy the instance on the hypervisor.
Nov 18 18:33:33 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:33:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:34 user nova-compute[74692]: INFO nova.network.neutron [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updating port bdd4ef83-835c-42c0-a7e0-0432ab03618f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:33:34 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Took 0.52 seconds to deallocate network for instance.
Nov 18 18:33:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Successfully updated port: 48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "refresh_cache-873169f2-f1a7-4c16-8b8c-88767fea7fc9" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquired lock "refresh_cache-873169f2-f1a7-4c16-8b8c-88767fea7fc9" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.network.neutron [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Updating instance_info_cache with network_info: [{"id": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "address": "fa:16:3e:ae:20:b0", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b99854-18", "ovs_interfaceid": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Releasing lock "refresh_cache-873169f2-f1a7-4c16-8b8c-88767fea7fc9" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Instance network_info: |[{"id": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "address": "fa:16:3e:ae:20:b0", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b99854-18", "ovs_interfaceid": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Start _get_guest_xml network_info=[{"id": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "address": "fa:16:3e:ae:20:b0", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b99854-18", "ovs_interfaceid": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:33:34 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:33:34 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1596301347',display_name='tempest-TestStampPattern-server-1596301347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1596301347',id=20,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB7akI9Ef5IF2ubc0pOGpfPsCLfKgXlGgPf6VXPlA0zR+68LnHP3vVrar+LjgpmnH9dLlzovoA0gykf7I0UDbFjCuPzygvOsGrahVjnNx7QVyzmocIYPH6AmctAdhsRVw==',key_name='tempest-TestStampPattern-1083759675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c72c980ad5b43bfb3e021d8c945a72c',ramdisk_id='',reservation_id='r-j3a0107l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-180669565',owner_user_name='tempest-TestStampPattern-180669565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:33:32Z,user_data=None,user_id='06701e65ca164dcc9156a1b0980c2456',uuid=873169f2-f1a7-4c16-8b8c-88767fea7fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "address": "fa:16:3e:ae:20:b0", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b99854-18", "ovs_interfaceid": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Converting VIF {"id": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "address": "fa:16:3e:ae:20:b0", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b99854-18", "ovs_interfaceid": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:20:b0,bridge_name='br-int',has_traffic_filtering=True,id=48b99854-18f7-4fb9-b31f-9e669aa9fa6a,network=Network(d592abe8-2581-4e23-93f9-c3676958cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48b99854-18') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.objects.instance [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lazy-loading 'pci_devices' on Instance uuid 873169f2-f1a7-4c16-8b8c-88767fea7fc9 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquired lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:33:34 user nova-compute[74692]:   <uuid>873169f2-f1a7-4c16-8b8c-88767fea7fc9</uuid>
Nov 18 18:33:34 user nova-compute[74692]:   <name>instance-00000014</name>
Nov 18 18:33:34 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:33:34 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:33:34 user nova-compute[74692]:   <metadata>
Nov 18 18:33:34 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:33:34 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:33:34 user nova-compute[74692]:       <nova:name>tempest-TestStampPattern-server-1596301347</nova:name>
Nov 18 18:33:34 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:33:34</nova:creationTime>
Nov 18 18:33:34 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:33:34 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:33:34 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:33:34 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:33:34 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:33:34 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:33:34 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:33:34 user nova-compute[74692]:       <nova:owner>
Nov 18 18:33:34 user nova-compute[74692]:         <nova:user uuid="06701e65ca164dcc9156a1b0980c2456">tempest-TestStampPattern-180669565-project-member</nova:user>
Nov 18 18:33:34 user nova-compute[74692]:         <nova:project uuid="8c72c980ad5b43bfb3e021d8c945a72c">tempest-TestStampPattern-180669565</nova:project>
Nov 18 18:33:34 user nova-compute[74692]:       </nova:owner>
Nov 18 18:33:34 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:33:34 user nova-compute[74692]:       <nova:ports>
Nov 18 18:33:34 user nova-compute[74692]:         <nova:port uuid="48b99854-18f7-4fb9-b31f-9e669aa9fa6a">
Nov 18 18:33:34 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 18 18:33:34 user nova-compute[74692]:         </nova:port>
Nov 18 18:33:34 user nova-compute[74692]:       </nova:ports>
Nov 18 18:33:34 user nova-compute[74692]:     </nova:instance>
Nov 18 18:33:34 user nova-compute[74692]:   </metadata>
Nov 18 18:33:34 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:33:34 user nova-compute[74692]:     <system>
Nov 18 18:33:34 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:33:34 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:33:34 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:33:34 user nova-compute[74692]:       <entry name="serial">873169f2-f1a7-4c16-8b8c-88767fea7fc9</entry>
Nov 18 18:33:34 user nova-compute[74692]:       <entry name="uuid">873169f2-f1a7-4c16-8b8c-88767fea7fc9</entry>
Nov 18 18:33:34 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:33:34 user nova-compute[74692]:     </system>
Nov 18 18:33:34 user nova-compute[74692]:   </sysinfo>
Nov 18 18:33:34 user nova-compute[74692]:   <os>
Nov 18 18:33:34 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:33:34 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:33:34 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:33:34 user nova-compute[74692]:   </os>
Nov 18 18:33:34 user nova-compute[74692]:   <features>
Nov 18 18:33:34 user nova-compute[74692]:     <acpi/>
Nov 18 18:33:34 user nova-compute[74692]:     <apic/>
Nov 18 18:33:34 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:33:34 user nova-compute[74692]:   </features>
Nov 18 18:33:34 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:33:34 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:33:34 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:33:34 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:33:34 user nova-compute[74692]:   </clock>
Nov 18 18:33:34 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:33:34 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:33:34 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:33:34 user nova-compute[74692]:   </cpu>
Nov 18 18:33:34 user nova-compute[74692]:   <devices>
Nov 18 18:33:34 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:33:34 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:33:34 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk"/>
Nov 18 18:33:34 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:33:34 user nova-compute[74692]:     </disk>
Nov 18 18:33:34 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:33:34 user nova-compute[74692]:       <mac address="fa:16:3e:ae:20:b0"/>
Nov 18 18:33:34 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:33:34 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:33:34 user nova-compute[74692]:       <target dev="tap48b99854-18"/>
Nov 18 18:33:34 user nova-compute[74692]:     </interface>
Nov 18 18:33:34 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:33:34 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/console.log" append="off"/>
Nov 18 18:33:34 user nova-compute[74692]:     </serial>
Nov 18 18:33:34 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:33:34 user nova-compute[74692]:     <video>
Nov 18 18:33:34 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:33:34 user nova-compute[74692]:     </video>
Nov 18 18:33:34 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:33:34 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:33:34 user nova-compute[74692]:     </rng>
Nov 18 18:33:34 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:33:34 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:33:34 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:33:34 user nova-compute[74692]:     </memballoon>
Nov 18 18:33:34 user nova-compute[74692]:   </devices>
Nov 18 18:33:34 user nova-compute[74692]: </domain>
Nov 18 18:33:34 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1596301347',display_name='tempest-TestStampPattern-server-1596301347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1596301347',id=20,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB7akI9Ef5IF2ubc0pOGpfPsCLfKgXlGgPf6VXPlA0zR+68LnHP3vVrar+LjgpmnH9dLlzovoA0gykf7I0UDbFjCuPzygvOsGrahVjnNx7QVyzmocIYPH6AmctAdhsRVw==',key_name='tempest-TestStampPattern-1083759675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c72c980ad5b43bfb3e021d8c945a72c',ramdisk_id='',reservation_id='r-j3a0107l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-180669565',owner_user_name='tempest-TestStampPattern-180669565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:33:32Z,user_data=None,user_id='06701e65ca164dcc9156a1b0980c2456',uuid=873169f2-f1a7-4c16-8b8c-88767fea7fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "address": "fa:16:3e:ae:20:b0", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b99854-18", "ovs_interfaceid": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Converting VIF {"id": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "address": "fa:16:3e:ae:20:b0", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b99854-18", "ovs_interfaceid": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:20:b0,bridge_name='br-int',has_traffic_filtering=True,id=48b99854-18f7-4fb9-b31f-9e669aa9fa6a,network=Network(d592abe8-2581-4e23-93f9-c3676958cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48b99854-18') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG os_vif [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:20:b0,bridge_name='br-int',has_traffic_filtering=True,id=48b99854-18f7-4fb9-b31f-9e669aa9fa6a,network=Network(d592abe8-2581-4e23-93f9-c3676958cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48b99854-18') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa496792-f66f-53da-af9b-01d10b4bc1f2', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:33:35 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Deleted allocations for instance 2fbc1048-58dc-41ab-9e36-b7c3b0be9741
Nov 18 18:33:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48b99854-18, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48b99854-18, col_values=(('qos', UUID('b076cc7b-0168-4b59-b966-781f703c7a78')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48b99854-18, col_values=(('external_ids', {'iface-id': '48b99854-18f7-4fb9-b31f-9e669aa9fa6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:20:b0', 'vm-uuid': '873169f2-f1a7-4c16-8b8c-88767fea7fc9'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-ddddfa78-6735-47cb-b349-8f8d475d1395 req-9e5f28c1-8944-4454-b7af-04e08c018159 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-changed-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-ddddfa78-6735-47cb-b349-8f8d475d1395 req-9e5f28c1-8944-4454-b7af-04e08c018159 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Refreshing instance network info cache due to event network-changed-bdd4ef83-835c-42c0-a7e0-0432ab03618f. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ddddfa78-6735-47cb-b349-8f8d475d1395 req-9e5f28c1-8944-4454-b7af-04e08c018159 service nova] Acquiring lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:35 user nova-compute[74692]: INFO os_vif [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:20:b0,bridge_name='br-int',has_traffic_filtering=True,id=48b99854-18f7-4fb9-b31f-9e669aa9fa6a,network=Network(d592abe8-2581-4e23-93f9-c3676958cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48b99854-18')
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] No VIF found with MAC fa:16:3e:ae:20:b0, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-381ad888-edf0-4a4d-89f0-4fb9fbcc3aee tempest-VolumesActionsTest-948228922 tempest-VolumesActionsTest-948228922-project-member] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.720s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received event network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] Acquiring lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] No waiting events found dispatching network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:33:35 user nova-compute[74692]: WARNING nova.compute.manager [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received unexpected event network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 for instance with vm_state deleted and task_state None.
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received event network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] Acquiring lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] No waiting events found dispatching network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:33:35 user nova-compute[74692]: WARNING nova.compute.manager [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received unexpected event network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 for instance with vm_state deleted and task_state None.
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received event network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] Acquiring lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] No waiting events found dispatching network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:33:35 user nova-compute[74692]: WARNING nova.compute.manager [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received unexpected event network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 for instance with vm_state deleted and task_state None.
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Received event network-changed-48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Refreshing instance network info cache due to event network-changed-48b99854-18f7-4fb9-b31f-9e669aa9fa6a. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] Acquiring lock "refresh_cache-873169f2-f1a7-4c16-8b8c-88767fea7fc9" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] Acquired lock "refresh_cache-873169f2-f1a7-4c16-8b8c-88767fea7fc9" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.network.neutron [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Refreshing network info cache for port 48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updating instance_info_cache with network_info: [{"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-504d52dc-68b5-4b3a-9055-f168cf442c4c req-22463d3a-3294-4302-938f-06ed27778e6d service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Received event network-vif-plugged-42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-504d52dc-68b5-4b3a-9055-f168cf442c4c req-22463d3a-3294-4302-938f-06ed27778e6d service nova] Acquiring lock "3fd9a073-962e-44de-9252-2d5e339093bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-504d52dc-68b5-4b3a-9055-f168cf442c4c req-22463d3a-3294-4302-938f-06ed27778e6d service nova] Lock "3fd9a073-962e-44de-9252-2d5e339093bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-504d52dc-68b5-4b3a-9055-f168cf442c4c req-22463d3a-3294-4302-938f-06ed27778e6d service nova] Lock "3fd9a073-962e-44de-9252-2d5e339093bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-504d52dc-68b5-4b3a-9055-f168cf442c4c req-22463d3a-3294-4302-938f-06ed27778e6d service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] No waiting events found dispatching network-vif-plugged-42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:33:35 user nova-compute[74692]: WARNING nova.compute.manager [req-504d52dc-68b5-4b3a-9055-f168cf442c4c req-22463d3a-3294-4302-938f-06ed27778e6d service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Received unexpected event network-vif-plugged-42c3c7e8-f568-4a60-9613-152317e0543a for instance with vm_state building and task_state spawning.
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-504d52dc-68b5-4b3a-9055-f168cf442c4c req-22463d3a-3294-4302-938f-06ed27778e6d service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received event network-vif-deleted-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Releasing lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:33:35 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Creating image(s)
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Ensure instance console log exists: /opt/stack/data/nova/instances/7960f76b-9176-4d98-8045-03678457add7/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Start _get_guest_xml network_info=[{"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORgqFxrZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7960f76b-9176-4d98-8045-03678457add7', 'attached_at': '', 'detached_at': '', 'volume_id': '3eeda74a-6f86-4797-8c30-fb05c69e7bd6', 'serial': '3eeda74a-6f86-4797-8c30-fb05c69e7bd6'}, 'attachment_id': '3572ef02-529c-4f4c-9327-8c42a505d604', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ddddfa78-6735-47cb-b349-8f8d475d1395 req-9e5f28c1-8944-4454-b7af-04e08c018159 service nova] Acquired lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.network.neutron [req-ddddfa78-6735-47cb-b349-8f8d475d1395 req-9e5f28c1-8944-4454-b7af-04e08c018159 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Refreshing network info cache for port bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:33:35 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:33:35 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.objects.instance [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7960f76b-9176-4d98-8045-03678457add7 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.objects.base [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Object Instance<7960f76b-9176-4d98-8045-03678457add7> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORgqFxrZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:33:35 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:33:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:33:35 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:33:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:33:35 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.network.neutron [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Updated VIF entry in instance network info cache for port 48b99854-18f7-4fb9-b31f-9e669aa9fa6a. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.network.neutron [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Updating instance_info_cache with network_info: [{"id": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "address": "fa:16:3e:ae:20:b0", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b99854-18", "ovs_interfaceid": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] Releasing lock "refresh_cache-873169f2-f1a7-4c16-8b8c-88767fea7fc9" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received event network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] Acquiring lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] Lock "2fbc1048-58dc-41ab-9e36-b7c3b0be9741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] No waiting events found dispatching network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:33:35 user nova-compute[74692]: WARNING nova.compute.manager [req-5ec1d9b5-8fa6-427d-abae-1797ace34e42 req-9990f054-f5ce-49b4-add0-71580cc1d2d2 service nova] [instance: 2fbc1048-58dc-41ab-9e36-b7c3b0be9741] Received unexpected event network-vif-plugged-a80879d4-d41e-4418-9181-905a9ec118d5 for instance with vm_state deleted and task_state None.
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbabb25a-73d8-440b-b8c1-bb47fe147ada]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:33:35 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6065b8-740a-4765-b446-f22d4ecdcdc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6] added
Nov 18 18:33:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.256s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c11cd1-ca2b-4969-ad19-ce5d0f8d3162]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f21aaf6-514f-4b56-afeb-d6cfea4253ff]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ORgqFxrZ {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ORgqFxrZ" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[694fcf01-af1c-46ca-9b95-37be32add826]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ORgqFxrZ'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.compute.manager [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:33:35 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Instance spawned successfully.
Nov 18 18:33:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[742869a9-540c-4011-ae3b-5e1165e627c3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:33:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d858e5c6-2f48-43b5-8bb6-8469d20bf8f9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 (non-flash)
Nov 18 18:33:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 (non-flash)
Nov 18 18:33:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --login" returned: 0 in 0.117s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[50985528-4380-433d-8680-eb05875a3dd3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260]
Nov 18 18:33:36 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260] successful.
Nov 18 18:33:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG nova.network.neutron [req-ddddfa78-6735-47cb-b349-8f8d475d1395 req-9e5f28c1-8944-4454-b7af-04e08c018159 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updated VIF entry in instance network info cache for port bdd4ef83-835c-42c0-a7e0-0432ab03618f. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG nova.network.neutron [req-ddddfa78-6735-47cb-b349-8f8d475d1395 req-9e5f28c1-8944-4454-b7af-04e08c018159 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updating instance_info_cache with network_info: [{"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c7e005-42b8-4e8c-9597-65507c9c49d3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:36 user nova-compute[74692]: INFO nova.compute.manager [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Took 7.32 seconds to spawn the instance on the hypervisor.
Nov 18 18:33:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ddddfa78-6735-47cb-b349-8f8d475d1395 req-9e5f28c1-8944-4454-b7af-04e08c018159 service nova] Releasing lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb8ce6f-aed1-4c6c-b171-d0dbda95718e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 (non-flash)
Nov 18 18:33:36 user nova-compute[74692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:33:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 (non-flash)
Nov 18 18:33:36 user nova-compute[74692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:33:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.618s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf602a3b-b25e-489d-bda1-c1f7e973296e]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORgqFxrZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:33:36 user nova-compute[74692]: INFO nova.compute.manager [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Took 8.13 seconds to build instance.
Nov 18 18:33:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e6a44cf2-6360-43b3-a5a5-2b39410787c3 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "3fd9a073-962e-44de-9252-2d5e339093bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.263s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.compute.manager [req-0229c91d-1cf0-457a-b64f-b6b70099e0b4 req-0074e98a-a030-4702-b305-adb61a3e4ef8 service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Received event network-vif-plugged-48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0229c91d-1cf0-457a-b64f-b6b70099e0b4 req-0074e98a-a030-4702-b305-adb61a3e4ef8 service nova] Acquiring lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0229c91d-1cf0-457a-b64f-b6b70099e0b4 req-0074e98a-a030-4702-b305-adb61a3e4ef8 service nova] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0229c91d-1cf0-457a-b64f-b6b70099e0b4 req-0074e98a-a030-4702-b305-adb61a3e4ef8 service nova] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.compute.manager [req-0229c91d-1cf0-457a-b64f-b6b70099e0b4 req-0074e98a-a030-4702-b305-adb61a3e4ef8 service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] No waiting events found dispatching network-vif-plugged-48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:33:37 user nova-compute[74692]: WARNING nova.compute.manager [req-0229c91d-1cf0-457a-b64f-b6b70099e0b4 req-0074e98a-a030-4702-b305-adb61a3e4ef8 service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Received unexpected event network-vif-plugged-48b99854-18f7-4fb9-b31f-9e669aa9fa6a for instance with vm_state building and task_state spawning.
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.compute.manager [req-0229c91d-1cf0-457a-b64f-b6b70099e0b4 req-0074e98a-a030-4702-b305-adb61a3e4ef8 service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Received event network-vif-plugged-48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0229c91d-1cf0-457a-b64f-b6b70099e0b4 req-0074e98a-a030-4702-b305-adb61a3e4ef8 service nova] Acquiring lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0229c91d-1cf0-457a-b64f-b6b70099e0b4 req-0074e98a-a030-4702-b305-adb61a3e4ef8 service nova] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0229c91d-1cf0-457a-b64f-b6b70099e0b4 req-0074e98a-a030-4702-b305-adb61a3e4ef8 service nova] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.compute.manager [req-0229c91d-1cf0-457a-b64f-b6b70099e0b4 req-0074e98a-a030-4702-b305-adb61a3e4ef8 service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] No waiting events found dispatching network-vif-plugged-48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:33:37 user nova-compute[74692]: WARNING nova.compute.manager [req-0229c91d-1cf0-457a-b64f-b6b70099e0b4 req-0074e98a-a030-4702-b305-adb61a3e4ef8 service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Received unexpected event network-vif-plugged-48b99854-18f7-4fb9-b31f-9e669aa9fa6a for instance with vm_state building and task_state spawning.
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.669s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] <== connect_volume: return (1671ms) {'type': 'block', 'scsi_wwn': '23164353338303532', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164353338303532', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T18:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2059968008',display_name='tempest-TestShelveInstance-server-2059968008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2059968008',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1852882518',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5425715d2457463b8464c69b99c63831',ramdisk_id='',reservation_id='r-3gclmodf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-213519045',owner_user_name='tempest-TestShelveInstance-213519045-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:33:27Z,user_data=None,user_id='dce10cede81746b2bead51383a21b0a3',uuid=7960f76b-9176-4d98-8045-03678457add7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Converting VIF {"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=bdd4ef83-835c-42c0-a7e0-0432ab03618f,network=Network(cb98a4f1-8a2e-4b02-923f-810f47f4dccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd4ef83-83') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.objects.instance [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lazy-loading 'pci_devices' on Instance uuid 7960f76b-9176-4d98-8045-03678457add7 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.objects.base [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Object Instance<7960f76b-9176-4d98-8045-03678457add7> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:33:37 user nova-compute[74692]:   <uuid>7960f76b-9176-4d98-8045-03678457add7</uuid>
Nov 18 18:33:37 user nova-compute[74692]:   <name>instance-0000000b</name>
Nov 18 18:33:37 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:33:37 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:33:37 user nova-compute[74692]:   <metadata>
Nov 18 18:33:37 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:33:37 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:33:37 user nova-compute[74692]:       <nova:name>tempest-TestShelveInstance-server-2059968008</nova:name>
Nov 18 18:33:37 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:33:35</nova:creationTime>
Nov 18 18:33:37 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:33:37 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:33:37 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:33:37 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:33:37 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:33:37 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:33:37 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:33:37 user nova-compute[74692]:       <nova:owner>
Nov 18 18:33:37 user nova-compute[74692]:         <nova:user uuid="dce10cede81746b2bead51383a21b0a3">tempest-TestShelveInstance-213519045-project-member</nova:user>
Nov 18 18:33:37 user nova-compute[74692]:         <nova:project uuid="5425715d2457463b8464c69b99c63831">tempest-TestShelveInstance-213519045</nova:project>
Nov 18 18:33:37 user nova-compute[74692]:       </nova:owner>
Nov 18 18:33:37 user nova-compute[74692]:       <nova:ports>
Nov 18 18:33:37 user nova-compute[74692]:         <nova:port uuid="bdd4ef83-835c-42c0-a7e0-0432ab03618f">
Nov 18 18:33:37 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 18:33:37 user nova-compute[74692]:         </nova:port>
Nov 18 18:33:37 user nova-compute[74692]:       </nova:ports>
Nov 18 18:33:37 user nova-compute[74692]:     </nova:instance>
Nov 18 18:33:37 user nova-compute[74692]:   </metadata>
Nov 18 18:33:37 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:33:37 user nova-compute[74692]:     <system>
Nov 18 18:33:37 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:33:37 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:33:37 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:33:37 user nova-compute[74692]:       <entry name="serial">7960f76b-9176-4d98-8045-03678457add7</entry>
Nov 18 18:33:37 user nova-compute[74692]:       <entry name="uuid">7960f76b-9176-4d98-8045-03678457add7</entry>
Nov 18 18:33:37 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:33:37 user nova-compute[74692]:     </system>
Nov 18 18:33:37 user nova-compute[74692]:   </sysinfo>
Nov 18 18:33:37 user nova-compute[74692]:   <os>
Nov 18 18:33:37 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:33:37 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:33:37 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:33:37 user nova-compute[74692]:   </os>
Nov 18 18:33:37 user nova-compute[74692]:   <features>
Nov 18 18:33:37 user nova-compute[74692]:     <acpi/>
Nov 18 18:33:37 user nova-compute[74692]:     <apic/>
Nov 18 18:33:37 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:33:37 user nova-compute[74692]:   </features>
Nov 18 18:33:37 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:33:37 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:33:37 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:33:37 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:33:37 user nova-compute[74692]:   </clock>
Nov 18 18:33:37 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:33:37 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:33:37 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:33:37 user nova-compute[74692]:   </cpu>
Nov 18 18:33:37 user nova-compute[74692]:   <devices>
Nov 18 18:33:37 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:33:37 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:33:37 user nova-compute[74692]:       <source dev="/dev/sdb"/>
Nov 18 18:33:37 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:33:37 user nova-compute[74692]:       <serial>3eeda74a-6f86-4797-8c30-fb05c69e7bd6</serial>
Nov 18 18:33:37 user nova-compute[74692]:     </disk>
Nov 18 18:33:37 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:33:37 user nova-compute[74692]:       <mac address="fa:16:3e:0c:58:cc"/>
Nov 18 18:33:37 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:33:37 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:33:37 user nova-compute[74692]:       <target dev="tapbdd4ef83-83"/>
Nov 18 18:33:37 user nova-compute[74692]:     </interface>
Nov 18 18:33:37 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:33:37 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/7960f76b-9176-4d98-8045-03678457add7/console.log" append="off"/>
Nov 18 18:33:37 user nova-compute[74692]:     </serial>
Nov 18 18:33:37 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:33:37 user nova-compute[74692]:     <video>
Nov 18 18:33:37 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:33:37 user nova-compute[74692]:     </video>
Nov 18 18:33:37 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:33:37 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:33:37 user nova-compute[74692]:     </rng>
Nov 18 18:33:37 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:33:37 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:33:37 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:33:37 user nova-compute[74692]:     </memballoon>
Nov 18 18:33:37 user nova-compute[74692]:   </devices>
Nov 18 18:33:37 user nova-compute[74692]: </domain>
Nov 18 18:33:37 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T18:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2059968008',display_name='tempest-TestShelveInstance-server-2059968008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2059968008',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1852882518',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:29:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5425715d2457463b8464c69b99c63831',ramdisk_id='',reservation_id='r-3gclmodf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-213519045',owner_user_name='tempest-TestShelveInstance-213519045-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:33:27Z,user_data=None,user_id='dce10cede81746b2bead51383a21b0a3',uuid=7960f76b-9176-4d98-8045-03678457add7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Converting VIF {"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=bdd4ef83-835c-42c0-a7e0-0432ab03618f,network=Network(cb98a4f1-8a2e-4b02-923f-810f47f4dccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd4ef83-83') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG os_vif [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=bdd4ef83-835c-42c0-a7e0-0432ab03618f,network=Network(cb98a4f1-8a2e-4b02-923f-810f47f4dccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd4ef83-83') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0f343f2-e9d5-5c81-a2c9-b28965c6461c', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdd4ef83-83, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbdd4ef83-83, col_values=(('qos', UUID('e5bd8d86-21c7-48fa-8d85-70db1ef2a42b')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbdd4ef83-83, col_values=(('external_ids', {'iface-id': 'bdd4ef83-835c-42c0-a7e0-0432ab03618f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:58:cc', 'vm-uuid': '7960f76b-9176-4d98-8045-03678457add7'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:37 user nova-compute[74692]: INFO os_vif [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=bdd4ef83-835c-42c0-a7e0-0432ab03618f,network=Network(cb98a4f1-8a2e-4b02-923f-810f47f4dccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd4ef83-83')
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:33:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] No VIF found with MAC fa:16:3e:0c:58:cc, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:33:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-1a443699-92a6-43d0-832b-3bad6baa782e req-c62d605c-d4e7-407c-8853-baf383dac175 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1a443699-92a6-43d0-832b-3bad6baa782e req-c62d605c-d4e7-407c-8853-baf383dac175 service nova] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1a443699-92a6-43d0-832b-3bad6baa782e req-c62d605c-d4e7-407c-8853-baf383dac175 service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1a443699-92a6-43d0-832b-3bad6baa782e req-c62d605c-d4e7-407c-8853-baf383dac175 service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-1a443699-92a6-43d0-832b-3bad6baa782e req-c62d605c-d4e7-407c-8853-baf383dac175 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] No waiting events found dispatching network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:33:38 user nova-compute[74692]: WARNING nova.compute.manager [req-1a443699-92a6-43d0-832b-3bad6baa782e req-c62d605c-d4e7-407c-8853-baf383dac175 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received unexpected event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 18:33:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:33:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:33:38 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Instance spawned successfully.
Nov 18 18:33:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:33:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:33:39 user nova-compute[74692]: INFO nova.compute.manager [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Took 6.60 seconds to spawn the instance on the hypervisor.
Nov 18 18:33:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:33:39 user nova-compute[74692]: INFO nova.compute.manager [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Took 7.91 seconds to build instance.
Nov 18 18:33:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cf9af58f-6020-4883-9f4b-e3e1757d127a tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.084s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-d6dea407-7b82-443e-8a1a-12530fcd6eb4 req-00613ed6-ecdb-4bf5-8f5e-2969affb7e56 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:33:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d6dea407-7b82-443e-8a1a-12530fcd6eb4 req-00613ed6-ecdb-4bf5-8f5e-2969affb7e56 service nova] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d6dea407-7b82-443e-8a1a-12530fcd6eb4 req-00613ed6-ecdb-4bf5-8f5e-2969affb7e56 service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d6dea407-7b82-443e-8a1a-12530fcd6eb4 req-00613ed6-ecdb-4bf5-8f5e-2969affb7e56 service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-d6dea407-7b82-443e-8a1a-12530fcd6eb4 req-00613ed6-ecdb-4bf5-8f5e-2969affb7e56 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] No waiting events found dispatching network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:33:41 user nova-compute[74692]: WARNING nova.compute.manager [req-d6dea407-7b82-443e-8a1a-12530fcd6eb4 req-00613ed6-ecdb-4bf5-8f5e-2969affb7e56 service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received unexpected event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 18:33:41 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:33:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:33:41 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7960f76b-9176-4d98-8045-03678457add7] Instance spawned successfully.
Nov 18 18:33:41 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:33:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e2c42f6-8e66-487c-bcfa-622bd1823675 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "7960f76b-9176-4d98-8045-03678457add7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.239s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:33:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:33:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "bebb6344-183e-4367-bb0b-b575b70adfbc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:33:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:33:59 user nova-compute[74692]: INFO nova.compute.manager [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Detaching volume 38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48
Nov 18 18:33:59 user nova-compute[74692]: INFO nova.virt.block_device [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Attempting to driver detach volume 38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 from mountpoint /dev/vdc
Nov 18 18:33:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Attempting to detach device vdc from instance bebb6344-183e-4367-bb0b-b575b70adfbc from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:33:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:33:59 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:33:59 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:33:59 user nova-compute[74692]:   <target dev="vdc" bus="virtio"/>
Nov 18 18:33:59 user nova-compute[74692]:   <serial>38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48</serial>
Nov 18 18:33:59 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 18:33:59 user nova-compute[74692]: </disk>
Nov 18 18:33:59 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:33:59 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Successfully detached device vdc from instance bebb6344-183e-4367-bb0b-b575b70adfbc from the persistent domain config.
Nov 18 18:33:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bebb6344-183e-4367-bb0b-b575b70adfbc from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:33:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:33:59 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:33:59 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:33:59 user nova-compute[74692]:   <target dev="vdc" bus="virtio"/>
Nov 18 18:33:59 user nova-compute[74692]:   <serial>38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48</serial>
Nov 18 18:33:59 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 18:33:59 user nova-compute[74692]: </disk>
Nov 18 18:33:59 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:34:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bebb6344-183e-4367-bb0b-b575b70adfbc {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:34:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:04 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:34:05 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:34:05 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:34:05 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 18:34:05 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:34:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:07 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:34:07 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:34:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:08 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:34:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:34:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:11 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:34:11 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:34:11 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7202MB free_disk=25.290374755859375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:34:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 153d4723-7ede-41b3-9f64-a0487f617ed2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance bebb6344-183e-4367-bb0b-b575b70adfbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance c9c2ea43-093a-48ea-a464-373482eb1638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7960f76b-9176-4d98-8045-03678457add7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 873169f2-f1a7-4c16-8b8c-88767fea7fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 18:34:12 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] There are 0 instances to clean {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 18:34:13 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:34:14 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:34:14 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:34:15 user nova-compute[74692]: INFO nova.compute.manager [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Rescuing
Nov 18 18:34:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "refresh_cache-d949d403-0a45-48bc-b64a-f63b114d1944" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:34:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquired lock "refresh_cache-d949d403-0a45-48bc-b64a-f63b114d1944" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:34:15 user nova-compute[74692]: DEBUG nova.network.neutron [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:34:16 user nova-compute[74692]: DEBUG nova.network.neutron [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Updating instance_info_cache with network_info: [{"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:34:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Releasing lock "refresh_cache-d949d403-0a45-48bc-b64a-f63b114d1944" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:34:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-8b1c58ef-ade7-4a19-aafd-4738957938d0 req-fdd5ff85-deb6-48e7-99e5-f3fd91d0a10c service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received event network-vif-unplugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:34:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8b1c58ef-ade7-4a19-aafd-4738957938d0 req-fdd5ff85-deb6-48e7-99e5-f3fd91d0a10c service nova] Acquiring lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8b1c58ef-ade7-4a19-aafd-4738957938d0 req-fdd5ff85-deb6-48e7-99e5-f3fd91d0a10c service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8b1c58ef-ade7-4a19-aafd-4738957938d0 req-fdd5ff85-deb6-48e7-99e5-f3fd91d0a10c service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-8b1c58ef-ade7-4a19-aafd-4738957938d0 req-fdd5ff85-deb6-48e7-99e5-f3fd91d0a10c service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] No waiting events found dispatching network-vif-unplugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:34:16 user nova-compute[74692]: WARNING nova.compute.manager [req-8b1c58ef-ade7-4a19-aafd-4738957938d0 req-fdd5ff85-deb6-48e7-99e5-f3fd91d0a10c service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received unexpected event network-vif-unplugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 for instance with vm_state active and task_state rescuing.
Nov 18 18:34:16 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:34:17 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Instance destroyed successfully.
Nov 18 18:34:17 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Attempting rescue
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74692) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Instance directory exists: not creating {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 18:34:17 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Creating image(s)
Nov 18 18:34:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "/opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "/opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "/opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.objects.instance [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'trusted_certs' on Instance uuid d949d403-0a45-48bc-b64a-f63b114d1944 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue" returned: 0 in 0.045s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.objects.instance [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'migration_context' on Instance uuid d949d403-0a45-48bc-b64a-f63b114d1944 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.objects.base [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Object Instance<d949d403-0a45-48bc-b64a-f63b114d1944> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Start _get_guest_xml network_info=[{"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "vif_mac": "fa:16:3e:cc:41:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.objects.instance [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'resources' on Instance uuid d949d403-0a45-48bc-b64a-f63b114d1944 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.objects.base [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Object Instance<d949d403-0a45-48bc-b64a-f63b114d1944> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.objects.instance [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'numa_topology' on Instance uuid d949d403-0a45-48bc-b64a-f63b114d1944 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.objects.base [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Object Instance<d949d403-0a45-48bc-b64a-f63b114d1944> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:34:17 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:34:17 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.objects.instance [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'vcpu_model' on Instance uuid d949d403-0a45-48bc-b64a-f63b114d1944 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.objects.base [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Object Instance<d949d403-0a45-48bc-b64a-f63b114d1944> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-32162393',display_name='tempest-ServerRescueNegativeTestJSON-server-32162393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-32162393',id=15,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:32:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fead685ad47d4e96bb7c5225029f82ce',ramdisk_id='',reservation_id='r-7p8a4cme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-88342386',owner_user_name='tempest-ServerRescueNegativeTestJSON-88342386-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:32:36Z,user_data=None,user_id='c418956015544fb8ac0a8acb6af6aacd',uuid=d949d403-0a45-48bc-b64a-f63b114d1944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "vif_mac": "fa:16:3e:cc:41:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converting VIF {"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "vif_mac": "fa:16:3e:cc:41:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:41:ab,bridge_name='br-int',has_traffic_filtering=True,id=e8afbd9d-a907-4180-9db9-9eee0652b0f9,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8afbd9d-a9') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.objects.instance [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'pci_devices' on Instance uuid d949d403-0a45-48bc-b64a-f63b114d1944 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.objects.base [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Object Instance<d949d403-0a45-48bc-b64a-f63b114d1944> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:34:17 user nova-compute[74692]:   <uuid>d949d403-0a45-48bc-b64a-f63b114d1944</uuid>
Nov 18 18:34:17 user nova-compute[74692]:   <name>instance-0000000f</name>
Nov 18 18:34:17 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:34:17 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:34:17 user nova-compute[74692]:   <metadata>
Nov 18 18:34:17 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:34:17 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:34:17 user nova-compute[74692]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-32162393</nova:name>
Nov 18 18:34:17 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:34:17</nova:creationTime>
Nov 18 18:34:17 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:34:17 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:34:17 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:34:17 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:34:17 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:34:17 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:34:17 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:34:17 user nova-compute[74692]:       <nova:owner>
Nov 18 18:34:17 user nova-compute[74692]:         <nova:user uuid="c418956015544fb8ac0a8acb6af6aacd">tempest-ServerRescueNegativeTestJSON-88342386-project-member</nova:user>
Nov 18 18:34:17 user nova-compute[74692]:         <nova:project uuid="fead685ad47d4e96bb7c5225029f82ce">tempest-ServerRescueNegativeTestJSON-88342386</nova:project>
Nov 18 18:34:17 user nova-compute[74692]:       </nova:owner>
Nov 18 18:34:17 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:34:17 user nova-compute[74692]:       <nova:ports>
Nov 18 18:34:17 user nova-compute[74692]:         <nova:port uuid="e8afbd9d-a907-4180-9db9-9eee0652b0f9">
Nov 18 18:34:17 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 18 18:34:17 user nova-compute[74692]:         </nova:port>
Nov 18 18:34:17 user nova-compute[74692]:       </nova:ports>
Nov 18 18:34:17 user nova-compute[74692]:     </nova:instance>
Nov 18 18:34:17 user nova-compute[74692]:   </metadata>
Nov 18 18:34:17 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:34:17 user nova-compute[74692]:     <system>
Nov 18 18:34:17 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:34:17 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:34:17 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:34:17 user nova-compute[74692]:       <entry name="serial">d949d403-0a45-48bc-b64a-f63b114d1944</entry>
Nov 18 18:34:17 user nova-compute[74692]:       <entry name="uuid">d949d403-0a45-48bc-b64a-f63b114d1944</entry>
Nov 18 18:34:17 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:34:17 user nova-compute[74692]:     </system>
Nov 18 18:34:17 user nova-compute[74692]:   </sysinfo>
Nov 18 18:34:17 user nova-compute[74692]:   <os>
Nov 18 18:34:17 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:34:17 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:34:17 user nova-compute[74692]:   </os>
Nov 18 18:34:17 user nova-compute[74692]:   <features>
Nov 18 18:34:17 user nova-compute[74692]:     <acpi/>
Nov 18 18:34:17 user nova-compute[74692]:     <apic/>
Nov 18 18:34:17 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:34:17 user nova-compute[74692]:   </features>
Nov 18 18:34:17 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:34:17 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:34:17 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:34:17 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:34:17 user nova-compute[74692]:   </clock>
Nov 18 18:34:17 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:34:17 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:34:17 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:34:17 user nova-compute[74692]:   </cpu>
Nov 18 18:34:17 user nova-compute[74692]:   <devices>
Nov 18 18:34:17 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:34:17 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:34:17 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue"/>
Nov 18 18:34:17 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:34:17 user nova-compute[74692]:     </disk>
Nov 18 18:34:17 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:34:17 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:34:17 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk"/>
Nov 18 18:34:17 user nova-compute[74692]:       <target dev="vdb" bus="virtio"/>
Nov 18 18:34:17 user nova-compute[74692]:     </disk>
Nov 18 18:34:17 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:34:17 user nova-compute[74692]:       <mac address="fa:16:3e:cc:41:ab"/>
Nov 18 18:34:17 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:34:17 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:34:17 user nova-compute[74692]:       <target dev="tape8afbd9d-a9"/>
Nov 18 18:34:17 user nova-compute[74692]:     </interface>
Nov 18 18:34:17 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:34:17 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/console.log" append="off"/>
Nov 18 18:34:17 user nova-compute[74692]:     </serial>
Nov 18 18:34:17 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:34:17 user nova-compute[74692]:     <video>
Nov 18 18:34:17 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:34:17 user nova-compute[74692]:     </video>
Nov 18 18:34:17 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:34:17 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:34:17 user nova-compute[74692]:     </rng>
Nov 18 18:34:17 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:34:17 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:34:17 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:34:17 user nova-compute[74692]:     </memballoon>
Nov 18 18:34:17 user nova-compute[74692]:   </devices>
Nov 18 18:34:17 user nova-compute[74692]: </domain>
Nov 18 18:34:17 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:34:17 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Instance destroyed successfully.
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No VIF found with MAC fa:16:3e:cc:41:ab, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:34:17 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid 153d4723-7ede-41b3-9f64-a0487f617ed2 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Updating instance_info_cache with network_info: [{"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-9c043790-61ae-42d6-bda4-89e9b706598b req-94d9dc9b-4ba3-41f2-9b1d-d87f3fc321d6 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received event network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9c043790-61ae-42d6-bda4-89e9b706598b req-94d9dc9b-4ba3-41f2-9b1d-d87f3fc321d6 service nova] Acquiring lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9c043790-61ae-42d6-bda4-89e9b706598b req-94d9dc9b-4ba3-41f2-9b1d-d87f3fc321d6 service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9c043790-61ae-42d6-bda4-89e9b706598b req-94d9dc9b-4ba3-41f2-9b1d-d87f3fc321d6 service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-9c043790-61ae-42d6-bda4-89e9b706598b req-94d9dc9b-4ba3-41f2-9b1d-d87f3fc321d6 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] No waiting events found dispatching network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:34:18 user nova-compute[74692]: WARNING nova.compute.manager [req-9c043790-61ae-42d6-bda4-89e9b706598b req-94d9dc9b-4ba3-41f2-9b1d-d87f3fc321d6 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received unexpected event network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 for instance with vm_state active and task_state rescuing.
Nov 18 18:34:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:20 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance bebb6344-183e-4367-bb0b-b575b70adfbc is timed out.
Nov 18 18:34:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Successfully detached device vdc from instance bebb6344-183e-4367-bb0b-b575b70adfbc from the live domain config.
Nov 18 18:34:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcZMsyfk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:34:20 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa16df2-dedf-4182-9001-dccb6e29840a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:34:20 user nova-compute[74692]: No targets found.
Nov 18 18:34:20 user nova-compute[74692]: iSNS:
Nov 18 18:34:20 user nova-compute[74692]: No targets found.
Nov 18 18:34:20 user nova-compute[74692]: STATIC:
Nov 18 18:34:20 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48
Nov 18 18:34:20 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:34:20 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:34:20 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:34:20 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:34:20 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:34:20 user nova-compute[74692]: FIRMWARE:
Nov 18 18:34:20 user nova-compute[74692]: No targets found.
Nov 18 18:34:20 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:34:20 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:34:20 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fea2006-a0cb-4219-9476-4be3e3ed475a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d3452-82b0-43fc-8e83-db9aef838a81]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 (non-flash)
Nov 18 18:34:20 user nova-compute[74692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:34:20 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 (non-flash)
Nov 18 18:34:20 user nova-compute[74692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:34:20 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c4670f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48'): ({'sdc'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Removing single pathed devices sdc {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f44230-e588-4596-9809-37259793ac77]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd597ef-90f0-40a8-8871-ad872a0768a0]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Flushing IO for device /dev/sdc {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8de37da-91b2-478e-a222-64992e7faac0]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[516a5ef8-11bd-4d34-877f-6d506b8e3bb4]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8863b173-151c-427f-a723-533ffb95e5f9]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e84552-4b6e-481b-8e27-877dc38c6ca6]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48, portal: 172.16.0.220,3260]
Nov 18 18:34:20 user nova-compute[74692]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48, portal: 172.16.0.220,3260] successful.
Nov 18 18:34:20 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ae52ba-ea3e-4d16-b6f3-8a6f4ca2de48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[55292f79-5ac2-4fd4-9c9f-94e06f5403fb]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] <== disconnect_volume: return (279ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-de35ea22-f14b-4b64-ba16-350d29c062a5 req-acaf01ec-e757-4a02-953f-ca49c54aa628 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received event network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-de35ea22-f14b-4b64-ba16-350d29c062a5 req-acaf01ec-e757-4a02-953f-ca49c54aa628 service nova] Acquiring lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-de35ea22-f14b-4b64-ba16-350d29c062a5 req-acaf01ec-e757-4a02-953f-ca49c54aa628 service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-de35ea22-f14b-4b64-ba16-350d29c062a5 req-acaf01ec-e757-4a02-953f-ca49c54aa628 service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-de35ea22-f14b-4b64-ba16-350d29c062a5 req-acaf01ec-e757-4a02-953f-ca49c54aa628 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] No waiting events found dispatching network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:34:20 user nova-compute[74692]: WARNING nova.compute.manager [req-de35ea22-f14b-4b64-ba16-350d29c062a5 req-acaf01ec-e757-4a02-953f-ca49c54aa628 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received unexpected event network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 for instance with vm_state active and task_state rescuing.
Nov 18 18:34:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-de35ea22-f14b-4b64-ba16-350d29c062a5 req-acaf01ec-e757-4a02-953f-ca49c54aa628 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received event network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-de35ea22-f14b-4b64-ba16-350d29c062a5 req-acaf01ec-e757-4a02-953f-ca49c54aa628 service nova] Acquiring lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-de35ea22-f14b-4b64-ba16-350d29c062a5 req-acaf01ec-e757-4a02-953f-ca49c54aa628 service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-de35ea22-f14b-4b64-ba16-350d29c062a5 req-acaf01ec-e757-4a02-953f-ca49c54aa628 service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-de35ea22-f14b-4b64-ba16-350d29c062a5 req-acaf01ec-e757-4a02-953f-ca49c54aa628 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] No waiting events found dispatching network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:34:20 user nova-compute[74692]: WARNING nova.compute.manager [req-de35ea22-f14b-4b64-ba16-350d29c062a5 req-acaf01ec-e757-4a02-953f-ca49c54aa628 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received unexpected event network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 for instance with vm_state active and task_state rescuing.
Nov 18 18:34:21 user nova-compute[74692]: DEBUG nova.compute.manager [None req-ab7f8ef5-970d-4361-8fd3-17d891969404 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:34:21 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'flavor' on Instance uuid bebb6344-183e-4367-bb0b-b575b70adfbc {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:34:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8969e7f5-3346-4ef6-a67b-b5d2e57d9b41 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.731s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-dd661231-d892-4e26-8705-6c85426129ac req-0b5591be-a5ef-47cb-8947-09c4561c1631 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Received event network-changed-fe82ba82-5046-473f-b0a7-7212a924e5de {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:34:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-dd661231-d892-4e26-8705-6c85426129ac req-0b5591be-a5ef-47cb-8947-09c4561c1631 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Refreshing instance network info cache due to event network-changed-fe82ba82-5046-473f-b0a7-7212a924e5de. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:34:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-dd661231-d892-4e26-8705-6c85426129ac req-0b5591be-a5ef-47cb-8947-09c4561c1631 service nova] Acquiring lock "refresh_cache-c9c2ea43-093a-48ea-a464-373482eb1638" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:34:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-dd661231-d892-4e26-8705-6c85426129ac req-0b5591be-a5ef-47cb-8947-09c4561c1631 service nova] Acquired lock "refresh_cache-c9c2ea43-093a-48ea-a464-373482eb1638" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:34:24 user nova-compute[74692]: DEBUG nova.network.neutron [req-dd661231-d892-4e26-8705-6c85426129ac req-0b5591be-a5ef-47cb-8947-09c4561c1631 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Refreshing network info cache for port fe82ba82-5046-473f-b0a7-7212a924e5de {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:34:24 user nova-compute[74692]: DEBUG nova.network.neutron [req-dd661231-d892-4e26-8705-6c85426129ac req-0b5591be-a5ef-47cb-8947-09c4561c1631 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Updated VIF entry in instance network info cache for port fe82ba82-5046-473f-b0a7-7212a924e5de. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:34:24 user nova-compute[74692]: DEBUG nova.network.neutron [req-dd661231-d892-4e26-8705-6c85426129ac req-0b5591be-a5ef-47cb-8947-09c4561c1631 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Updating instance_info_cache with network_info: [{"id": "fe82ba82-5046-473f-b0a7-7212a924e5de", "address": "fa:16:3e:f3:04:2c", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe82ba82-50", "ovs_interfaceid": "fe82ba82-5046-473f-b0a7-7212a924e5de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:34:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-dd661231-d892-4e26-8705-6c85426129ac req-0b5591be-a5ef-47cb-8947-09c4561c1631 service nova] Releasing lock "refresh_cache-c9c2ea43-093a-48ea-a464-373482eb1638" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:34:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "c9c2ea43-093a-48ea-a464-373482eb1638" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c9c2ea43-093a-48ea-a464-373482eb1638" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:26 user nova-compute[74692]: DEBUG nova.objects.instance [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lazy-loading 'flavor' on Instance uuid c9c2ea43-093a-48ea-a464-373482eb1638 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:34:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c9c2ea43-093a-48ea-a464-373482eb1638" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "c9c2ea43-093a-48ea-a464-373482eb1638" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c9c2ea43-093a-48ea-a464-373482eb1638" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:27 user nova-compute[74692]: INFO nova.compute.manager [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Attaching volume cfdd363e-5781-46ac-8295-c2184d668424 to /dev/vdb
Nov 18 18:34:27 user nova-compute[74692]: DEBUG os_brick.utils [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[39000934-ec79-4f8a-984f-f495b17a05f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[11faf1f1-22ba-4c88-9fd4-53718df6e06e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[820a75a7-c6fe-4113-9f1a-59ba2d7475c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c7863e-fe23-4bdc-812d-dc640da5f711]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:34:27 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:34:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f30b5e-c563-4ecd-b9bd-d5a44f162776]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG os_brick.utils [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:34:27 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Updating existing volume attachment record: ef2036c8-0465-45ed-b8eb-d6f3e48ed336 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:34:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvQSsfLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:34:33 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:34:33 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:34:33 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b16bc9e-fd3e-40ff-8500-f66f3c4fe951]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:34:33 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e698cc86-66fc-426f-a79a-7e2b24e512c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424] added
Nov 18 18:34:33 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ef4e85-fddf-43b2-909f-3507d4ddca17]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf1e918-c159-4c28-8cfa-51939cd721f5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KvQSsfLz {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KvQSsfLz" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3181cb3-052e-4c9b-96f7-9d91eed37d4b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KvQSsfLz'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c0be2c-ee99-46ca-b4e2-61b8d1ba0cfb]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[59daa966-aefc-4e98-9d20-8f12999ba9f8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c800081c-4624-4670-b690-efbe8cfa9d99 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:34:33 user nova-compute[74692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c800081c-4624-4670-b690-efbe8cfa9d99 (non-flash)
Nov 18 18:34:33 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:34:33 user nova-compute[74692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c800081c-4624-4670-b690-efbe8cfa9d99 (non-flash)
Nov 18 18:34:33 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c2f458-ac41-4bb2-af1e-0fc79179236d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424, portal: 172.16.0.220,3260]
Nov 18 18:34:33 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424, portal: 172.16.0.220,3260] successful.
Nov 18 18:34:33 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[713e8ca5-e40d-4382-ad48-5c09b1a40264]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6931e85a-d346-4b57-81f8-1631cecece64]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c800081c-4624-4670-b690-efbe8cfa9d99 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:34:33 user nova-compute[74692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c800081c-4624-4670-b690-efbe8cfa9d99 (non-flash)
Nov 18 18:34:33 user nova-compute[74692]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 (non-flash)
Nov 18 18:34:33 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:34:33 user nova-compute[74692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c800081c-4624-4670-b690-efbe8cfa9d99 (non-flash)
Nov 18 18:34:33 user nova-compute[74692]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 (non-flash)
Nov 18 18:34:33 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:34:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.036s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5856c13-6f1b-4411-aeae-4a689282b35c]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:34 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:34:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvQSsfLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:34:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:34:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23335373139336439', 'path': '/dev/sdd'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:34:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335373139336439', 'path': '/dev/sdd'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:34:35 user nova-compute[74692]: DEBUG nova.objects.instance [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lazy-loading 'flavor' on Instance uuid c9c2ea43-093a-48ea-a464-373482eb1638 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:34:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:34:35 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:34:35 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:34:35 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:34:35 user nova-compute[74692]:   <serial>cfdd363e-5781-46ac-8295-c2184d668424</serial>
Nov 18 18:34:35 user nova-compute[74692]: </disk>
Nov 18 18:34:35 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:34:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:34:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:34:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] No VIF found with MAC fa:16:3e:f3:04:2c, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:34:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a16bd2dd-7697-4e38-acc5-4adb79c3ce15 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c9c2ea43-093a-48ea-a464-373482eb1638" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.230s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "c9c2ea43-093a-48ea-a464-373482eb1638" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c9c2ea43-093a-48ea-a464-373482eb1638" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:37 user nova-compute[74692]: INFO nova.compute.manager [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Detaching volume cfdd363e-5781-46ac-8295-c2184d668424
Nov 18 18:34:38 user nova-compute[74692]: INFO nova.virt.block_device [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Attempting to driver detach volume cfdd363e-5781-46ac-8295-c2184d668424 from mountpoint /dev/vdb
Nov 18 18:34:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Attempting to detach device vdb from instance c9c2ea43-093a-48ea-a464-373482eb1638 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:34:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:34:38 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:34:38 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:34:38 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:34:38 user nova-compute[74692]:   <serial>cfdd363e-5781-46ac-8295-c2184d668424</serial>
Nov 18 18:34:38 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:34:38 user nova-compute[74692]: </disk>
Nov 18 18:34:38 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:34:38 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Successfully detached device vdb from instance c9c2ea43-093a-48ea-a464-373482eb1638 from the persistent domain config.
Nov 18 18:34:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9c2ea43-093a-48ea-a464-373482eb1638 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:34:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:34:38 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:34:38 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:34:38 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:34:38 user nova-compute[74692]:   <serial>cfdd363e-5781-46ac-8295-c2184d668424</serial>
Nov 18 18:34:38 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:34:38 user nova-compute[74692]: </disk>
Nov 18 18:34:38 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9c2ea43-093a-48ea-a464-373482eb1638 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 153d4723-7ede-41b3-9f64-a0487f617ed2 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 7540540c-af3e-4992-8756-3497a3bd4bf6 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid d949d403-0a45-48bc-b64a-f63b114d1944 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid c9c2ea43-093a-48ea-a464-373482eb1638 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid dd434b0c-593a-47ad-9109-0f8b5f545b6c {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 3fd9a073-962e-44de-9252-2d5e339093bc {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 873169f2-f1a7-4c16-8b8c-88767fea7fc9 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid bebb6344-183e-4367-bb0b-b575b70adfbc {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 7960f76b-9176-4d98-8045-03678457add7 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "d949d403-0a45-48bc-b64a-f63b114d1944" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "d949d403-0a45-48bc-b64a-f63b114d1944" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "c9c2ea43-093a-48ea-a464-373482eb1638" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "3fd9a073-962e-44de-9252-2d5e339093bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "3fd9a073-962e-44de-9252-2d5e339093bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "bebb6344-183e-4367-bb0b-b575b70adfbc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "7960f76b-9176-4d98-8045-03678457add7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "d949d403-0a45-48bc-b64a-f63b114d1944" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "3fd9a073-962e-44de-9252-2d5e339093bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "7960f76b-9176-4d98-8045-03678457add7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "bebb6344-183e-4367-bb0b-b575b70adfbc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:49 user nova-compute[74692]: INFO nova.compute.manager [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Terminating instance
Nov 18 18:34:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:34:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-e087dd22-569a-496c-a850-afb46250d2b3 req-67228f7b-4b75-4236-94ea-6f6ca36bd62d service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received event network-vif-unplugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e087dd22-569a-496c-a850-afb46250d2b3 req-67228f7b-4b75-4236-94ea-6f6ca36bd62d service nova] Acquiring lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e087dd22-569a-496c-a850-afb46250d2b3 req-67228f7b-4b75-4236-94ea-6f6ca36bd62d service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e087dd22-569a-496c-a850-afb46250d2b3 req-67228f7b-4b75-4236-94ea-6f6ca36bd62d service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-e087dd22-569a-496c-a850-afb46250d2b3 req-67228f7b-4b75-4236-94ea-6f6ca36bd62d service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] No waiting events found dispatching network-vif-unplugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-e087dd22-569a-496c-a850-afb46250d2b3 req-67228f7b-4b75-4236-94ea-6f6ca36bd62d service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received event network-vif-unplugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:34:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Instance destroyed successfully.
Nov 18 18:34:50 user nova-compute[74692]: DEBUG nova.objects.instance [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'resources' on Instance uuid bebb6344-183e-4367-bb0b-b575b70adfbc {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T18:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1074163696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1074163696',id=2,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeLBOPFzK9EaCTBkDnIIkEDoB/rVhgGY9JYnZGbi0tGbLRkFO76l0CO4COQkIW7VJcbNIL08CVp8x3z68j+yJdAOAZQA/in4FEAcfWxAJTCv0DtidMPu5KzAnRV9OgdZw==',key_name='tempest-keypair-1821240249',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:32:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f169f28da1640d9b03b4ba44b4e7b7c',ramdisk_id='',reservation_id='r-s1ly0l0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1768400085',owner_user_name='tempest-AttachVolumeShelveTestJSON-1768400085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a005c7c46c46ad9217578412ec906f',uuid=bebb6344-183e-4367-bb0b-b575b70adfbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converting VIF {"id": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "address": "fa:16:3e:d3:98:ed", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea5c349-f1", "ovs_interfaceid": "3ea5c349-f13f-453c-81e5-388c93e6dfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:98:ed,bridge_name='br-int',has_traffic_filtering=True,id=3ea5c349-f13f-453c-81e5-388c93e6dfa4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea5c349-f1') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG os_vif [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:98:ed,bridge_name='br-int',has_traffic_filtering=True,id=3ea5c349-f13f-453c-81e5-388c93e6dfa4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea5c349-f1') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ea5c349-f1, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=081b703a-ee85-41c3-871f-c84293304254) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:34:50 user nova-compute[74692]: INFO os_vif [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:98:ed,bridge_name='br-int',has_traffic_filtering=True,id=3ea5c349-f13f-453c-81e5-388c93e6dfa4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea5c349-f1')
Nov 18 18:34:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Deleting instance files /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc_del
Nov 18 18:34:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Deletion of /opt/stack/data/nova/instances/bebb6344-183e-4367-bb0b-b575b70adfbc_del complete
Nov 18 18:34:50 user nova-compute[74692]: INFO nova.compute.manager [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 18 18:34:50 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:34:50 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:34:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-609b54bb-31b9-4483-a33b-35d5bfcc0e7b req-51007707-2a99-4532-a9a2-8e4fcb1b082d service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-changed-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:34:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-609b54bb-31b9-4483-a33b-35d5bfcc0e7b req-51007707-2a99-4532-a9a2-8e4fcb1b082d service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Refreshing instance network info cache due to event network-changed-9753f583-4360-48e8-a59f-43b16198aa36. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:34:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-609b54bb-31b9-4483-a33b-35d5bfcc0e7b req-51007707-2a99-4532-a9a2-8e4fcb1b082d service nova] Acquiring lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:34:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-609b54bb-31b9-4483-a33b-35d5bfcc0e7b req-51007707-2a99-4532-a9a2-8e4fcb1b082d service nova] Acquired lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:34:51 user nova-compute[74692]: DEBUG nova.network.neutron [req-609b54bb-31b9-4483-a33b-35d5bfcc0e7b req-51007707-2a99-4532-a9a2-8e4fcb1b082d service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Refreshing network info cache for port 9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:34:51 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:34:51 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Took 0.80 seconds to deallocate network for instance.
Nov 18 18:34:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:51 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Refreshing inventories for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 18:34:51 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Updating ProviderTree inventory for provider 582be55c-ee9f-496e-b354-5900b8401d2c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 18:34:51 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Updating inventory in ProviderTree for provider 582be55c-ee9f-496e-b354-5900b8401d2c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 18:34:51 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Refreshing aggregate associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, aggregates: None {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 18:34:51 user nova-compute[74692]: DEBUG nova.network.neutron [req-609b54bb-31b9-4483-a33b-35d5bfcc0e7b req-51007707-2a99-4532-a9a2-8e4fcb1b082d service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Updated VIF entry in instance network info cache for port 9753f583-4360-48e8-a59f-43b16198aa36. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:34:51 user nova-compute[74692]: DEBUG nova.network.neutron [req-609b54bb-31b9-4483-a33b-35d5bfcc0e7b req-51007707-2a99-4532-a9a2-8e4fcb1b082d service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Updating instance_info_cache with network_info: [{"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:34:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-609b54bb-31b9-4483-a33b-35d5bfcc0e7b req-51007707-2a99-4532-a9a2-8e4fcb1b082d service nova] Releasing lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:34:51 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Refreshing trait associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 18:34:52 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:34:52 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:34:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:52 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Deleted allocations for instance bebb6344-183e-4367-bb0b-b575b70adfbc
Nov 18 18:34:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-c465fa1b-c7eb-4a93-aec7-59d75c27dc68 req-e600214c-d2b9-40e5-815e-a7b2401b13fc service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received event network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:34:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c465fa1b-c7eb-4a93-aec7-59d75c27dc68 req-e600214c-d2b9-40e5-815e-a7b2401b13fc service nova] Acquiring lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c465fa1b-c7eb-4a93-aec7-59d75c27dc68 req-e600214c-d2b9-40e5-815e-a7b2401b13fc service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c465fa1b-c7eb-4a93-aec7-59d75c27dc68 req-e600214c-d2b9-40e5-815e-a7b2401b13fc service nova] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-c465fa1b-c7eb-4a93-aec7-59d75c27dc68 req-e600214c-d2b9-40e5-815e-a7b2401b13fc service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] No waiting events found dispatching network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:34:52 user nova-compute[74692]: WARNING nova.compute.manager [req-c465fa1b-c7eb-4a93-aec7-59d75c27dc68 req-e600214c-d2b9-40e5-815e-a7b2401b13fc service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received unexpected event network-vif-plugged-3ea5c349-f13f-453c-81e5-388c93e6dfa4 for instance with vm_state deleted and task_state None.
Nov 18 18:34:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-c465fa1b-c7eb-4a93-aec7-59d75c27dc68 req-e600214c-d2b9-40e5-815e-a7b2401b13fc service nova] [instance: bebb6344-183e-4367-bb0b-b575b70adfbc] Received event network-vif-deleted-3ea5c349-f13f-453c-81e5-388c93e6dfa4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:34:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-009c2e46-681c-4116-ac77-dd4634d7fb69 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "bebb6344-183e-4367-bb0b-b575b70adfbc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.376s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG nova.objects.instance [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'flavor' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:34:54 user nova-compute[74692]: INFO nova.compute.manager [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Attaching volume ef33492e-0be5-4134-8333-62d26e73d98c to /dev/vdb
Nov 18 18:34:54 user nova-compute[74692]: DEBUG os_brick.utils [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[93400021-21d0-4a82-b313-150e49f04b2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b276952-70e3-4ff8-bc3f-54730e7b6432]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d47ce33-3596-47e6-9530-02be30b2c9e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e62fe3-3999-4472-8ba7-83a18136ccbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:34:54 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:34:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9c9085-7dab-4bf7-a619-aac222ec6cb9]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG os_brick.utils [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:34:54 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Updating existing volume attachment record: bfd4e95c-794b-4bff-9e39-be78b5480400 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:34:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:34:59 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9c2ea43-093a-48ea-a464-373482eb1638 is timed out.
Nov 18 18:34:59 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Successfully detached device vdb from instance c9c2ea43-093a-48ea-a464-373482eb1638 from the live domain config.
Nov 18 18:34:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvQSsfLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:34:59 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a6d644-16e2-41c9-8189-e9be43c932f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:34:59 user nova-compute[74692]: No targets found.
Nov 18 18:34:59 user nova-compute[74692]: iSNS:
Nov 18 18:34:59 user nova-compute[74692]: No targets found.
Nov 18 18:34:59 user nova-compute[74692]: STATIC:
Nov 18 18:34:59 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:34:59 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:34:59 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:34:59 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424
Nov 18 18:34:59 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:34:59 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:34:59 user nova-compute[74692]: FIRMWARE:
Nov 18 18:34:59 user nova-compute[74692]: No targets found.
Nov 18 18:34:59 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:34:59 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:34:59 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b94923-1760-4c1d-8587-91a2509a8cca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da7edf6-ca93-41aa-b7dc-d55b24e230d3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:34:59 user nova-compute[74692]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 (non-flash)
Nov 18 18:34:59 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:34:59 user nova-compute[74692]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 (non-flash)
Nov 18 18:34:59 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a456ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424'): ({'sdd'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Removing single pathed devices sdd {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[54981b39-f1f0-4df9-8457-d313cd02ebc9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd34261c-fca9-42bb-84a2-b4b1cee19cf8]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Flushing IO for device /dev/sdd {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b1b78d-8fb8-46b7-a614-4f99838261d5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[231ac128-d4f3-47fe-a9c6-8fec4cb9ba71]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e599b1-ddc1-4e10-886d-6178069408ae]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c13a5f-b50a-4dc0-a866-d9f0a760e398]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424, portal: 172.16.0.220,3260]
Nov 18 18:34:59 user nova-compute[74692]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424, portal: 172.16.0.220,3260] successful.
Nov 18 18:34:59 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdd363e-5781-46ac-8295-c2184d668424 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[10386dbc-f0ae-4380-9db6-c098d3dc4a47]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] <== disconnect_volume: return (307ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NafBPsmo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:34:59 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:34:59 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:34:59 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[177d2b34-9cc6-483d-af35-117635eb0eb8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:34:59 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0158a9-fb1b-4e70-b92c-7ebe8cb9fce2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c] added
Nov 18 18:34:59 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.044s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f237484c-5f72-495d-a2b2-50f632e4f02d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:34:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[758f0fab-fe8d-4ed2-9d49-07cd78d78431]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NafBPsmo {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NafBPsmo" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed76b9b-92ed-4247-b2b7-9c8c30a79003]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NafBPsmo'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c20f37-8db4-4fa8-9255-d4c786ec6429]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fef7a9-864d-47f8-bd9c-0dd4ad1f11d0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:35:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:35:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f26658-b7f9-40b1-94bb-307299c45bf8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260]
Nov 18 18:35:00 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260] successful.
Nov 18 18:35:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6339f4-537d-4fa0-a661-9efee58f5625]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc78d53-05a5-44ba-b3df-33bb92bd871d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:35:00 user nova-compute[74692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:35:00 user nova-compute[74692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b71b4d-91ad-401d-aecd-6f4a65831248]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NafBPsmo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:35:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:35:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26234303138383966', 'path': '/dev/sdc'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:35:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234303138383966', 'path': '/dev/sdc'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:35:01 user nova-compute[74692]: DEBUG nova.objects.instance [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'flavor' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:35:01 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:35:01 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:35:01 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:35:01 user nova-compute[74692]:   <serial>ef33492e-0be5-4134-8333-62d26e73d98c</serial>
Nov 18 18:35:01 user nova-compute[74692]: </disk>
Nov 18 18:35:01 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:35:01 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lazy-loading 'flavor' on Instance uuid c9c2ea43-093a-48ea-a464-373482eb1638 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acc4894b-e1eb-4f5c-ab80-8eb25e55399b tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c9c2ea43-093a-48ea-a464-373482eb1638" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.591s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "c9c2ea43-093a-48ea-a464-373482eb1638" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 21.537s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "c9c2ea43-093a-48ea-a464-373482eb1638" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:35:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:35:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] No VIF found with MAC fa:16:3e:bb:07:0d, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:35:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e1726506-6dbd-43e8-8f11-76545d1b88a7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.536s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0f500cb4-fb4b-42a7-ab62-ff232961c00b tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0f500cb4-fb4b-42a7-ab62-ff232961c00b tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0f500cb4-fb4b-42a7-ab62-ff232961c00b tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:35:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0f500cb4-fb4b-42a7-ab62-ff232961c00b tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74692) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 18 18:35:03 user nova-compute[74692]: DEBUG nova.objects.instance [None req-0f500cb4-fb4b-42a7-ab62-ff232961c00b tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'flavor' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-7011199a-9856-4baf-8c11-4346af1162dc req-33ba956e-cd77-4c9f-bfd5-35740f38724b service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-vif-unplugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7011199a-9856-4baf-8c11-4346af1162dc req-33ba956e-cd77-4c9f-bfd5-35740f38724b service nova] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7011199a-9856-4baf-8c11-4346af1162dc req-33ba956e-cd77-4c9f-bfd5-35740f38724b service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7011199a-9856-4baf-8c11-4346af1162dc req-33ba956e-cd77-4c9f-bfd5-35740f38724b service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-7011199a-9856-4baf-8c11-4346af1162dc req-33ba956e-cd77-4c9f-bfd5-35740f38724b service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] No waiting events found dispatching network-vif-unplugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:35:03 user nova-compute[74692]: WARNING nova.compute.manager [req-7011199a-9856-4baf-8c11-4346af1162dc req-33ba956e-cd77-4c9f-bfd5-35740f38724b service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received unexpected event network-vif-unplugged-9753f583-4360-48e8-a59f-43b16198aa36 for instance with vm_state active and task_state powering-off.
Nov 18 18:35:03 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Instance destroyed successfully.
Nov 18 18:35:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0f500cb4-fb4b-42a7-ab62-ff232961c00b tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:35:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0f500cb4-fb4b-42a7-ab62-ff232961c00b tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.882s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:04 user nova-compute[74692]: DEBUG nova.compute.manager [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:35:04 user nova-compute[74692]: INFO nova.compute.manager [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] instance snapshotting
Nov 18 18:35:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Beginning live snapshot process
Nov 18 18:35:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json -f qcow2 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json -f qcow2 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-ed2d835c-80d9-4a71-a2be-b71ec9f696f9 req-4e3c90ba-e21c-4343-82f3-5475fefe490c service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ed2d835c-80d9-4a71-a2be-b71ec9f696f9 req-4e3c90ba-e21c-4343-82f3-5475fefe490c service nova] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ed2d835c-80d9-4a71-a2be-b71ec9f696f9 req-4e3c90ba-e21c-4343-82f3-5475fefe490c service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ed2d835c-80d9-4a71-a2be-b71ec9f696f9 req-4e3c90ba-e21c-4343-82f3-5475fefe490c service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-ed2d835c-80d9-4a71-a2be-b71ec9f696f9 req-4e3c90ba-e21c-4343-82f3-5475fefe490c service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] No waiting events found dispatching network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:35:05 user nova-compute[74692]: WARNING nova.compute.manager [req-ed2d835c-80d9-4a71-a2be-b71ec9f696f9 req-4e3c90ba-e21c-4343-82f3-5475fefe490c service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received unexpected event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 for instance with vm_state stopped and task_state None.
Nov 18 18:35:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.191s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpye4usxq4/0a6f873c49d745708bd64d223675b2ed.delta 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpye4usxq4/0a6f873c49d745708bd64d223675b2ed.delta 1073741824" returned: 0 in 0.054s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:05 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 18 18:35:06 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:35:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:35:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:35:06 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 18 18:35:07 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:35:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpye4usxq4/0a6f873c49d745708bd64d223675b2ed.delta /opt/stack/data/nova/instances/snapshots/tmpye4usxq4/0a6f873c49d745708bd64d223675b2ed {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpye4usxq4/0a6f873c49d745708bd64d223675b2ed.delta /opt/stack/data/nova/instances/snapshots/tmpye4usxq4/0a6f873c49d745708bd64d223675b2ed" returned: 0 in 0.504s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:07 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Snapshot extracted, beginning image upload
Nov 18 18:35:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:07 user nova-compute[74692]: DEBUG nova.objects.instance [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lazy-loading 'flavor' on Instance uuid 153d4723-7ede-41b3-9f64-a0487f617ed2 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:08 user nova-compute[74692]: INFO nova.compute.manager [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Attaching volume 38159c1d-b012-4fd2-8ce5-96216e7822e3 to /dev/vdb
Nov 18 18:35:08 user nova-compute[74692]: DEBUG os_brick.utils [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[937c698f-2316-4831-97f5-81e5a81c16cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4335108-c365-4523-904e-bbf29c02251c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ab188a-719c-4c6b-b70e-ce401be2e802]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea7e6c6-fd13-4643-836a-712770b712f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:35:08 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[92168aef-86fc-4a4e-86e5-2172c1833692]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG os_brick.utils [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Updating existing volume attachment record: 7ed7d99d-daf9-4b58-9c32-75c71b2e8549 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:35:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:09 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:35:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:35:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:35:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:10 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Snapshot image upload complete
Nov 18 18:35:10 user nova-compute[74692]: INFO nova.compute.manager [None req-beda6ac8-a5fe-4d7d-992c-a3e484dd1ee7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Took 5.58 seconds to snapshot the instance on the hypervisor.
Nov 18 18:35:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:13 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:35:13 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:35:13 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7654MB free_disk=25.255409240722656GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 153d4723-7ede-41b3-9f64-a0487f617ed2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance c9c2ea43-093a-48ea-a464-373482eb1638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7960f76b-9176-4d98-8045-03678457add7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 873169f2-f1a7-4c16-8b8c-88767fea7fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:35:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:15 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:35:15 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:35:15 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:35:15 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:35:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:35:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 18:35:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:35:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:35:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:15 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:35:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:17 user nova-compute[74692]: DEBUG nova.compute.manager [req-7dd0ef1f-7eda-4fa9-a004-b40f826a612f req-6a5c19d0-44ee-4f68-a515-c09abb365f1c service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-changed-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:17 user nova-compute[74692]: DEBUG nova.compute.manager [req-7dd0ef1f-7eda-4fa9-a004-b40f826a612f req-6a5c19d0-44ee-4f68-a515-c09abb365f1c service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Refreshing instance network info cache due to event network-changed-bdd4ef83-835c-42c0-a7e0-0432ab03618f. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:35:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7dd0ef1f-7eda-4fa9-a004-b40f826a612f req-6a5c19d0-44ee-4f68-a515-c09abb365f1c service nova] Acquiring lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:35:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7dd0ef1f-7eda-4fa9-a004-b40f826a612f req-6a5c19d0-44ee-4f68-a515-c09abb365f1c service nova] Acquired lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:35:17 user nova-compute[74692]: DEBUG nova.network.neutron [req-7dd0ef1f-7eda-4fa9-a004-b40f826a612f req-6a5c19d0-44ee-4f68-a515-c09abb365f1c service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Refreshing network info cache for port bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:35:17 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:35:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "7960f76b-9176-4d98-8045-03678457add7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "7960f76b-9176-4d98-8045-03678457add7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "7960f76b-9176-4d98-8045-03678457add7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:18 user nova-compute[74692]: INFO nova.compute.manager [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Terminating instance
Nov 18 18:35:18 user nova-compute[74692]: DEBUG nova.compute.manager [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhwRojrn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:35:18 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:35:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:35:18 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:35:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:35:18 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed2555e-45bc-41a3-aaad-c675c50f7392]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:35:18 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bc3d66-c773-4bf3-89bc-f752634452f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3] added
Nov 18 18:35:18 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-0a6efc22-9f4d-4060-b73f-33738e5a2ad3 req-c5317d9b-7a1a-4e4e-a27a-d60a3ee9af2e service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-vif-unplugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0a6efc22-9f4d-4060-b73f-33738e5a2ad3 req-c5317d9b-7a1a-4e4e-a27a-d60a3ee9af2e service nova] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0a6efc22-9f4d-4060-b73f-33738e5a2ad3 req-c5317d9b-7a1a-4e4e-a27a-d60a3ee9af2e service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0a6efc22-9f4d-4060-b73f-33738e5a2ad3 req-c5317d9b-7a1a-4e4e-a27a-d60a3ee9af2e service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-0a6efc22-9f4d-4060-b73f-33738e5a2ad3 req-c5317d9b-7a1a-4e4e-a27a-d60a3ee9af2e service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] No waiting events found dispatching network-vif-unplugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-0a6efc22-9f4d-4060-b73f-33738e5a2ad3 req-c5317d9b-7a1a-4e4e-a27a-d60a3ee9af2e service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-vif-unplugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d9fa0b-4443-4df4-b4f9-ebe50c1f2979]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad948af1-a03e-4f95-8b98-d74436ae5f09]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhwRojrn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhwRojrn" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaeb89b-498a-40d5-86c7-df1a38c5a7ce]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KhwRojrn'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[757e82ea-ff19-478e-9266-399083c72024]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d34cb4-a67d-420d-9f2f-d6dc8847b75e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1396ec84-34cc-4ef8-8e07-2062074c881f (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:35:18 user nova-compute[74692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:18 user nova-compute[74692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1396ec84-34cc-4ef8-8e07-2062074c881f (non-flash)
Nov 18 18:35:18 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:35:18 user nova-compute[74692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:18 user nova-compute[74692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1396ec84-34cc-4ef8-8e07-2062074c881f (non-flash)
Nov 18 18:35:18 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8358616b-92dd-4333-9e1d-bb54cd0a8deb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3, portal: 172.16.0.220,3260]
Nov 18 18:35:18 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3, portal: 172.16.0.220,3260] successful.
Nov 18 18:35:18 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[27803af0-f86c-47f4-9545-fdc304479fae]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[168fa4e0-cdc1-47f5-8c62-39433eab78b7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1396ec84-34cc-4ef8-8e07-2062074c881f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:35:19 user nova-compute[74692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:19 user nova-compute[74692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1396ec84-34cc-4ef8-8e07-2062074c881f (non-flash)
Nov 18 18:35:19 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:35:19 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:35:19 user nova-compute[74692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:19 user nova-compute[74692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1396ec84-34cc-4ef8-8e07-2062074c881f (non-flash)
Nov 18 18:35:19 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:35:19 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.032s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dd6551-8a34-4ee6-95a7-5e6844ebb4ed]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhwRojrn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:35:19 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7960f76b-9176-4d98-8045-03678457add7] Instance destroyed successfully.
Nov 18 18:35:19 user nova-compute[74692]: DEBUG nova.objects.instance [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lazy-loading 'resources' on Instance uuid 7960f76b-9176-4d98-8045-03678457add7 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T18:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2059968008',display_name='tempest-TestShelveInstance-server-2059968008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2059968008',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqvDFaau/67R12i2PVg3zAmOTHhomyvhTqHRvkp08NpDDwRA6rjvsD7HSARckE1h3VtjUuYwEBUoGDT9lZLitru1a2otYt+5V6h8m0rpnvHGvpStzG11FTI2Dj8WqOnDw==',key_name='tempest-TestShelveInstance-1852882518',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:33:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5425715d2457463b8464c69b99c63831',ramdisk_id='',reservation_id='r-3gclmodf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-213519045',owner_user_name='tempest-TestShelveInstance-213519045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:33:41Z,user_data=None,user_id='dce10cede81746b2bead51383a21b0a3',uuid=7960f76b-9176-4d98-8045-03678457add7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Converting VIF {"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=bdd4ef83-835c-42c0-a7e0-0432ab03618f,network=Network(cb98a4f1-8a2e-4b02-923f-810f47f4dccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd4ef83-83') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG os_vif [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=bdd4ef83-835c-42c0-a7e0-0432ab03618f,network=Network(cb98a4f1-8a2e-4b02-923f-810f47f4dccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd4ef83-83') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdd4ef83-83, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5bd8d86-21c7-48fa-8d85-70db1ef2a42b) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:19 user nova-compute[74692]: INFO os_vif [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=bdd4ef83-835c-42c0-a7e0-0432ab03618f,network=Network(cb98a4f1-8a2e-4b02-923f-810f47f4dccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd4ef83-83')
Nov 18 18:35:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORgqFxrZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:35:19 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:35:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG nova.network.neutron [req-7dd0ef1f-7eda-4fa9-a004-b40f826a612f req-6a5c19d0-44ee-4f68-a515-c09abb365f1c service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updated VIF entry in instance network info cache for port bdd4ef83-835c-42c0-a7e0-0432ab03618f. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG nova.network.neutron [req-7dd0ef1f-7eda-4fa9-a004-b40f826a612f req-6a5c19d0-44ee-4f68-a515-c09abb365f1c service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updating instance_info_cache with network_info: [{"id": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "address": "fa:16:3e:0c:58:cc", "network": {"id": "cb98a4f1-8a2e-4b02-923f-810f47f4dccc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1061436398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5425715d2457463b8464c69b99c63831", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd4ef83-83", "ovs_interfaceid": "bdd4ef83-835c-42c0-a7e0-0432ab03618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7dd0ef1f-7eda-4fa9-a004-b40f826a612f req-6a5c19d0-44ee-4f68-a515-c09abb365f1c service nova] Releasing lock "refresh_cache-7960f76b-9176-4d98-8045-03678457add7" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Updating instance_info_cache with network_info: [{"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:35:19 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-f834c653-9d9a-40b3-a401-f9814c80872e req-0d046d55-dd6a-4a8b-be17-a66e2428407f service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Received event network-changed-42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-f834c653-9d9a-40b3-a401-f9814c80872e req-0d046d55-dd6a-4a8b-be17-a66e2428407f service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Refreshing instance network info cache due to event network-changed-42c3c7e8-f568-4a60-9613-152317e0543a. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f834c653-9d9a-40b3-a401-f9814c80872e req-0d046d55-dd6a-4a8b-be17-a66e2428407f service nova] Acquiring lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f834c653-9d9a-40b3-a401-f9814c80872e req-0d046d55-dd6a-4a8b-be17-a66e2428407f service nova] Acquired lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-f834c653-9d9a-40b3-a401-f9814c80872e req-0d046d55-dd6a-4a8b-be17-a66e2428407f service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Refreshing network info cache for port 42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26337393734643361', 'path': '/dev/sde'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337393734643361', 'path': '/dev/sde'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.917s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.objects.instance [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lazy-loading 'flavor' on Instance uuid 153d4723-7ede-41b3-9f64-a0487f617ed2 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e890ad92-29ae-4bc2-b37b-991754bf95d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1396ec84-34cc-4ef8-8e07-2062074c881f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:35:20 user nova-compute[74692]: No targets found.
Nov 18 18:35:20 user nova-compute[74692]: iSNS:
Nov 18 18:35:20 user nova-compute[74692]: No targets found.
Nov 18 18:35:20 user nova-compute[74692]: STATIC:
Nov 18 18:35:20 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6
Nov 18 18:35:20 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:35:20 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:35:20 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:1396ec84-34cc-4ef8-8e07-2062074c881f
Nov 18 18:35:20 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:35:20 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:35:20 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3
Nov 18 18:35:20 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:35:20 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:35:20 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c
Nov 18 18:35:20 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:35:20 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:35:20 user nova-compute[74692]: FIRMWARE:
Nov 18 18:35:20 user nova-compute[74692]: No targets found.
Nov 18 18:35:20 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:35:20 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:35:20 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:35:20 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:35:20 user nova-compute[74692]:   <source dev="/dev/sde"/>
Nov 18 18:35:20 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:35:20 user nova-compute[74692]:   <serial>38159c1d-b012-4fd2-8ce5-96216e7822e3</serial>
Nov 18 18:35:20 user nova-compute[74692]: </disk>
Nov 18 18:35:20 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2554fc-a50b-43ca-babb-76d41d499965]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1396ec84-34cc-4ef8-8e07-2062074c881f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1876db27-7e8a-4233-b15b-55f007c831a4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1396ec84-34cc-4ef8-8e07-2062074c881f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:35:20 user nova-compute[74692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:20 user nova-compute[74692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1396ec84-34cc-4ef8-8e07-2062074c881f (non-flash)
Nov 18 18:35:20 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:35:20 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 (non-flash)
Nov 18 18:35:20 user nova-compute[74692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:20 user nova-compute[74692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1396ec84-34cc-4ef8-8e07-2062074c881f (non-flash)
Nov 18 18:35:20 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:35:20 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a47845e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65a2f74-c942-476f-b734-3acef4ea67af]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f056cc2-8612-436f-91f3-d7536760aa74]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[003202fd-32a5-40dd-ab8f-5845198fc931]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcdeae4-87e4-405b-a58a-acb20c4a40a8]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e31053-779f-4e45-a0f2-0b05f7242952]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[470fb882-320e-4d04-ab90-a8a019bbb4e2]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260]
Nov 18 18:35:20 user nova-compute[74692]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6, portal: 172.16.0.220,3260] successful.
Nov 18 18:35:20 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeda74a-6f86-4797-8c30-fb05c69e7bd6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4011cf-550e-488e-8204-f35ae1db2d6a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] <== disconnect_volume: return (1232ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:35:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Deleting instance files /opt/stack/data/nova/instances/7960f76b-9176-4d98-8045-03678457add7_del
Nov 18 18:35:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Deletion of /opt/stack/data/nova/instances/7960f76b-9176-4d98-8045-03678457add7_del complete
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-f834c653-9d9a-40b3-a401-f9814c80872e req-0d046d55-dd6a-4a8b-be17-a66e2428407f service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Updated VIF entry in instance network info cache for port 42c3c7e8-f568-4a60-9613-152317e0543a. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-f834c653-9d9a-40b3-a401-f9814c80872e req-0d046d55-dd6a-4a8b-be17-a66e2428407f service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Updating instance_info_cache with network_info: [{"id": "42c3c7e8-f568-4a60-9613-152317e0543a", "address": "fa:16:3e:13:1b:f6", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42c3c7e8-f5", "ovs_interfaceid": "42c3c7e8-f568-4a60-9613-152317e0543a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f834c653-9d9a-40b3-a401-f9814c80872e req-0d046d55-dd6a-4a8b-be17-a66e2428407f service nova] Releasing lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:35:20 user nova-compute[74692]: INFO nova.compute.manager [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Took 2.57 seconds to destroy the instance on the hypervisor.
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 7960f76b-9176-4d98-8045-03678457add7] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 7960f76b-9176-4d98-8045-03678457add7] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] No VIF found with MAC fa:16:3e:fe:ea:27, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d345ca62-35f6-4eed-bc16-dcbf4b2a2961 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.748s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-f90b2877-ee6a-4d4a-a633-666f2a6daa07 req-4ac9ebc6-4905-4405-9fdf-70d6fb77246c service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f90b2877-ee6a-4d4a-a633-666f2a6daa07 req-4ac9ebc6-4905-4405-9fdf-70d6fb77246c service nova] Acquiring lock "7960f76b-9176-4d98-8045-03678457add7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f90b2877-ee6a-4d4a-a633-666f2a6daa07 req-4ac9ebc6-4905-4405-9fdf-70d6fb77246c service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f90b2877-ee6a-4d4a-a633-666f2a6daa07 req-4ac9ebc6-4905-4405-9fdf-70d6fb77246c service nova] Lock "7960f76b-9176-4d98-8045-03678457add7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-f90b2877-ee6a-4d4a-a633-666f2a6daa07 req-4ac9ebc6-4905-4405-9fdf-70d6fb77246c service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] No waiting events found dispatching network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:35:20 user nova-compute[74692]: WARNING nova.compute.manager [req-f90b2877-ee6a-4d4a-a633-666f2a6daa07 req-4ac9ebc6-4905-4405-9fdf-70d6fb77246c service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received unexpected event network-vif-plugged-bdd4ef83-835c-42c0-a7e0-0432ab03618f for instance with vm_state active and task_state deleting.
Nov 18 18:35:21 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 7960f76b-9176-4d98-8045-03678457add7] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:35:21 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 7960f76b-9176-4d98-8045-03678457add7] Took 0.52 seconds to deallocate network for instance.
Nov 18 18:35:21 user nova-compute[74692]: INFO nova.compute.manager [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Rescuing
Nov 18 18:35:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:35:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquired lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:35:21 user nova-compute[74692]: DEBUG nova.network.neutron [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:35:21 user nova-compute[74692]: INFO nova.compute.manager [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Took 0.85 seconds to detach 1 volumes for instance.
Nov 18 18:35:21 user nova-compute[74692]: DEBUG nova.compute.manager [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] [instance: 7960f76b-9176-4d98-8045-03678457add7] Deleting volume: 3eeda74a-6f86-4797-8c30-fb05c69e7bd6 {{(pid=74692) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 18:35:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:22 user nova-compute[74692]: DEBUG nova.compute.manager [req-547c91d1-cf8a-4859-adb1-85ba2d94cded req-6e59a31e-177f-4e94-a166-8597ec7ed99b service nova] [instance: 7960f76b-9176-4d98-8045-03678457add7] Received event network-vif-deleted-bdd4ef83-835c-42c0-a7e0-0432ab03618f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:22 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:35:22 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:35:22 user nova-compute[74692]: DEBUG nova.network.neutron [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Updating instance_info_cache with network_info: [{"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:35:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Releasing lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:35:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:22 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Deleted allocations for instance 7960f76b-9176-4d98-8045-03678457add7
Nov 18 18:35:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-85eed5ae-a063-43a9-9288-c3da4caf1fa5 tempest-TestShelveInstance-213519045 tempest-TestShelveInstance-213519045-project-member] Lock "7960f76b-9176-4d98-8045-03678457add7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.593s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:23 user nova-compute[74692]: DEBUG nova.compute.manager [req-1bfa2aa1-473c-474f-bde8-18d08b85bdbc req-0ec6133a-9c1a-46d2-9007-144e7b6d87cc service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Received event network-changed-48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:23 user nova-compute[74692]: DEBUG nova.compute.manager [req-1bfa2aa1-473c-474f-bde8-18d08b85bdbc req-0ec6133a-9c1a-46d2-9007-144e7b6d87cc service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Refreshing instance network info cache due to event network-changed-48b99854-18f7-4fb9-b31f-9e669aa9fa6a. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:35:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1bfa2aa1-473c-474f-bde8-18d08b85bdbc req-0ec6133a-9c1a-46d2-9007-144e7b6d87cc service nova] Acquiring lock "refresh_cache-873169f2-f1a7-4c16-8b8c-88767fea7fc9" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:35:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1bfa2aa1-473c-474f-bde8-18d08b85bdbc req-0ec6133a-9c1a-46d2-9007-144e7b6d87cc service nova] Acquired lock "refresh_cache-873169f2-f1a7-4c16-8b8c-88767fea7fc9" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:35:23 user nova-compute[74692]: DEBUG nova.network.neutron [req-1bfa2aa1-473c-474f-bde8-18d08b85bdbc req-0ec6133a-9c1a-46d2-9007-144e7b6d87cc service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Refreshing network info cache for port 48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:35:23 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Instance destroyed successfully.
Nov 18 18:35:23 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Attempting a stable device rescue
Nov 18 18:35:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74692) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 18:35:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Instance directory exists: not creating {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 18:35:23 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Creating image(s)
Nov 18 18:35:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "/opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "/opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "/opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:23 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lazy-loading 'trusted_certs' on Instance uuid 153d4723-7ede-41b3-9f64-a0487f617ed2 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "ba681db75743ae797f0930b18b144c2b4a369d64" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "ba681db75743ae797f0930b18b144c2b4a369d64" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba681db75743ae797f0930b18b144c2b4a369d64.part --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-09cc006d-6eb9-4975-a86c-c9e8cd0d26a0 req-1d69f15f-8e79-4af3-b27e-5998eca60e33 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-unplugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-09cc006d-6eb9-4975-a86c-c9e8cd0d26a0 req-1d69f15f-8e79-4af3-b27e-5998eca60e33 service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-09cc006d-6eb9-4975-a86c-c9e8cd0d26a0 req-1d69f15f-8e79-4af3-b27e-5998eca60e33 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-09cc006d-6eb9-4975-a86c-c9e8cd0d26a0 req-1d69f15f-8e79-4af3-b27e-5998eca60e33 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-09cc006d-6eb9-4975-a86c-c9e8cd0d26a0 req-1d69f15f-8e79-4af3-b27e-5998eca60e33 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-unplugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:35:24 user nova-compute[74692]: WARNING nova.compute.manager [req-09cc006d-6eb9-4975-a86c-c9e8cd0d26a0 req-1d69f15f-8e79-4af3-b27e-5998eca60e33 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received unexpected event network-vif-unplugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with vm_state active and task_state rescuing.
Nov 18 18:35:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-09cc006d-6eb9-4975-a86c-c9e8cd0d26a0 req-1d69f15f-8e79-4af3-b27e-5998eca60e33 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-09cc006d-6eb9-4975-a86c-c9e8cd0d26a0 req-1d69f15f-8e79-4af3-b27e-5998eca60e33 service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-09cc006d-6eb9-4975-a86c-c9e8cd0d26a0 req-1d69f15f-8e79-4af3-b27e-5998eca60e33 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-09cc006d-6eb9-4975-a86c-c9e8cd0d26a0 req-1d69f15f-8e79-4af3-b27e-5998eca60e33 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-09cc006d-6eb9-4975-a86c-c9e8cd0d26a0 req-1d69f15f-8e79-4af3-b27e-5998eca60e33 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:35:24 user nova-compute[74692]: WARNING nova.compute.manager [req-09cc006d-6eb9-4975-a86c-c9e8cd0d26a0 req-1d69f15f-8e79-4af3-b27e-5998eca60e33 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received unexpected event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with vm_state active and task_state rescuing.
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lazy-loading 'flavor' on Instance uuid 873169f2-f1a7-4c16-8b8c-88767fea7fc9 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG nova.network.neutron [req-1bfa2aa1-473c-474f-bde8-18d08b85bdbc req-0ec6133a-9c1a-46d2-9007-144e7b6d87cc service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Updated VIF entry in instance network info cache for port 48b99854-18f7-4fb9-b31f-9e669aa9fa6a. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG nova.network.neutron [req-1bfa2aa1-473c-474f-bde8-18d08b85bdbc req-0ec6133a-9c1a-46d2-9007-144e7b6d87cc service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Updating instance_info_cache with network_info: [{"id": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "address": "fa:16:3e:ae:20:b0", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b99854-18", "ovs_interfaceid": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1bfa2aa1-473c-474f-bde8-18d08b85bdbc req-0ec6133a-9c1a-46d2-9007-144e7b6d87cc service nova] Releasing lock "refresh_cache-873169f2-f1a7-4c16-8b8c-88767fea7fc9" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba681db75743ae797f0930b18b144c2b4a369d64.part --force-share --output=json" returned: 0 in 0.191s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG nova.virt.images [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] 87a4ddb6-9309-4dad-a4b2-53faa41e517a was qcow2, converting to raw {{(pid=74692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba681db75743ae797f0930b18b144c2b4a369d64.part /opt/stack/data/nova/instances/_base/ba681db75743ae797f0930b18b144c2b4a369d64.converted {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.005s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:24 user nova-compute[74692]: INFO nova.compute.manager [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Attaching volume fb361c73-60b8-4f9f-8073-7af2d46b6f7f to /dev/vdb
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba681db75743ae797f0930b18b144c2b4a369d64.part /opt/stack/data/nova/instances/_base/ba681db75743ae797f0930b18b144c2b4a369d64.converted" returned: 0 in 0.254s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba681db75743ae797f0930b18b144c2b4a369d64.converted --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG os_brick.utils [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f181e2-4509-40dc-9d89-5beafeb5e4a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4c00d5-8eed-4cdc-afbe-87a9daa46128]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a055f4a-63bc-4ab0-b92d-e74e90b92b6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfef2db2-3d28-42c2-8492-c1c76b6096d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:35:25 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1ba792-c8d0-44dd-a36f-f8549af31ed1]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.utils [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Updating existing volume attachment record: cb7caf67-dd69-4e50-b25e-5de8b3e70947 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba681db75743ae797f0930b18b144c2b4a369d64.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "ba681db75743ae797f0930b18b144c2b4a369d64" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.628s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "ba681db75743ae797f0930b18b144c2b4a369d64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "ba681db75743ae797f0930b18b144c2b4a369d64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba681db75743ae797f0930b18b144c2b4a369d64 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba681db75743ae797f0930b18b144c2b4a369d64 --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba681db75743ae797f0930b18b144c2b4a369d64,backing_fmt=raw /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.rescue {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba681db75743ae797f0930b18b144c2b4a369d64,backing_fmt=raw /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.rescue" returned: 0 in 0.050s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "ba681db75743ae797f0930b18b144c2b4a369d64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lazy-loading 'migration_context' on Instance uuid 153d4723-7ede-41b3-9f64-a0487f617ed2 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.objects.base [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Object Instance<153d4723-7ede-41b3-9f64-a0487f617ed2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Start _get_guest_xml network_info=[{"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "vif_mac": "fa:16:3e:fe:ea:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '87a4ddb6-9309-4dad-a4b2-53faa41e517a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhwRojrn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '153d4723-7ede-41b3-9f64-a0487f617ed2', 'attached_at': '', 'detached_at': '', 'volume_id': '38159c1d-b012-4fd2-8ce5-96216e7822e3', 'serial': '38159c1d-b012-4fd2-8ce5-96216e7822e3'}, 'attachment_id': '7ed7d99d-daf9-4b58-9c32-75c71b2e8549', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lazy-loading 'resources' on Instance uuid 153d4723-7ede-41b3-9f64-a0487f617ed2 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.objects.base [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Object Instance<153d4723-7ede-41b3-9f64-a0487f617ed2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lazy-loading 'numa_topology' on Instance uuid 153d4723-7ede-41b3-9f64-a0487f617ed2 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.objects.base [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Object Instance<153d4723-7ede-41b3-9f64-a0487f617ed2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:35:25 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:35:25 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lazy-loading 'vcpu_model' on Instance uuid 153d4723-7ede-41b3-9f64-a0487f617ed2 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.objects.base [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Object Instance<153d4723-7ede-41b3-9f64-a0487f617ed2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhwRojrn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:35:25 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:35:25 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:35:25 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faace47-1f12-4150-a5be-547ff2ad1c6c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KhwRojrn\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 18 18:35:25 user nova-compute[74692]: node.name = iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3
Nov 18 18:35:25 user nova-compute[74692]: node.tpgt = -1
Nov 18 18:35:25 user nova-compute[74692]: node.startup = automatic
Nov 18 18:35:25 user nova-compute[74692]: node.leading_login = No
Nov 18 18:35:25 user nova-compute[74692]: iface.iscsi_ifacename = default
Nov 18 18:35:25 user nova-compute[74692]: iface.net_ifacename = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.ipaddress = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.prefix_len = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.hwaddress = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.transport_name = tcp
Nov 18 18:35:25 user nova-compute[74692]: iface.initiatorname = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.state = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.vlan_id = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.vlan_priority = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.vlan_state = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.iface_num = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.mtu = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.port = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.bootproto = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.subnet_mask = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.gateway = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.dhcp_alt_client_id_state = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.dhcp_alt_client_id = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.dhcp_dns = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.dhcp_learn_iqn = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.dhcp_req_vendor_id_state = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.dhcp_vendor_id_state = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.dhcp_vendor_id = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.dhcp_slp_da = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.fragmentation = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.gratuitous_arp = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.incoming_forwarding = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.tos_state = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.tos = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.ttl = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.delayed_ack = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.tcp_nagle = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.tcp_wsf_state = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.tcp_wsf = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.tcp_timer_scale = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.tcp_timestamp = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.redirect = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.def_task_mgmt_timeout = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.header_digest = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.data_digest = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.immediate_data = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.initial_r2t = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.data_seq_inorder = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.data_pdu_inorder = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.erl = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.max_receive_data_len = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.first_burst_len = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.max_outstanding_r2t = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.max_burst_len = 0
Nov 18 18:35:25 user nova-compute[74692]: iface.chap_auth = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.bidi_chap = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.strict_login_compliance = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.discovery_auth = <empty>
Nov 18 18:35:25 user nova-compute[74692]: iface.discovery_logout = <empty>
Nov 18 18:35:25 user nova-compute[74692]: node.discovery_address = <empty>
Nov 18 18:35:25 user nova-compute[74692]: node.discovery_port = 0
Nov 18 18:35:25 user nova-compute[74692]: node.discovery_type = static
Nov 18 18:35:25 user nova-compute[74692]: node.session.initial_cmdsn = 0
Nov 18 18:35:25 user nova-compute[74692]: node.session.initial_login_retry_max = 8
Nov 18 18:35:25 user nova-compute[74692]: node.session.xmit_thread_priority = -20
Nov 18 18:35:25 user nova-compute[74692]: node.session.cmds_max = 128
Nov 18 18:35:25 user nova-compute[74692]: node.session.queue_depth = 32
Nov 18 18:35:25 user nova-compute[74692]: node.session.nr_sessions = 1
Nov 18 18:35:25 user nova-compute[74692]: node.session.auth.authmethod = CHAP
Nov 18 18:35:25 user nova-compute[74692]: node.session.auth.username = KhwRojrn
Nov 18 18:35:25 user nova-compute[74692]: node.session.auth.password = ***
Nov 18 18:35:25 user nova-compute[74692]: node.session.auth.username_in = <empty>
Nov 18 18:35:25 user nova-compute[74692]: node.session.auth.password_in = <empty>
Nov 18 18:35:25 user nova-compute[74692]: node.session.auth.chap_algs = MD5
Nov 18 18:35:25 user nova-compute[74692]: node.session.timeo.replacement_timeout = 120
Nov 18 18:35:25 user nova-compute[74692]: node.session.err_timeo.abort_timeout = 15
Nov 18 18:35:25 user nova-compute[74692]: node.session.err_timeo.lu_reset_timeout = 30
Nov 18 18:35:25 user nova-compute[74692]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 18 18:35:25 user nova-compute[74692]: node.session.err_timeo.host_reset_timeout = 60
Nov 18 18:35:25 user nova-compute[74692]: node.session.iscsi.FastAbort = Yes
Nov 18 18:35:25 user nova-compute[74692]: node.session.iscsi.InitialR2T = No
Nov 18 18:35:25 user nova-compute[74692]: node.session.iscsi.ImmediateData = Yes
Nov 18 18:35:25 user nova-compute[74692]: node.session.iscsi.FirstBurstLength = 262144
Nov 18 18:35:25 user nova-compute[74692]: node.session.iscsi.MaxBurstLength = 16776192
Nov 18 18:35:25 user nova-compute[74692]: node.session.iscsi.DefaultTime2Retain = 0
Nov 18 18:35:25 user nova-compute[74692]: node.session.iscsi.DefaultTime2Wait = 2
Nov 18 18:35:25 user nova-compute[74692]: node.session.iscsi.MaxConnections = 1
Nov 18 18:35:25 user nova-compute[74692]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 18 18:35:25 user nova-compute[74692]: node.session.iscsi.ERL = 0
Nov 18 18:35:25 user nova-compute[74692]: node.session.scan = manual
Nov 18 18:35:25 user nova-compute[74692]: node.session.reopen_max = 0
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].address = 172.16.0.220
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].port = 3260
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].startup = manual
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].tcp.window_size = 524288
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].tcp.type_of_service = 0
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].timeo.logout_timeout = 15
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].timeo.login_timeout = 15
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].timeo.auth_timeout = 45
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].timeo.noop_out_interval = 5
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].timeo.noop_out_timeout = 5
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].iscsi.HeaderDigest = None
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].iscsi.DataDigest = None
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].iscsi.IFMarker = No
Nov 18 18:35:25 user nova-compute[74692]: node.conn[0].iscsi.OFMarker = No
Nov 18 18:35:25 user nova-compute[74692]: # END RECORD
Nov 18 18:35:25 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda4c07b-c9ab-4b4f-8fc3-c7d75d5383b4]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[033b0d08-32c9-4e5c-a028-06171b0befab]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhwRojrn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhwRojrn" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c4653a-fc86-4871-a4e9-e709751392cb]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KhwRojrn'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddb095d-bd3d-4e5b-8dfa-b89dc9f6fe8f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05618ad-d389-4ebf-9337-a3ede5593383]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:25 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:35:25 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:25 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:35:25 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.140s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] HCTL ('36', '0', '0', 0) found on session 25 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ede81f-6c3b-4cb5-a410-91bad7632e2c]: (4, ('0 0 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Searching for a device in session 25 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhwRojrn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.165s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] <== connect_volume: return (166ms) {'type': 'block', 'scsi_wwn': '26337393734643361', 'path': '/dev/sde'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337393734643361', 'path': '/dev/sde'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1812438622',display_name='tempest-ServerStableDeviceRescueTest-server-1812438622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1812438622',id=12,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXCGEJULwKPqzrmPp7Bsfx2IXbS6p9gZQ9/X6kg1yFYuvYoFt8pfMiAIEibdhQ14zBwHFYVMkEm/mgvVZz9WHejA2ywEe2B9BeRswQ0UHrDkkvMcoV8X7zJEUd0zFmwsg==',key_name='tempest-keypair-1872300764',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37858e7bb5cb41d082a4b0ee86658f08',ramdisk_id='',reservation_id='r-ivtc64el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1647655097',owner_user_name='tempest-ServerStableDeviceRescueTest-1647655097-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3279e5607e8462caa50f6cf4ff5d98e',uuid=153d4723-7ede-41b3-9f64-a0487f617ed2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "vif_mac": "fa:16:3e:fe:ea:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Converting VIF {"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "vif_mac": "fa:16:3e:fe:ea:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ea:27,bridge_name='br-int',has_traffic_filtering=True,id=b1bcdb35-95f4-4010-b94b-75cfb5ec082e,network=Network(52a674cd-fbb9-409f-9547-8c85726f9e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bcdb35-95') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lazy-loading 'pci_devices' on Instance uuid 153d4723-7ede-41b3-9f64-a0487f617ed2 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.objects.base [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Object Instance<153d4723-7ede-41b3-9f64-a0487f617ed2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:35:25 user nova-compute[74692]:   <uuid>153d4723-7ede-41b3-9f64-a0487f617ed2</uuid>
Nov 18 18:35:25 user nova-compute[74692]:   <name>instance-0000000c</name>
Nov 18 18:35:25 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:35:25 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:35:25 user nova-compute[74692]:   <metadata>
Nov 18 18:35:25 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:35:25 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:35:25 user nova-compute[74692]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1812438622</nova:name>
Nov 18 18:35:25 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:35:25</nova:creationTime>
Nov 18 18:35:25 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:35:25 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:35:25 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:35:25 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:35:25 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:35:25 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:35:25 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:35:25 user nova-compute[74692]:       <nova:owner>
Nov 18 18:35:25 user nova-compute[74692]:         <nova:user uuid="f3279e5607e8462caa50f6cf4ff5d98e">tempest-ServerStableDeviceRescueTest-1647655097-project-member</nova:user>
Nov 18 18:35:25 user nova-compute[74692]:         <nova:project uuid="37858e7bb5cb41d082a4b0ee86658f08">tempest-ServerStableDeviceRescueTest-1647655097</nova:project>
Nov 18 18:35:25 user nova-compute[74692]:       </nova:owner>
Nov 18 18:35:25 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:35:25 user nova-compute[74692]:       <nova:ports>
Nov 18 18:35:25 user nova-compute[74692]:         <nova:port uuid="b1bcdb35-95f4-4010-b94b-75cfb5ec082e">
Nov 18 18:35:25 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 18:35:25 user nova-compute[74692]:         </nova:port>
Nov 18 18:35:25 user nova-compute[74692]:       </nova:ports>
Nov 18 18:35:25 user nova-compute[74692]:     </nova:instance>
Nov 18 18:35:25 user nova-compute[74692]:   </metadata>
Nov 18 18:35:25 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:35:25 user nova-compute[74692]:     <system>
Nov 18 18:35:25 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:35:25 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:35:25 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:35:25 user nova-compute[74692]:       <entry name="serial">153d4723-7ede-41b3-9f64-a0487f617ed2</entry>
Nov 18 18:35:25 user nova-compute[74692]:       <entry name="uuid">153d4723-7ede-41b3-9f64-a0487f617ed2</entry>
Nov 18 18:35:25 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:35:25 user nova-compute[74692]:     </system>
Nov 18 18:35:25 user nova-compute[74692]:   </sysinfo>
Nov 18 18:35:25 user nova-compute[74692]:   <os>
Nov 18 18:35:25 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:35:25 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:35:25 user nova-compute[74692]:   </os>
Nov 18 18:35:25 user nova-compute[74692]:   <features>
Nov 18 18:35:25 user nova-compute[74692]:     <acpi/>
Nov 18 18:35:25 user nova-compute[74692]:     <apic/>
Nov 18 18:35:25 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:35:25 user nova-compute[74692]:   </features>
Nov 18 18:35:25 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:35:25 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:35:25 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:35:25 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:35:25 user nova-compute[74692]:   </clock>
Nov 18 18:35:25 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:35:25 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:35:25 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:35:25 user nova-compute[74692]:   </cpu>
Nov 18 18:35:25 user nova-compute[74692]:   <devices>
Nov 18 18:35:25 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:35:25 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:35:25 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk"/>
Nov 18 18:35:25 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:35:25 user nova-compute[74692]:     </disk>
Nov 18 18:35:25 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:35:25 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:35:25 user nova-compute[74692]:       <source dev="/dev/sde"/>
Nov 18 18:35:25 user nova-compute[74692]:       <target dev="vdb" bus="virtio"/>
Nov 18 18:35:25 user nova-compute[74692]:       <serial>38159c1d-b012-4fd2-8ce5-96216e7822e3</serial>
Nov 18 18:35:25 user nova-compute[74692]:     </disk>
Nov 18 18:35:25 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:35:25 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:35:25 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.rescue"/>
Nov 18 18:35:25 user nova-compute[74692]:       <target dev="vdc" bus="virtio"/>
Nov 18 18:35:25 user nova-compute[74692]:       <boot order="1"/>
Nov 18 18:35:25 user nova-compute[74692]:     </disk>
Nov 18 18:35:25 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:35:25 user nova-compute[74692]:       <mac address="fa:16:3e:fe:ea:27"/>
Nov 18 18:35:25 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:35:25 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:35:25 user nova-compute[74692]:       <target dev="tapb1bcdb35-95"/>
Nov 18 18:35:25 user nova-compute[74692]:     </interface>
Nov 18 18:35:25 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:35:25 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/console.log" append="off"/>
Nov 18 18:35:25 user nova-compute[74692]:     </serial>
Nov 18 18:35:25 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:35:25 user nova-compute[74692]:     <video>
Nov 18 18:35:25 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:35:25 user nova-compute[74692]:     </video>
Nov 18 18:35:25 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:35:25 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:35:25 user nova-compute[74692]:     </rng>
Nov 18 18:35:25 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:35:25 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:35:25 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:35:25 user nova-compute[74692]:     </memballoon>
Nov 18 18:35:25 user nova-compute[74692]:   </devices>
Nov 18 18:35:25 user nova-compute[74692]: </domain>
Nov 18 18:35:25 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:35:25 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Instance destroyed successfully.
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:35:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] No VIF found with MAC fa:16:3e:fe:ea:27, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:35:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-a3c6307c-ba81-4b0e-86ad-f24475d99dfc req-ef1a301d-e9b9-4e6d-848b-dfb7f27c9ec8 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a3c6307c-ba81-4b0e-86ad-f24475d99dfc req-ef1a301d-e9b9-4e6d-848b-dfb7f27c9ec8 service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a3c6307c-ba81-4b0e-86ad-f24475d99dfc req-ef1a301d-e9b9-4e6d-848b-dfb7f27c9ec8 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a3c6307c-ba81-4b0e-86ad-f24475d99dfc req-ef1a301d-e9b9-4e6d-848b-dfb7f27c9ec8 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-a3c6307c-ba81-4b0e-86ad-f24475d99dfc req-ef1a301d-e9b9-4e6d-848b-dfb7f27c9ec8 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:35:27 user nova-compute[74692]: WARNING nova.compute.manager [req-a3c6307c-ba81-4b0e-86ad-f24475d99dfc req-ef1a301d-e9b9-4e6d-848b-dfb7f27c9ec8 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received unexpected event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with vm_state active and task_state rescuing.
Nov 18 18:35:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-d0404e5b-14a8-4d02-bd95-84c620ebc7fc req-11c068af-5feb-4331-85ea-3c1968314c28 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d0404e5b-14a8-4d02-bd95-84c620ebc7fc req-11c068af-5feb-4331-85ea-3c1968314c28 service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d0404e5b-14a8-4d02-bd95-84c620ebc7fc req-11c068af-5feb-4331-85ea-3c1968314c28 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d0404e5b-14a8-4d02-bd95-84c620ebc7fc req-11c068af-5feb-4331-85ea-3c1968314c28 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-d0404e5b-14a8-4d02-bd95-84c620ebc7fc req-11c068af-5feb-4331-85ea-3c1968314c28 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:35:29 user nova-compute[74692]: WARNING nova.compute.manager [req-d0404e5b-14a8-4d02-bd95-84c620ebc7fc req-11c068af-5feb-4331-85ea-3c1968314c28 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received unexpected event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with vm_state active and task_state rescuing.
Nov 18 18:35:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:29 user nova-compute[74692]: DEBUG nova.compute.manager [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:35:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:35:29 user nova-compute[74692]: INFO nova.compute.claims [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Claim successful on node user
Nov 18 18:35:29 user nova-compute[74692]: DEBUG nova.compute.manager [None req-8413abc5-c77c-4bd1-b97f-f12e211a5a2e tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG nova.compute.manager [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG nova.compute.manager [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG nova.network.neutron [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:35:30 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:35:30 user nova-compute[74692]: DEBUG nova.compute.manager [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG nova.policy [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a97cd00e39c84616a0d114827b66687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1029d1e2110746d3af205df825090efa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG nova.compute.manager [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:35:30 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Creating image(s)
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "/opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "/opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "/opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.200s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XChYqfuL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:35:30 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:35:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:35:30 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:35:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:35:30 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.209s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dfa544-14c2-4d8e-b5a0-93de6aaea9fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:35:30 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk 1073741824" returned: 0 in 0.052s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9d0534-d58c-4253-89c0-ad23abb44d51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f] added
Nov 18 18:35:30 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0d44ff-de86-4120-af44-f940c94b0634]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a23c556-bce9-40a2-a13d-78139af6afb3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XChYqfuL {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG nova.network.neutron [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Successfully created port: 4e492ce0-54ec-436d-9a85-3a15428538bb {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XChYqfuL" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff69887-628f-463c-ae6d-6e9589565229]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XChYqfuL'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[911431c5-5938-40ad-aa69-ae59378af51a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c619ca31-b838-43cc-ab27-66f169321902]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:31 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:35:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:31 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:35:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.192s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b135eaa1-b0ee-4b90-923c-07fa4112149e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f, portal: 172.16.0.220,3260]
Nov 18 18:35:31 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f, portal: 172.16.0.220,3260] successful.
Nov 18 18:35:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[17183615-d8b7-490d-a489-8e2bde8e86cf]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3445b8c5-4512-46a1-861a-49aa659da431]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:31 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:35:31 user nova-compute[74692]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f (non-flash)
Nov 18 18:35:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:31 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:35:31 user nova-compute[74692]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f (non-flash)
Nov 18 18:35:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c724fe06-f090-4138-b6fb-10f100aa1416]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XChYqfuL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Cannot resize image /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Ensure instance console log exists: /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG nova.network.neutron [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Successfully updated port: 4e492ce0-54ec-436d-9a85-3a15428538bb {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "refresh_cache-c80bfaf1-4f8f-4131-8591-d4c70a62a6ec" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquired lock "refresh_cache-c80bfaf1-4f8f-4131-8591-d4c70a62a6ec" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG nova.network.neutron [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-1c140eba-400a-4603-9287-0c5efe5e1d2f req-143e10e6-4b00-4868-a352-4174d1ff0b41 service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Received event network-changed-4e492ce0-54ec-436d-9a85-3a15428538bb {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-1c140eba-400a-4603-9287-0c5efe5e1d2f req-143e10e6-4b00-4868-a352-4174d1ff0b41 service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Refreshing instance network info cache due to event network-changed-4e492ce0-54ec-436d-9a85-3a15428538bb. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1c140eba-400a-4603-9287-0c5efe5e1d2f req-143e10e6-4b00-4868-a352-4174d1ff0b41 service nova] Acquiring lock "refresh_cache-c80bfaf1-4f8f-4131-8591-d4c70a62a6ec" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:35:31 user nova-compute[74692]: DEBUG nova.network.neutron [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.network.neutron [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Updating instance_info_cache with network_info: [{"id": "4e492ce0-54ec-436d-9a85-3a15428538bb", "address": "fa:16:3e:2f:4f:77", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e492ce0-54", "ovs_interfaceid": "4e492ce0-54ec-436d-9a85-3a15428538bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Releasing lock "refresh_cache-c80bfaf1-4f8f-4131-8591-d4c70a62a6ec" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.compute.manager [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Instance network_info: |[{"id": "4e492ce0-54ec-436d-9a85-3a15428538bb", "address": "fa:16:3e:2f:4f:77", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e492ce0-54", "ovs_interfaceid": "4e492ce0-54ec-436d-9a85-3a15428538bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1c140eba-400a-4603-9287-0c5efe5e1d2f req-143e10e6-4b00-4868-a352-4174d1ff0b41 service nova] Acquired lock "refresh_cache-c80bfaf1-4f8f-4131-8591-d4c70a62a6ec" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.network.neutron [req-1c140eba-400a-4603-9287-0c5efe5e1d2f req-143e10e6-4b00-4868-a352-4174d1ff0b41 service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Refreshing network info cache for port 4e492ce0-54ec-436d-9a85-3a15428538bb {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Start _get_guest_xml network_info=[{"id": "4e492ce0-54ec-436d-9a85-3a15428538bb", "address": "fa:16:3e:2f:4f:77", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e492ce0-54", "ovs_interfaceid": "4e492ce0-54ec-436d-9a85-3a15428538bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:35:32 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:35:32 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:35:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1976852103',display_name='tempest-VolumesAdminNegativeTest-server-1976852103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1976852103',id=21,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1029d1e2110746d3af205df825090efa',ramdisk_id='',reservation_id='r-mnioclef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1838367509',owner_user_name='tempest-VolumesAdminNegativeTest-1838367509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:35:30Z,user_data=None,user_id='a97cd00e39c84616a0d114827b66687a',uuid=c80bfaf1-4f8f-4131-8591-d4c70a62a6ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e492ce0-54ec-436d-9a85-3a15428538bb", "address": "fa:16:3e:2f:4f:77", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e492ce0-54", "ovs_interfaceid": "4e492ce0-54ec-436d-9a85-3a15428538bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Converting VIF {"id": "4e492ce0-54ec-436d-9a85-3a15428538bb", "address": "fa:16:3e:2f:4f:77", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e492ce0-54", "ovs_interfaceid": "4e492ce0-54ec-436d-9a85-3a15428538bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4f:77,bridge_name='br-int',has_traffic_filtering=True,id=4e492ce0-54ec-436d-9a85-3a15428538bb,network=Network(8f7fd586-cc31-4828-bd1b-b9c67e164813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e492ce0-54') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.objects.instance [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lazy-loading 'pci_devices' on Instance uuid c80bfaf1-4f8f-4131-8591-d4c70a62a6ec {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:35:32 user nova-compute[74692]:   <uuid>c80bfaf1-4f8f-4131-8591-d4c70a62a6ec</uuid>
Nov 18 18:35:32 user nova-compute[74692]:   <name>instance-00000015</name>
Nov 18 18:35:32 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:35:32 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:35:32 user nova-compute[74692]:   <metadata>
Nov 18 18:35:32 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:35:32 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:35:32 user nova-compute[74692]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1976852103</nova:name>
Nov 18 18:35:32 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:35:32</nova:creationTime>
Nov 18 18:35:32 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:35:32 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:35:32 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:35:32 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:35:32 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:35:32 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:35:32 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:35:32 user nova-compute[74692]:       <nova:owner>
Nov 18 18:35:32 user nova-compute[74692]:         <nova:user uuid="a97cd00e39c84616a0d114827b66687a">tempest-VolumesAdminNegativeTest-1838367509-project-member</nova:user>
Nov 18 18:35:32 user nova-compute[74692]:         <nova:project uuid="1029d1e2110746d3af205df825090efa">tempest-VolumesAdminNegativeTest-1838367509</nova:project>
Nov 18 18:35:32 user nova-compute[74692]:       </nova:owner>
Nov 18 18:35:32 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:35:32 user nova-compute[74692]:       <nova:ports>
Nov 18 18:35:32 user nova-compute[74692]:         <nova:port uuid="4e492ce0-54ec-436d-9a85-3a15428538bb">
Nov 18 18:35:32 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 18:35:32 user nova-compute[74692]:         </nova:port>
Nov 18 18:35:32 user nova-compute[74692]:       </nova:ports>
Nov 18 18:35:32 user nova-compute[74692]:     </nova:instance>
Nov 18 18:35:32 user nova-compute[74692]:   </metadata>
Nov 18 18:35:32 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:35:32 user nova-compute[74692]:     <system>
Nov 18 18:35:32 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:35:32 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:35:32 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:35:32 user nova-compute[74692]:       <entry name="serial">c80bfaf1-4f8f-4131-8591-d4c70a62a6ec</entry>
Nov 18 18:35:32 user nova-compute[74692]:       <entry name="uuid">c80bfaf1-4f8f-4131-8591-d4c70a62a6ec</entry>
Nov 18 18:35:32 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:35:32 user nova-compute[74692]:     </system>
Nov 18 18:35:32 user nova-compute[74692]:   </sysinfo>
Nov 18 18:35:32 user nova-compute[74692]:   <os>
Nov 18 18:35:32 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:35:32 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:35:32 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:35:32 user nova-compute[74692]:   </os>
Nov 18 18:35:32 user nova-compute[74692]:   <features>
Nov 18 18:35:32 user nova-compute[74692]:     <acpi/>
Nov 18 18:35:32 user nova-compute[74692]:     <apic/>
Nov 18 18:35:32 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:35:32 user nova-compute[74692]:   </features>
Nov 18 18:35:32 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:35:32 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:35:32 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:35:32 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:35:32 user nova-compute[74692]:   </clock>
Nov 18 18:35:32 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:35:32 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:35:32 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:35:32 user nova-compute[74692]:   </cpu>
Nov 18 18:35:32 user nova-compute[74692]:   <devices>
Nov 18 18:35:32 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:35:32 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:35:32 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk"/>
Nov 18 18:35:32 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:35:32 user nova-compute[74692]:     </disk>
Nov 18 18:35:32 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:35:32 user nova-compute[74692]:       <mac address="fa:16:3e:2f:4f:77"/>
Nov 18 18:35:32 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:35:32 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:35:32 user nova-compute[74692]:       <target dev="tap4e492ce0-54"/>
Nov 18 18:35:32 user nova-compute[74692]:     </interface>
Nov 18 18:35:32 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:35:32 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/console.log" append="off"/>
Nov 18 18:35:32 user nova-compute[74692]:     </serial>
Nov 18 18:35:32 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:35:32 user nova-compute[74692]:     <video>
Nov 18 18:35:32 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:35:32 user nova-compute[74692]:     </video>
Nov 18 18:35:32 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:35:32 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:35:32 user nova-compute[74692]:     </rng>
Nov 18 18:35:32 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:35:32 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:35:32 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:35:32 user nova-compute[74692]:     </memballoon>
Nov 18 18:35:32 user nova-compute[74692]:   </devices>
Nov 18 18:35:32 user nova-compute[74692]: </domain>
Nov 18 18:35:32 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:35:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1976852103',display_name='tempest-VolumesAdminNegativeTest-server-1976852103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1976852103',id=21,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1029d1e2110746d3af205df825090efa',ramdisk_id='',reservation_id='r-mnioclef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1838367509',owner_user_name='tempest-VolumesAdminNegativeTest-1838367509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:35:30Z,user_data=None,user_id='a97cd00e39c84616a0d114827b66687a',uuid=c80bfaf1-4f8f-4131-8591-d4c70a62a6ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e492ce0-54ec-436d-9a85-3a15428538bb", "address": "fa:16:3e:2f:4f:77", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e492ce0-54", "ovs_interfaceid": "4e492ce0-54ec-436d-9a85-3a15428538bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Converting VIF {"id": "4e492ce0-54ec-436d-9a85-3a15428538bb", "address": "fa:16:3e:2f:4f:77", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e492ce0-54", "ovs_interfaceid": "4e492ce0-54ec-436d-9a85-3a15428538bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4f:77,bridge_name='br-int',has_traffic_filtering=True,id=4e492ce0-54ec-436d-9a85-3a15428538bb,network=Network(8f7fd586-cc31-4828-bd1b-b9c67e164813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e492ce0-54') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG os_vif [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4f:77,bridge_name='br-int',has_traffic_filtering=True,id=4e492ce0-54ec-436d-9a85-3a15428538bb,network=Network(8f7fd586-cc31-4828-bd1b-b9c67e164813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e492ce0-54') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad6b89d7-e693-5193-8db0-6643032ae9e0', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26339313932613533', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339313932613533', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e492ce0-54, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e492ce0-54, col_values=(('qos', UUID('616c104f-91e4-48d9-b85d-7adb44926cb9')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e492ce0-54, col_values=(('external_ids', {'iface-id': '4e492ce0-54ec-436d-9a85-3a15428538bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:4f:77', 'vm-uuid': 'c80bfaf1-4f8f-4131-8591-d4c70a62a6ec'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lazy-loading 'flavor' on Instance uuid 873169f2-f1a7-4c16-8b8c-88767fea7fc9 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:32 user nova-compute[74692]: INFO os_vif [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4f:77,bridge_name='br-int',has_traffic_filtering=True,id=4e492ce0-54ec-436d-9a85-3a15428538bb,network=Network(8f7fd586-cc31-4828-bd1b-b9c67e164813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e492ce0-54')
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:35:32 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:35:32 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 18:35:32 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:35:32 user nova-compute[74692]:   <serial>fb361c73-60b8-4f9f-8073-7af2d46b6f7f</serial>
Nov 18 18:35:32 user nova-compute[74692]: </disk>
Nov 18 18:35:32 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] No VIF found with MAC fa:16:3e:2f:4f:77, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.network.neutron [req-1c140eba-400a-4603-9287-0c5efe5e1d2f req-143e10e6-4b00-4868-a352-4174d1ff0b41 service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Updated VIF entry in instance network info cache for port 4e492ce0-54ec-436d-9a85-3a15428538bb. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.network.neutron [req-1c140eba-400a-4603-9287-0c5efe5e1d2f req-143e10e6-4b00-4868-a352-4174d1ff0b41 service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Updating instance_info_cache with network_info: [{"id": "4e492ce0-54ec-436d-9a85-3a15428538bb", "address": "fa:16:3e:2f:4f:77", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e492ce0-54", "ovs_interfaceid": "4e492ce0-54ec-436d-9a85-3a15428538bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1c140eba-400a-4603-9287-0c5efe5e1d2f req-143e10e6-4b00-4868-a352-4174d1ff0b41 service nova] Releasing lock "refresh_cache-c80bfaf1-4f8f-4131-8591-d4c70a62a6ec" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] No VIF found with MAC fa:16:3e:ae:20:b0, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:35:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8e082a2c-8b1d-4617-8982-555fed6790a9 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.110s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-bce93499-1460-444e-bbfd-e7614c44c2ff req-c040d670-3eae-4172-b867-6adff236de55 service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Received event network-vif-plugged-4e492ce0-54ec-436d-9a85-3a15428538bb {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-bce93499-1460-444e-bbfd-e7614c44c2ff req-c040d670-3eae-4172-b867-6adff236de55 service nova] Acquiring lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-bce93499-1460-444e-bbfd-e7614c44c2ff req-c040d670-3eae-4172-b867-6adff236de55 service nova] Lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-bce93499-1460-444e-bbfd-e7614c44c2ff req-c040d670-3eae-4172-b867-6adff236de55 service nova] Lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-bce93499-1460-444e-bbfd-e7614c44c2ff req-c040d670-3eae-4172-b867-6adff236de55 service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] No waiting events found dispatching network-vif-plugged-4e492ce0-54ec-436d-9a85-3a15428538bb {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:35:34 user nova-compute[74692]: WARNING nova.compute.manager [req-bce93499-1460-444e-bbfd-e7614c44c2ff req-c040d670-3eae-4172-b867-6adff236de55 service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Received unexpected event network-vif-plugged-4e492ce0-54ec-436d-9a85-3a15428538bb for instance with vm_state building and task_state spawning.
Nov 18 18:35:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:35 user nova-compute[74692]: INFO nova.compute.manager [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Detaching volume fb361c73-60b8-4f9f-8073-7af2d46b6f7f
Nov 18 18:35:35 user nova-compute[74692]: INFO nova.virt.block_device [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Attempting to driver detach volume fb361c73-60b8-4f9f-8073-7af2d46b6f7f from mountpoint /dev/vdb
Nov 18 18:35:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Attempting to detach device vdb from instance 873169f2-f1a7-4c16-8b8c-88767fea7fc9 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:35:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:35:35 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:35:35 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 18:35:35 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:35:35 user nova-compute[74692]:   <serial>fb361c73-60b8-4f9f-8073-7af2d46b6f7f</serial>
Nov 18 18:35:35 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:35:35 user nova-compute[74692]: </disk>
Nov 18 18:35:35 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:35:35 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Successfully detached device vdb from instance 873169f2-f1a7-4c16-8b8c-88767fea7fc9 from the persistent domain config.
Nov 18 18:35:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 873169f2-f1a7-4c16-8b8c-88767fea7fc9 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:35:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:35:35 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:35:35 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 18:35:35 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:35:35 user nova-compute[74692]:   <serial>fb361c73-60b8-4f9f-8073-7af2d46b6f7f</serial>
Nov 18 18:35:35 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:35:35 user nova-compute[74692]: </disk>
Nov 18 18:35:35 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:35:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 873169f2-f1a7-4c16-8b8c-88767fea7fc9 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:35:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:35:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:35:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-08d336de-b539-40d6-88cb-9edbb2b9158b req-6c392ff2-f06f-46db-a6d0-d7feb9acf60a service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Received event network-vif-plugged-4e492ce0-54ec-436d-9a85-3a15428538bb {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-08d336de-b539-40d6-88cb-9edbb2b9158b req-6c392ff2-f06f-46db-a6d0-d7feb9acf60a service nova] Acquiring lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-08d336de-b539-40d6-88cb-9edbb2b9158b req-6c392ff2-f06f-46db-a6d0-d7feb9acf60a service nova] Lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-08d336de-b539-40d6-88cb-9edbb2b9158b req-6c392ff2-f06f-46db-a6d0-d7feb9acf60a service nova] Lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-08d336de-b539-40d6-88cb-9edbb2b9158b req-6c392ff2-f06f-46db-a6d0-d7feb9acf60a service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] No waiting events found dispatching network-vif-plugged-4e492ce0-54ec-436d-9a85-3a15428538bb {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:35:36 user nova-compute[74692]: WARNING nova.compute.manager [req-08d336de-b539-40d6-88cb-9edbb2b9158b req-6c392ff2-f06f-46db-a6d0-d7feb9acf60a service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Received unexpected event network-vif-plugged-4e492ce0-54ec-436d-9a85-3a15428538bb for instance with vm_state building and task_state spawning.
Nov 18 18:35:36 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Instance spawned successfully.
Nov 18 18:35:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:35:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:35:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:35:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:35:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:35:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:35:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:35:36 user nova-compute[74692]: INFO nova.compute.manager [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 18 18:35:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:35:36 user nova-compute[74692]: INFO nova.compute.manager [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Took 6.84 seconds to build instance.
Nov 18 18:35:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-299fe024-90af-447d-9a55-0c279e86b54c tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.937s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "f3140c56-acf5-4cde-bd8c-273563540451" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "f3140c56-acf5-4cde-bd8c-273563540451" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:44 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:35:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:44 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:35:44 user nova-compute[74692]: INFO nova.compute.claims [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Claim successful on node user
Nov 18 18:35:45 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG nova.network.neutron [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:35:45 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:35:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG nova.policy [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0a005c7c46c46ad9217578412ec906f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169f28da1640d9b03b4ba44b4e7b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:35:45 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Creating image(s)
Nov 18 18:35:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "/opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "/opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.188s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk 1073741824" returned: 0 in 0.047s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Successfully created port: 1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.197s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Cannot resize image /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Ensure instance console log exists: /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Successfully updated port: 1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquired lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-f35de580-100e-4348-a04f-de48f67e90a0 req-d4e327ef-3513-4135-8974-06e1fabd36e2 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received event network-changed-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-f35de580-100e-4348-a04f-de48f67e90a0 req-d4e327ef-3513-4135-8974-06e1fabd36e2 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Refreshing instance network info cache due to event network-changed-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f35de580-100e-4348-a04f-de48f67e90a0 req-d4e327ef-3513-4135-8974-06e1fabd36e2 service nova] Acquiring lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:35:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Updating instance_info_cache with network_info: [{"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Releasing lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Instance network_info: |[{"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f35de580-100e-4348-a04f-de48f67e90a0 req-d4e327ef-3513-4135-8974-06e1fabd36e2 service nova] Acquired lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-f35de580-100e-4348-a04f-de48f67e90a0 req-d4e327ef-3513-4135-8974-06e1fabd36e2 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Refreshing network info cache for port 1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Start _get_guest_xml network_info=[{"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:35:47 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:35:47 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:35:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-539204829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-539204829',id=22,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOthkNNTFNmgshDO1rX52xwX9XJ2lO5YQxpyk5EEQ45Um8FR6Asz93Cp5prjGn6ddTJuKrAt7f9xLeqnxRgRZvpIVIpYI1gtVx59eDLtxaX+ya8P9H3FJZI+qzQmvQeDHw==',key_name='tempest-keypair-151002570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f169f28da1640d9b03b4ba44b4e7b7c',ramdisk_id='',reservation_id='r-f44p51kz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1768400085',owner_user_name='tempest-AttachVolumeShelveTestJSON-1768400085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:35:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a005c7c46c46ad9217578412ec906f',uuid=f3140c56-acf5-4cde-bd8c-273563540451,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converting VIF {"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6b:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c5f8cc6-74') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.objects.instance [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'pci_devices' on Instance uuid f3140c56-acf5-4cde-bd8c-273563540451 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:35:47 user nova-compute[74692]:   <uuid>f3140c56-acf5-4cde-bd8c-273563540451</uuid>
Nov 18 18:35:47 user nova-compute[74692]:   <name>instance-00000016</name>
Nov 18 18:35:47 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:35:47 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:35:47 user nova-compute[74692]:   <metadata>
Nov 18 18:35:47 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:35:47 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:35:47 user nova-compute[74692]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-539204829</nova:name>
Nov 18 18:35:47 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:35:47</nova:creationTime>
Nov 18 18:35:47 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:35:47 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:35:47 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:35:47 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:35:47 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:35:47 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:35:47 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:35:47 user nova-compute[74692]:       <nova:owner>
Nov 18 18:35:47 user nova-compute[74692]:         <nova:user uuid="c0a005c7c46c46ad9217578412ec906f">tempest-AttachVolumeShelveTestJSON-1768400085-project-member</nova:user>
Nov 18 18:35:47 user nova-compute[74692]:         <nova:project uuid="1f169f28da1640d9b03b4ba44b4e7b7c">tempest-AttachVolumeShelveTestJSON-1768400085</nova:project>
Nov 18 18:35:47 user nova-compute[74692]:       </nova:owner>
Nov 18 18:35:47 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:35:47 user nova-compute[74692]:       <nova:ports>
Nov 18 18:35:47 user nova-compute[74692]:         <nova:port uuid="1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4">
Nov 18 18:35:47 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 18:35:47 user nova-compute[74692]:         </nova:port>
Nov 18 18:35:47 user nova-compute[74692]:       </nova:ports>
Nov 18 18:35:47 user nova-compute[74692]:     </nova:instance>
Nov 18 18:35:47 user nova-compute[74692]:   </metadata>
Nov 18 18:35:47 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:35:47 user nova-compute[74692]:     <system>
Nov 18 18:35:47 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:35:47 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:35:47 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:35:47 user nova-compute[74692]:       <entry name="serial">f3140c56-acf5-4cde-bd8c-273563540451</entry>
Nov 18 18:35:47 user nova-compute[74692]:       <entry name="uuid">f3140c56-acf5-4cde-bd8c-273563540451</entry>
Nov 18 18:35:47 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:35:47 user nova-compute[74692]:     </system>
Nov 18 18:35:47 user nova-compute[74692]:   </sysinfo>
Nov 18 18:35:47 user nova-compute[74692]:   <os>
Nov 18 18:35:47 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:35:47 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:35:47 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:35:47 user nova-compute[74692]:   </os>
Nov 18 18:35:47 user nova-compute[74692]:   <features>
Nov 18 18:35:47 user nova-compute[74692]:     <acpi/>
Nov 18 18:35:47 user nova-compute[74692]:     <apic/>
Nov 18 18:35:47 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:35:47 user nova-compute[74692]:   </features>
Nov 18 18:35:47 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:35:47 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:35:47 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:35:47 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:35:47 user nova-compute[74692]:   </clock>
Nov 18 18:35:47 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:35:47 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:35:47 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:35:47 user nova-compute[74692]:   </cpu>
Nov 18 18:35:47 user nova-compute[74692]:   <devices>
Nov 18 18:35:47 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:35:47 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:35:47 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk"/>
Nov 18 18:35:47 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:35:47 user nova-compute[74692]:     </disk>
Nov 18 18:35:47 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:35:47 user nova-compute[74692]:       <mac address="fa:16:3e:2a:6b:aa"/>
Nov 18 18:35:47 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:35:47 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:35:47 user nova-compute[74692]:       <target dev="tap1c5f8cc6-74"/>
Nov 18 18:35:47 user nova-compute[74692]:     </interface>
Nov 18 18:35:47 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:35:47 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/console.log" append="off"/>
Nov 18 18:35:47 user nova-compute[74692]:     </serial>
Nov 18 18:35:47 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:35:47 user nova-compute[74692]:     <video>
Nov 18 18:35:47 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:35:47 user nova-compute[74692]:     </video>
Nov 18 18:35:47 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:35:47 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:35:47 user nova-compute[74692]:     </rng>
Nov 18 18:35:47 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:35:47 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:35:47 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:35:47 user nova-compute[74692]:     </memballoon>
Nov 18 18:35:47 user nova-compute[74692]:   </devices>
Nov 18 18:35:47 user nova-compute[74692]: </domain>
Nov 18 18:35:47 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:35:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-539204829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-539204829',id=22,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOthkNNTFNmgshDO1rX52xwX9XJ2lO5YQxpyk5EEQ45Um8FR6Asz93Cp5prjGn6ddTJuKrAt7f9xLeqnxRgRZvpIVIpYI1gtVx59eDLtxaX+ya8P9H3FJZI+qzQmvQeDHw==',key_name='tempest-keypair-151002570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f169f28da1640d9b03b4ba44b4e7b7c',ramdisk_id='',reservation_id='r-f44p51kz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1768400085',owner_user_name='tempest-AttachVolumeShelveTestJSON-1768400085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:35:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a005c7c46c46ad9217578412ec906f',uuid=f3140c56-acf5-4cde-bd8c-273563540451,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converting VIF {"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6b:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c5f8cc6-74') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG os_vif [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6b:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c5f8cc6-74') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58e88981-9f88-545f-b0d4-67b200cd8ea8', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c5f8cc6-74, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c5f8cc6-74, col_values=(('qos', UUID('4016bc66-bcf6-4df1-9d2d-e985a8ce0a99')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c5f8cc6-74, col_values=(('external_ids', {'iface-id': '1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:6b:aa', 'vm-uuid': 'f3140c56-acf5-4cde-bd8c-273563540451'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:47 user nova-compute[74692]: INFO os_vif [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6b:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c5f8cc6-74')
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] No VIF found with MAC fa:16:3e:2a:6b:aa, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-f35de580-100e-4348-a04f-de48f67e90a0 req-d4e327ef-3513-4135-8974-06e1fabd36e2 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Updated VIF entry in instance network info cache for port 1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-f35de580-100e-4348-a04f-de48f67e90a0 req-d4e327ef-3513-4135-8974-06e1fabd36e2 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Updating instance_info_cache with network_info: [{"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:35:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f35de580-100e-4348-a04f-de48f67e90a0 req-d4e327ef-3513-4135-8974-06e1fabd36e2 service nova] Releasing lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:35:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-bd6f5e8f-0d81-418e-a7f4-2ba32990f381 req-0238c5cf-281a-4056-9bd3-508681c589f6 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received event network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-bd6f5e8f-0d81-418e-a7f4-2ba32990f381 req-0238c5cf-281a-4056-9bd3-508681c589f6 service nova] Acquiring lock "f3140c56-acf5-4cde-bd8c-273563540451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-bd6f5e8f-0d81-418e-a7f4-2ba32990f381 req-0238c5cf-281a-4056-9bd3-508681c589f6 service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-bd6f5e8f-0d81-418e-a7f4-2ba32990f381 req-0238c5cf-281a-4056-9bd3-508681c589f6 service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-bd6f5e8f-0d81-418e-a7f4-2ba32990f381 req-0238c5cf-281a-4056-9bd3-508681c589f6 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] No waiting events found dispatching network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:35:48 user nova-compute[74692]: WARNING nova.compute.manager [req-bd6f5e8f-0d81-418e-a7f4-2ba32990f381 req-0238c5cf-281a-4056-9bd3-508681c589f6 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received unexpected event network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 for instance with vm_state building and task_state spawning.
Nov 18 18:35:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-1bf1bcdc-22aa-4d4e-b93f-a54e9a9648ab req-ac2cf24e-12fa-4f1a-9088-6531d10d5ad4 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received event network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:35:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1bf1bcdc-22aa-4d4e-b93f-a54e9a9648ab req-ac2cf24e-12fa-4f1a-9088-6531d10d5ad4 service nova] Acquiring lock "f3140c56-acf5-4cde-bd8c-273563540451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:35:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1bf1bcdc-22aa-4d4e-b93f-a54e9a9648ab req-ac2cf24e-12fa-4f1a-9088-6531d10d5ad4 service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:35:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1bf1bcdc-22aa-4d4e-b93f-a54e9a9648ab req-ac2cf24e-12fa-4f1a-9088-6531d10d5ad4 service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-1bf1bcdc-22aa-4d4e-b93f-a54e9a9648ab req-ac2cf24e-12fa-4f1a-9088-6531d10d5ad4 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] No waiting events found dispatching network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:35:51 user nova-compute[74692]: WARNING nova.compute.manager [req-1bf1bcdc-22aa-4d4e-b93f-a54e9a9648ab req-ac2cf24e-12fa-4f1a-9088-6531d10d5ad4 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received unexpected event network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 for instance with vm_state building and task_state spawning.
Nov 18 18:35:51 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:35:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:35:51 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Instance spawned successfully.
Nov 18 18:35:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:35:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:35:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:35:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:35:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:35:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:35:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:35:51 user nova-compute[74692]: INFO nova.compute.manager [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Took 5.56 seconds to spawn the instance on the hypervisor.
Nov 18 18:35:51 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:35:51 user nova-compute[74692]: INFO nova.compute.manager [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Took 6.49 seconds to build instance.
Nov 18 18:35:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d6cc6141-d642-4081-93a6-7ef16c07e7db tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "f3140c56-acf5-4cde-bd8c-273563540451" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.626s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:56 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 873169f2-f1a7-4c16-8b8c-88767fea7fc9 is timed out.
Nov 18 18:35:56 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Successfully detached device vdb from instance 873169f2-f1a7-4c16-8b8c-88767fea7fc9 from the live domain config.
Nov 18 18:35:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XChYqfuL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:35:56 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c9ce08-885a-45b6-a863-f978025a40a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:35:56 user nova-compute[74692]: No targets found.
Nov 18 18:35:56 user nova-compute[74692]: iSNS:
Nov 18 18:35:56 user nova-compute[74692]: No targets found.
Nov 18 18:35:56 user nova-compute[74692]: STATIC:
Nov 18 18:35:56 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3
Nov 18 18:35:56 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:35:56 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:35:56 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f
Nov 18 18:35:56 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:35:56 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:35:56 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c
Nov 18 18:35:56 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:35:56 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:35:56 user nova-compute[74692]: FIRMWARE:
Nov 18 18:35:56 user nova-compute[74692]: No targets found.
Nov 18 18:35:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:35:56 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:35:56 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[91366b4e-1a26-4ab6-9a81-57323b3fe95f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8767fec-f811-4a45-8d80-353fc5f9e716]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:56 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:35:56 user nova-compute[74692]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f (non-flash)
Nov 18 18:35:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:35:56 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:35:56 user nova-compute[74692]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f (non-flash)
Nov 18 18:35:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a4531cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[31478b7f-04ae-4a13-ad2b-2300b02a006b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e499c2-ee2e-4300-ae1b-552e73b6e666]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[98daf44c-4aa7-47c6-9d0d-6d359bdaa415]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3126a372-7d61-4ada-ad4c-5d20acf7ad2b]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[65abae90-eca9-4956-8df6-36e0a8174f3a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5adc88-4a98-4e87-9164-30aa10ab9b0a]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f, portal: 172.16.0.220,3260]
Nov 18 18:35:56 user nova-compute[74692]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f, portal: 172.16.0.220,3260] successful.
Nov 18 18:35:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb361c73-60b8-4f9f-8073-7af2d46b6f7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1f5fd8-df04-4c30-b2e0-aa667aef7c43]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] <== disconnect_volume: return (327ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:35:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:35:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:35:57 user nova-compute[74692]: DEBUG nova.objects.instance [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lazy-loading 'flavor' on Instance uuid 873169f2-f1a7-4c16-8b8c-88767fea7fc9 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:35:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-17cbf240-a16c-46dc-aaff-04ecf6a487f8 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.683s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:35:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:07 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:36:07 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:36:08 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:36:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:08 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:36:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:36:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:36:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "d17071fc-5d5b-4e06-8a47-05174014167c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG nova.compute.manager [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:36:12 user nova-compute[74692]: INFO nova.compute.claims [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Claim successful on node user
Nov 18 18:36:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG nova.compute.manager [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG nova.compute.manager [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG nova.network.neutron [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:36:13 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:36:13 user nova-compute[74692]: DEBUG nova.compute.manager [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG nova.policy [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1233b31e12dc4d5796a60327d93c3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704ef46081d04fc7a0ed88456cbe9fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:36:13 user nova-compute[74692]: INFO nova.virt.block_device [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Booting with blank volume at /dev/vda
Nov 18 18:36:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG nova.network.neutron [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Successfully created port: 14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:36:14 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:36:14 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:36:14 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7513MB free_disk=25.091808319091797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 153d4723-7ede-41b3-9f64-a0487f617ed2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance c9c2ea43-093a-48ea-a464-373482eb1638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 873169f2-f1a7-4c16-8b8c-88767fea7fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance c80bfaf1-4f8f-4131-8591-d4c70a62a6ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance f3140c56-acf5-4cde-bd8c-273563540451 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:36:14 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.624s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG nova.network.neutron [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Successfully updated port: 14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "refresh_cache-d17071fc-5d5b-4e06-8a47-05174014167c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquired lock "refresh_cache-d17071fc-5d5b-4e06-8a47-05174014167c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG nova.network.neutron [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ba58035-e699-4b09-8da3-91b3d052cd4e req-e09375ab-8c68-46b5-a36b-293320faafb4 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received event network-changed-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ba58035-e699-4b09-8da3-91b3d052cd4e req-e09375ab-8c68-46b5-a36b-293320faafb4 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Refreshing instance network info cache due to event network-changed-14c60d63-2b64-480b-bd2e-8a26567cab7e. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ba58035-e699-4b09-8da3-91b3d052cd4e req-e09375ab-8c68-46b5-a36b-293320faafb4 service nova] Acquiring lock "refresh_cache-d17071fc-5d5b-4e06-8a47-05174014167c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG nova.network.neutron [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG nova.network.neutron [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Updating instance_info_cache with network_info: [{"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Releasing lock "refresh_cache-d17071fc-5d5b-4e06-8a47-05174014167c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG nova.compute.manager [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Instance network_info: |[{"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ba58035-e699-4b09-8da3-91b3d052cd4e req-e09375ab-8c68-46b5-a36b-293320faafb4 service nova] Acquired lock "refresh_cache-d17071fc-5d5b-4e06-8a47-05174014167c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG nova.network.neutron [req-7ba58035-e699-4b09-8da3-91b3d052cd4e req-e09375ab-8c68-46b5-a36b-293320faafb4 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Refreshing network info cache for port 14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:36:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:16 user nova-compute[74692]: DEBUG nova.network.neutron [req-7ba58035-e699-4b09-8da3-91b3d052cd4e req-e09375ab-8c68-46b5-a36b-293320faafb4 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Updated VIF entry in instance network info cache for port 14c60d63-2b64-480b-bd2e-8a26567cab7e. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:36:16 user nova-compute[74692]: DEBUG nova.network.neutron [req-7ba58035-e699-4b09-8da3-91b3d052cd4e req-e09375ab-8c68-46b5-a36b-293320faafb4 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Updating instance_info_cache with network_info: [{"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:36:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ba58035-e699-4b09-8da3-91b3d052cd4e req-e09375ab-8c68-46b5-a36b-293320faafb4 service nova] Releasing lock "refresh_cache-d17071fc-5d5b-4e06-8a47-05174014167c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:36:17 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:36:17 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:36:17 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:36:17 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:36:17 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:36:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:17 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:36:17 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG os_brick.utils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[19614e1d-9756-47f8-b72e-bb55768aabe3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6994d60-2db0-4c84-9155-f5e4736f0fec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e12899-4db5-4746-9505-072ff316c56a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6fb3c7-dc59-48b2-88ec-280df19992c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:36:19 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:36:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19303c3-cd2f-4d45-b350-d753f79d90e1]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG os_brick.utils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:36:19 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Updating existing volume attachment record: 9110e5cb-9405-4204-9b25-f9797a42cb60 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:36:20 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:36:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:36:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-d949d403-0a45-48bc-b64a-f63b114d1944" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:36:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-d949d403-0a45-48bc-b64a-f63b114d1944" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:36:21 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:36:21 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Updating instance_info_cache with network_info: [{"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:36:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-d949d403-0a45-48bc-b64a-f63b114d1944" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:36:21 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:36:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:36:25 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Creating image(s)
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Ensure instance console log exists: /opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Start _get_guest_xml network_info=[{"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXzvMjCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd17071fc-5d5b-4e06-8a47-05174014167c', 'attached_at': '', 'detached_at': '', 'volume_id': 'f918f8b1-52ea-4a14-8217-1c1fe0d18962', 'serial': 'f918f8b1-52ea-4a14-8217-1c1fe0d18962'}, 'attachment_id': '9110e5cb-9405-4204-9b25-f9797a42cb60', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:36:25 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:36:25 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXzvMjCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:36:25 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:36:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:36:25 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:36:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:36:25 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[068aa154-f395-44a1-ad5e-e6f43897a61d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:36:25 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59c8797-ac60-4c5a-883f-4e441571ec79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962] added
Nov 18 18:36:25 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2191764d-4faf-4933-bba6-5336c91c8632]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[da52e489-a99a-401e-8cc4-3a1aec96cda3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LXzvMjCH {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LXzvMjCH" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad43f56-44cf-4829-8b7c-cc7524bcb7e5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LXzvMjCH'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9dea0f-95cb-4b94-8dd7-c2c8ec68327b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea718c2-9c37-496b-98ca-b320dac18a43]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:36:26 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:36:26 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:36:26 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:36:26 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7ac412-f82f-463d-8e4d-8488e67606fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962, portal: 172.16.0.220,3260]
Nov 18 18:36:26 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962, portal: 172.16.0.220,3260] successful.
Nov 18 18:36:26 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0920bec-123e-4360-aa94-95be70740d27]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d722498-aa66-4066-8fc9-4b2df56cd797]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:36:26 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:36:26 user nova-compute[74692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:36:26 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:36:26 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:36:26 user nova-compute[74692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:36:26 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deb20e0-8c80-44eb-b882-482a75236ab2]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:36:26 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXzvMjCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23165363731636133', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165363731636133', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-677677591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-677677591',id=23,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='704ef46081d04fc7a0ed88456cbe9fe8',ramdisk_id='',reservation_id='r-428x2dz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-199647198',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:36:13Z,user_data=None,user_id='1233b31e12dc4d5796a60327d93c3bfb',uuid=d17071fc-5d5b-4e06-8a47-05174014167c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converting VIF {"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:01:49,bridge_name='br-int',has_traffic_filtering=True,id=14c60d63-2b64-480b-bd2e-8a26567cab7e,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c60d63-2b') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG nova.objects.instance [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'pci_devices' on Instance uuid d17071fc-5d5b-4e06-8a47-05174014167c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:36:27 user nova-compute[74692]:   <uuid>d17071fc-5d5b-4e06-8a47-05174014167c</uuid>
Nov 18 18:36:27 user nova-compute[74692]:   <name>instance-00000017</name>
Nov 18 18:36:27 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:36:27 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:36:27 user nova-compute[74692]:   <metadata>
Nov 18 18:36:27 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:36:27 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:36:27 user nova-compute[74692]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-677677591</nova:name>
Nov 18 18:36:27 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:36:25</nova:creationTime>
Nov 18 18:36:27 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:36:27 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:36:27 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:36:27 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:36:27 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:36:27 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:36:27 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:36:27 user nova-compute[74692]:       <nova:owner>
Nov 18 18:36:27 user nova-compute[74692]:         <nova:user uuid="1233b31e12dc4d5796a60327d93c3bfb">tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member</nova:user>
Nov 18 18:36:27 user nova-compute[74692]:         <nova:project uuid="704ef46081d04fc7a0ed88456cbe9fe8">tempest-ServerBootFromVolumeStableRescueTest-199647198</nova:project>
Nov 18 18:36:27 user nova-compute[74692]:       </nova:owner>
Nov 18 18:36:27 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:36:27 user nova-compute[74692]:       <nova:ports>
Nov 18 18:36:27 user nova-compute[74692]:         <nova:port uuid="14c60d63-2b64-480b-bd2e-8a26567cab7e">
Nov 18 18:36:27 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 18:36:27 user nova-compute[74692]:         </nova:port>
Nov 18 18:36:27 user nova-compute[74692]:       </nova:ports>
Nov 18 18:36:27 user nova-compute[74692]:     </nova:instance>
Nov 18 18:36:27 user nova-compute[74692]:   </metadata>
Nov 18 18:36:27 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:36:27 user nova-compute[74692]:     <system>
Nov 18 18:36:27 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:36:27 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:36:27 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:36:27 user nova-compute[74692]:       <entry name="serial">d17071fc-5d5b-4e06-8a47-05174014167c</entry>
Nov 18 18:36:27 user nova-compute[74692]:       <entry name="uuid">d17071fc-5d5b-4e06-8a47-05174014167c</entry>
Nov 18 18:36:27 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:36:27 user nova-compute[74692]:     </system>
Nov 18 18:36:27 user nova-compute[74692]:   </sysinfo>
Nov 18 18:36:27 user nova-compute[74692]:   <os>
Nov 18 18:36:27 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:36:27 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:36:27 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:36:27 user nova-compute[74692]:   </os>
Nov 18 18:36:27 user nova-compute[74692]:   <features>
Nov 18 18:36:27 user nova-compute[74692]:     <acpi/>
Nov 18 18:36:27 user nova-compute[74692]:     <apic/>
Nov 18 18:36:27 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:36:27 user nova-compute[74692]:   </features>
Nov 18 18:36:27 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:36:27 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:36:27 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:36:27 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:36:27 user nova-compute[74692]:   </clock>
Nov 18 18:36:27 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:36:27 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:36:27 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:36:27 user nova-compute[74692]:   </cpu>
Nov 18 18:36:27 user nova-compute[74692]:   <devices>
Nov 18 18:36:27 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:36:27 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:36:27 user nova-compute[74692]:       <source dev="/dev/sdb"/>
Nov 18 18:36:27 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:36:27 user nova-compute[74692]:       <serial>f918f8b1-52ea-4a14-8217-1c1fe0d18962</serial>
Nov 18 18:36:27 user nova-compute[74692]:     </disk>
Nov 18 18:36:27 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:36:27 user nova-compute[74692]:       <mac address="fa:16:3e:f2:01:49"/>
Nov 18 18:36:27 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:36:27 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:36:27 user nova-compute[74692]:       <target dev="tap14c60d63-2b"/>
Nov 18 18:36:27 user nova-compute[74692]:     </interface>
Nov 18 18:36:27 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:36:27 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/console.log" append="off"/>
Nov 18 18:36:27 user nova-compute[74692]:     </serial>
Nov 18 18:36:27 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:36:27 user nova-compute[74692]:     <video>
Nov 18 18:36:27 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:36:27 user nova-compute[74692]:     </video>
Nov 18 18:36:27 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:36:27 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:36:27 user nova-compute[74692]:     </rng>
Nov 18 18:36:27 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:36:27 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:36:27 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:36:27 user nova-compute[74692]:     </memballoon>
Nov 18 18:36:27 user nova-compute[74692]:   </devices>
Nov 18 18:36:27 user nova-compute[74692]: </domain>
Nov 18 18:36:27 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-677677591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-677677591',id=23,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='704ef46081d04fc7a0ed88456cbe9fe8',ramdisk_id='',reservation_id='r-428x2dz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-199647198',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:36:13Z,user_data=None,user_id='1233b31e12dc4d5796a60327d93c3bfb',uuid=d17071fc-5d5b-4e06-8a47-05174014167c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converting VIF {"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:01:49,bridge_name='br-int',has_traffic_filtering=True,id=14c60d63-2b64-480b-bd2e-8a26567cab7e,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c60d63-2b') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG os_vif [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:01:49,bridge_name='br-int',has_traffic_filtering=True,id=14c60d63-2b64-480b-bd2e-8a26567cab7e,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c60d63-2b') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e0f1d3e-29b8-58f9-8479-a4104071f94f', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14c60d63-2b, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14c60d63-2b, col_values=(('qos', UUID('4bb753fa-1cfb-4c43-b13c-b8cfbe7d2da1')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14c60d63-2b, col_values=(('external_ids', {'iface-id': '14c60d63-2b64-480b-bd2e-8a26567cab7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:01:49', 'vm-uuid': 'd17071fc-5d5b-4e06-8a47-05174014167c'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:27 user nova-compute[74692]: INFO os_vif [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:01:49,bridge_name='br-int',has_traffic_filtering=True,id=14c60d63-2b64-480b-bd2e-8a26567cab7e,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c60d63-2b')
Nov 18 18:36:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:36:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] No VIF found with MAC fa:16:3e:f2:01:49, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:36:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:29 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:36:29 user nova-compute[74692]: INFO nova.compute.manager [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] instance snapshotting
Nov 18 18:36:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-be5d207a-2bac-41bc-9b0d-47c141c637ec req-570c78fe-ed0e-4fac-a9ff-ed38c2cf3b93 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:36:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-be5d207a-2bac-41bc-9b0d-47c141c637ec req-570c78fe-ed0e-4fac-a9ff-ed38c2cf3b93 service nova] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-be5d207a-2bac-41bc-9b0d-47c141c637ec req-570c78fe-ed0e-4fac-a9ff-ed38c2cf3b93 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-be5d207a-2bac-41bc-9b0d-47c141c637ec req-570c78fe-ed0e-4fac-a9ff-ed38c2cf3b93 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-be5d207a-2bac-41bc-9b0d-47c141c637ec req-570c78fe-ed0e-4fac-a9ff-ed38c2cf3b93 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] No waiting events found dispatching network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:36:29 user nova-compute[74692]: WARNING nova.compute.manager [req-be5d207a-2bac-41bc-9b0d-47c141c637ec req-570c78fe-ed0e-4fac-a9ff-ed38c2cf3b93 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received unexpected event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e for instance with vm_state building and task_state spawning.
Nov 18 18:36:29 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Beginning live snapshot process
Nov 18 18:36:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json -f qcow2 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json -f qcow2 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json -f qcow2" returned: 0 in 0.167s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.164s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpauak2pcy/02cf6a80d5ec470b9d5e73dad6d4f71c.delta 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpauak2pcy/02cf6a80d5ec470b9d5e73dad6d4f71c.delta 1073741824" returned: 0 in 0.049s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:30 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 18 18:36:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:36:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-5ab93002-2dc1-4a72-9345-28f47c7585f5 req-b04b08f4-4ba9-4f84-a1f9-0ebe1fae211b service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:36:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ab93002-2dc1-4a72-9345-28f47c7585f5 req-b04b08f4-4ba9-4f84-a1f9-0ebe1fae211b service nova] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ab93002-2dc1-4a72-9345-28f47c7585f5 req-b04b08f4-4ba9-4f84-a1f9-0ebe1fae211b service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ab93002-2dc1-4a72-9345-28f47c7585f5 req-b04b08f4-4ba9-4f84-a1f9-0ebe1fae211b service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-5ab93002-2dc1-4a72-9345-28f47c7585f5 req-b04b08f4-4ba9-4f84-a1f9-0ebe1fae211b service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] No waiting events found dispatching network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:36:31 user nova-compute[74692]: WARNING nova.compute.manager [req-5ab93002-2dc1-4a72-9345-28f47c7585f5 req-b04b08f4-4ba9-4f84-a1f9-0ebe1fae211b service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received unexpected event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e for instance with vm_state building and task_state spawning.
Nov 18 18:36:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:36:31 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 18 18:36:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:36:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:36:31 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Instance spawned successfully.
Nov 18 18:36:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:36:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:36:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:36:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:36:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:36:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:36:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:36:31 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:36:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpauak2pcy/02cf6a80d5ec470b9d5e73dad6d4f71c.delta /opt/stack/data/nova/instances/snapshots/tmpauak2pcy/02cf6a80d5ec470b9d5e73dad6d4f71c {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:31 user nova-compute[74692]: INFO nova.compute.manager [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 18 18:36:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:36:31 user nova-compute[74692]: INFO nova.compute.manager [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Took 19.11 seconds to build instance.
Nov 18 18:36:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-19746d71-8766-4207-aa00-5afe1cf8a00c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "d17071fc-5d5b-4e06-8a47-05174014167c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.234s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpauak2pcy/02cf6a80d5ec470b9d5e73dad6d4f71c.delta /opt/stack/data/nova/instances/snapshots/tmpauak2pcy/02cf6a80d5ec470b9d5e73dad6d4f71c" returned: 0 in 0.286s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:31 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Snapshot extracted, beginning image upload
Nov 18 18:36:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:34 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Snapshot image upload complete
Nov 18 18:36:34 user nova-compute[74692]: INFO nova.compute.manager [None req-5c394228-3f76-404d-8e81-de1c80f3f9c2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Took 5.42 seconds to snapshot the instance on the hypervisor.
Nov 18 18:36:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:37 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:36:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:37 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:36:37 user nova-compute[74692]: INFO nova.compute.claims [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Claim successful on node user
Nov 18 18:36:37 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:36:37 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:36:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:36:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:36:38 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:36:38 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:36:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:36:38 user nova-compute[74692]: DEBUG nova.policy [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06701e65ca164dcc9156a1b0980c2456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c72c980ad5b43bfb3e021d8c945a72c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:36:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:36:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:36:38 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Creating image(s)
Nov 18 18:36:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "/opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "/opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe.part --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:39 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Successfully created port: 932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:36:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe.part --force-share --output=json" returned: 0 in 0.221s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:39 user nova-compute[74692]: DEBUG nova.virt.images [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] c8b8c49e-4674-4c7d-a064-9d71ee29f690 was qcow2, converting to raw {{(pid=74692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 18:36:39 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:36:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe.part /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe.converted {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe.part /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe.converted" returned: 0 in 0.245s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe.converted --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.823s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Successfully updated port: 932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "refresh_cache-4a20894d-58ea-4ebb-a39f-9746ccb277eb" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquired lock "refresh_cache-4a20894d-58ea-4ebb-a39f-9746ccb277eb" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-1eec110c-bc84-4b0f-baf8-a4855140e262 req-24abb442-a4ab-427e-a849-1e8c15fcd67b service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Received event network-changed-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-1eec110c-bc84-4b0f-baf8-a4855140e262 req-24abb442-a4ab-427e-a849-1e8c15fcd67b service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Refreshing instance network info cache due to event network-changed-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1eec110c-bc84-4b0f-baf8-a4855140e262 req-24abb442-a4ab-427e-a849-1e8c15fcd67b service nova] Acquiring lock "refresh_cache-4a20894d-58ea-4ebb-a39f-9746ccb277eb" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe --force-share --output=json" returned: 0 in 0.166s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe,backing_fmt=raw /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe,backing_fmt=raw /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk 1073741824" returned: 0 in 0.046s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Updating instance_info_cache with network_info: [{"id": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "address": "fa:16:3e:27:c6:e2", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932b913e-8e", "ovs_interfaceid": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Releasing lock "refresh_cache-4a20894d-58ea-4ebb-a39f-9746ccb277eb" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Instance network_info: |[{"id": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "address": "fa:16:3e:27:c6:e2", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932b913e-8e", "ovs_interfaceid": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1eec110c-bc84-4b0f-baf8-a4855140e262 req-24abb442-a4ab-427e-a849-1e8c15fcd67b service nova] Acquired lock "refresh_cache-4a20894d-58ea-4ebb-a39f-9746ccb277eb" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.network.neutron [req-1eec110c-bc84-4b0f-baf8-a4855140e262 req-24abb442-a4ab-427e-a849-1e8c15fcd67b service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Refreshing network info cache for port 932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Ensure instance console log exists: /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Start _get_guest_xml network_info=[{"id": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "address": "fa:16:3e:27:c6:e2", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932b913e-8e", "ovs_interfaceid": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='db33e403d808c49bc0e491c4d2a89265',container_format='bare',created_at=2023-11-18T18:36:29Z,direct_url=<?>,disk_format='qcow2',id=c8b8c49e-4674-4c7d-a064-9d71ee29f690,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1009221032',owner='8c72c980ad5b43bfb3e021d8c945a72c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-18T18:36:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': 'c8b8c49e-4674-4c7d-a064-9d71ee29f690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:36:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:36:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='db33e403d808c49bc0e491c4d2a89265',container_format='bare',created_at=2023-11-18T18:36:29Z,direct_url=<?>,disk_format='qcow2',id=c8b8c49e-4674-4c7d-a064-9d71ee29f690,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1009221032',owner='8c72c980ad5b43bfb3e021d8c945a72c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-18T18:36:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-914646254',display_name='tempest-TestStampPattern-server-914646254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-914646254',id=24,image_ref='c8b8c49e-4674-4c7d-a064-9d71ee29f690',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB7akI9Ef5IF2ubc0pOGpfPsCLfKgXlGgPf6VXPlA0zR+68LnHP3vVrar+LjgpmnH9dLlzovoA0gykf7I0UDbFjCuPzygvOsGrahVjnNx7QVyzmocIYPH6AmctAdhsRVw==',key_name='tempest-TestStampPattern-1083759675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c72c980ad5b43bfb3e021d8c945a72c',ramdisk_id='',reservation_id='r-7q7l2zvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='873169f2-f1a7-4c16-8b8c-88767fea7fc9',image_min_disk='1',image_min_ram='0',image_owner_id='8c72c980ad5b43bfb3e021d8c945a72c',image_owner_project_name='tempest-TestStampPattern-180669565',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-180669565-project-member',image_user_id='06701e65ca164dcc9156a1b0980c2456',network_allocated='True',owner_project_name='tempest-TestStampPattern-180669565',owner_user_name='tempest-TestStampPattern-180669565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:36:38Z,user_data=None,user_id='06701e65ca164dcc9156a1b0980c2456',uuid=4a20894d-58ea-4ebb-a39f-9746ccb277eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "address": "fa:16:3e:27:c6:e2", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932b913e-8e", "ovs_interfaceid": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Converting VIF {"id": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "address": "fa:16:3e:27:c6:e2", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932b913e-8e", "ovs_interfaceid": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:c6:e2,bridge_name='br-int',has_traffic_filtering=True,id=932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8,network=Network(d592abe8-2581-4e23-93f9-c3676958cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932b913e-8e') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a20894d-58ea-4ebb-a39f-9746ccb277eb {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:36:40 user nova-compute[74692]:   <uuid>4a20894d-58ea-4ebb-a39f-9746ccb277eb</uuid>
Nov 18 18:36:40 user nova-compute[74692]:   <name>instance-00000018</name>
Nov 18 18:36:40 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:36:40 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:36:40 user nova-compute[74692]:   <metadata>
Nov 18 18:36:40 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:36:40 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:36:40 user nova-compute[74692]:       <nova:name>tempest-TestStampPattern-server-914646254</nova:name>
Nov 18 18:36:40 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:36:40</nova:creationTime>
Nov 18 18:36:40 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:36:40 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:36:40 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:36:40 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:36:40 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:36:40 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:36:40 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:36:40 user nova-compute[74692]:       <nova:owner>
Nov 18 18:36:40 user nova-compute[74692]:         <nova:user uuid="06701e65ca164dcc9156a1b0980c2456">tempest-TestStampPattern-180669565-project-member</nova:user>
Nov 18 18:36:40 user nova-compute[74692]:         <nova:project uuid="8c72c980ad5b43bfb3e021d8c945a72c">tempest-TestStampPattern-180669565</nova:project>
Nov 18 18:36:40 user nova-compute[74692]:       </nova:owner>
Nov 18 18:36:40 user nova-compute[74692]:       <nova:root type="image" uuid="c8b8c49e-4674-4c7d-a064-9d71ee29f690"/>
Nov 18 18:36:40 user nova-compute[74692]:       <nova:ports>
Nov 18 18:36:40 user nova-compute[74692]:         <nova:port uuid="932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8">
Nov 18 18:36:40 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 18:36:40 user nova-compute[74692]:         </nova:port>
Nov 18 18:36:40 user nova-compute[74692]:       </nova:ports>
Nov 18 18:36:40 user nova-compute[74692]:     </nova:instance>
Nov 18 18:36:40 user nova-compute[74692]:   </metadata>
Nov 18 18:36:40 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:36:40 user nova-compute[74692]:     <system>
Nov 18 18:36:40 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:36:40 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:36:40 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:36:40 user nova-compute[74692]:       <entry name="serial">4a20894d-58ea-4ebb-a39f-9746ccb277eb</entry>
Nov 18 18:36:40 user nova-compute[74692]:       <entry name="uuid">4a20894d-58ea-4ebb-a39f-9746ccb277eb</entry>
Nov 18 18:36:40 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:36:40 user nova-compute[74692]:     </system>
Nov 18 18:36:40 user nova-compute[74692]:   </sysinfo>
Nov 18 18:36:40 user nova-compute[74692]:   <os>
Nov 18 18:36:40 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:36:40 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:36:40 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:36:40 user nova-compute[74692]:   </os>
Nov 18 18:36:40 user nova-compute[74692]:   <features>
Nov 18 18:36:40 user nova-compute[74692]:     <acpi/>
Nov 18 18:36:40 user nova-compute[74692]:     <apic/>
Nov 18 18:36:40 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:36:40 user nova-compute[74692]:   </features>
Nov 18 18:36:40 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:36:40 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:36:40 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:36:40 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:36:40 user nova-compute[74692]:   </clock>
Nov 18 18:36:40 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:36:40 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:36:40 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:36:40 user nova-compute[74692]:   </cpu>
Nov 18 18:36:40 user nova-compute[74692]:   <devices>
Nov 18 18:36:40 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:36:40 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:36:40 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk"/>
Nov 18 18:36:40 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:36:40 user nova-compute[74692]:     </disk>
Nov 18 18:36:40 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:36:40 user nova-compute[74692]:       <mac address="fa:16:3e:27:c6:e2"/>
Nov 18 18:36:40 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:36:40 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:36:40 user nova-compute[74692]:       <target dev="tap932b913e-8e"/>
Nov 18 18:36:40 user nova-compute[74692]:     </interface>
Nov 18 18:36:40 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:36:40 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/console.log" append="off"/>
Nov 18 18:36:40 user nova-compute[74692]:     </serial>
Nov 18 18:36:40 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:36:40 user nova-compute[74692]:     <video>
Nov 18 18:36:40 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:36:40 user nova-compute[74692]:     </video>
Nov 18 18:36:40 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:36:40 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:36:40 user nova-compute[74692]:     </rng>
Nov 18 18:36:40 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:36:40 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:36:40 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:36:40 user nova-compute[74692]:     </memballoon>
Nov 18 18:36:40 user nova-compute[74692]:   </devices>
Nov 18 18:36:40 user nova-compute[74692]: </domain>
Nov 18 18:36:40 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-914646254',display_name='tempest-TestStampPattern-server-914646254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-914646254',id=24,image_ref='c8b8c49e-4674-4c7d-a064-9d71ee29f690',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB7akI9Ef5IF2ubc0pOGpfPsCLfKgXlGgPf6VXPlA0zR+68LnHP3vVrar+LjgpmnH9dLlzovoA0gykf7I0UDbFjCuPzygvOsGrahVjnNx7QVyzmocIYPH6AmctAdhsRVw==',key_name='tempest-TestStampPattern-1083759675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c72c980ad5b43bfb3e021d8c945a72c',ramdisk_id='',reservation_id='r-7q7l2zvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='873169f2-f1a7-4c16-8b8c-88767fea7fc9',image_min_disk='1',image_min_ram='0',image_owner_id='8c72c980ad5b43bfb3e021d8c945a72c',image_owner_project_name='tempest-TestStampPattern-180669565',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-180669565-project-member',image_user_id='06701e65ca164dcc9156a1b0980c2456',network_allocated='True',owner_project_name='tempest-TestStampPattern-180669565',owner_user_name='tempest-TestStampPattern-180669565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:36:38Z,user_data=None,user_id='06701e65ca164dcc9156a1b0980c2456',uuid=4a20894d-58ea-4ebb-a39f-9746ccb277eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "address": "fa:16:3e:27:c6:e2", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932b913e-8e", "ovs_interfaceid": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Converting VIF {"id": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "address": "fa:16:3e:27:c6:e2", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932b913e-8e", "ovs_interfaceid": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:c6:e2,bridge_name='br-int',has_traffic_filtering=True,id=932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8,network=Network(d592abe8-2581-4e23-93f9-c3676958cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932b913e-8e') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG os_vif [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:c6:e2,bridge_name='br-int',has_traffic_filtering=True,id=932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8,network=Network(d592abe8-2581-4e23-93f9-c3676958cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932b913e-8e') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '311d284b-cc33-5e9f-9ee9-86750f509c49', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap932b913e-8e, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap932b913e-8e, col_values=(('qos', UUID('c5a080a3-ff84-4734-88a9-22e8d910cfbe')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap932b913e-8e, col_values=(('external_ids', {'iface-id': '932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:c6:e2', 'vm-uuid': '4a20894d-58ea-4ebb-a39f-9746ccb277eb'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:36:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:41 user nova-compute[74692]: INFO os_vif [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:c6:e2,bridge_name='br-int',has_traffic_filtering=True,id=932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8,network=Network(d592abe8-2581-4e23-93f9-c3676958cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932b913e-8e')
Nov 18 18:36:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:36:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] No VIF found with MAC fa:16:3e:27:c6:e2, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:36:41 user nova-compute[74692]: DEBUG nova.network.neutron [req-1eec110c-bc84-4b0f-baf8-a4855140e262 req-24abb442-a4ab-427e-a849-1e8c15fcd67b service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Updated VIF entry in instance network info cache for port 932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:36:41 user nova-compute[74692]: DEBUG nova.network.neutron [req-1eec110c-bc84-4b0f-baf8-a4855140e262 req-24abb442-a4ab-427e-a849-1e8c15fcd67b service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Updating instance_info_cache with network_info: [{"id": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "address": "fa:16:3e:27:c6:e2", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932b913e-8e", "ovs_interfaceid": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:36:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1eec110c-bc84-4b0f-baf8-a4855140e262 req-24abb442-a4ab-427e-a849-1e8c15fcd67b service nova] Releasing lock "refresh_cache-4a20894d-58ea-4ebb-a39f-9746ccb277eb" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:36:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-5a263ae3-2d24-436b-a632-63e38f0830ac req-6f059722-a6dd-467d-adb6-8d724c53ad5e service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Received event network-vif-plugged-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:36:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5a263ae3-2d24-436b-a632-63e38f0830ac req-6f059722-a6dd-467d-adb6-8d724c53ad5e service nova] Acquiring lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5a263ae3-2d24-436b-a632-63e38f0830ac req-6f059722-a6dd-467d-adb6-8d724c53ad5e service nova] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5a263ae3-2d24-436b-a632-63e38f0830ac req-6f059722-a6dd-467d-adb6-8d724c53ad5e service nova] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-5a263ae3-2d24-436b-a632-63e38f0830ac req-6f059722-a6dd-467d-adb6-8d724c53ad5e service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] No waiting events found dispatching network-vif-plugged-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:36:42 user nova-compute[74692]: WARNING nova.compute.manager [req-5a263ae3-2d24-436b-a632-63e38f0830ac req-6f059722-a6dd-467d-adb6-8d724c53ad5e service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Received unexpected event network-vif-plugged-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 for instance with vm_state building and task_state spawning.
Nov 18 18:36:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-03752770-0f59-4ad9-8e70-9a2aabf66bb6 req-67380066-0802-4e8e-a075-ac5ee04c8299 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Received event network-vif-plugged-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:36:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-03752770-0f59-4ad9-8e70-9a2aabf66bb6 req-67380066-0802-4e8e-a075-ac5ee04c8299 service nova] Acquiring lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-03752770-0f59-4ad9-8e70-9a2aabf66bb6 req-67380066-0802-4e8e-a075-ac5ee04c8299 service nova] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-03752770-0f59-4ad9-8e70-9a2aabf66bb6 req-67380066-0802-4e8e-a075-ac5ee04c8299 service nova] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-03752770-0f59-4ad9-8e70-9a2aabf66bb6 req-67380066-0802-4e8e-a075-ac5ee04c8299 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] No waiting events found dispatching network-vif-plugged-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:36:44 user nova-compute[74692]: WARNING nova.compute.manager [req-03752770-0f59-4ad9-8e70-9a2aabf66bb6 req-67380066-0802-4e8e-a075-ac5ee04c8299 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Received unexpected event network-vif-plugged-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 for instance with vm_state building and task_state spawning.
Nov 18 18:36:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:44 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:36:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:36:44 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Instance spawned successfully.
Nov 18 18:36:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:36:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:36:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:36:44 user nova-compute[74692]: INFO nova.compute.manager [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Took 6.75 seconds to spawn the instance on the hypervisor.
Nov 18 18:36:44 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:36:45 user nova-compute[74692]: INFO nova.compute.manager [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Took 7.56 seconds to build instance.
Nov 18 18:36:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c2a77a2c-7dca-4960-9e20-177447c88bb2 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.669s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:53 user nova-compute[74692]: DEBUG nova.objects.instance [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'flavor' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:36:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:36:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquired lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:36:53 user nova-compute[74692]: DEBUG nova.network.neutron [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:36:53 user nova-compute[74692]: DEBUG nova.objects.instance [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'info_cache' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:36:53 user nova-compute[74692]: DEBUG nova.objects.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Object Instance<96c70a3c-82db-4adf-8f9b-4e7c1a37b519> lazy-loaded attributes: flavor,info_cache {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.network.neutron [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Updating instance_info_cache with network_info: [{"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Releasing lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:36:54 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Instance destroyed successfully.
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.objects.instance [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'resources' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.objects.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Object Instance<96c70a3c-82db-4adf-8f9b-4e7c1a37b519> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1934677203',display_name='tempest-AttachVolumeTestJSON-server-1934677203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1934677203',id=17,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWoJ1g21ysWeKm0aCaq0iDAu6GFhJ4Kgqa/cYa4mb67PyeCSQSB1+k/re9L+dOqnhT2aQmCtGqB0zHW7DLxwgFWBB78ohK6z8iaUSg7A5I+FxwvxJ5cm1dB7niInB9aXw==',key_name='tempest-keypair-29977122',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:33:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='da05b2ed39a3489db70da40991bc8e48',ramdisk_id='',reservation_id='r-xspl17l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-858172900',owner_user_name='tempest-AttachVolumeTestJSON-858172900-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:35:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9dad2e2f1d541bf803b5d923db5242b',uuid=96c70a3c-82db-4adf-8f9b-4e7c1a37b519,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converting VIF {"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_vif [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9753f583-43, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb90cc82-c04e-4125-bfa0-684d81b6f536) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:36:54 user nova-compute[74692]: INFO os_vif [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43')
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NafBPsmo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:36:54 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f42f6cb-29f2-4765-a299-f68e3ad00334]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:36:54 user nova-compute[74692]: No targets found.
Nov 18 18:36:54 user nova-compute[74692]: iSNS:
Nov 18 18:36:54 user nova-compute[74692]: No targets found.
Nov 18 18:36:54 user nova-compute[74692]: STATIC:
Nov 18 18:36:54 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3
Nov 18 18:36:54 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:36:54 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:36:54 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c
Nov 18 18:36:54 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:36:54 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:36:54 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:36:54 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:36:54 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:36:54 user nova-compute[74692]: FIRMWARE:
Nov 18 18:36:54 user nova-compute[74692]: No targets found.
Nov 18 18:36:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:36:54 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:36:54 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b4b1f7-a981-4270-bd34-76627cec84c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e996c6ba-3cc4-4e7d-a868-d2031000f88c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:36:54 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:36:54 user nova-compute[74692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:36:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:36:54 user nova-compute[74692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:36:54 user nova-compute[74692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:36:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a456a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c'): ({'sdc'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Removing single pathed devices sdc {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec5c3ab-8072-44f5-8dba-3af93aa2ffb0]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba03f3e1-dd4f-45cd-9e1e-480cfa808761]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Flushing IO for device /dev/sdc {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eafd5e5-eb22-4868-972d-07968b8fb7e5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d3f64d-e680-4bf1-b509-7cb0cb119408]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6e42c1-7a22-4308-b6b6-bd202f15b0cf]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8faf143-1065-4128-87e4-13f2715c9a29]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260]
Nov 18 18:36:54 user nova-compute[74692]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260] successful.
Nov 18 18:36:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdc5687-be50-45ed-a4d2-bce60ec64774]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] <== disconnect_volume: return (322ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Start _get_guest_xml network_info=[{"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NafBPsmo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '96c70a3c-82db-4adf-8f9b-4e7c1a37b519', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef33492e-0be5-4134-8333-62d26e73d98c', 'serial': 'ef33492e-0be5-4134-8333-62d26e73d98c'}, 'attachment_id': 'bfd4e95c-794b-4bff-9e39-be78b5480400', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.objects.instance [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'numa_topology' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.objects.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Object Instance<96c70a3c-82db-4adf-8f9b-4e7c1a37b519> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:36:54 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:36:54 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.objects.instance [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'vcpu_model' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.objects.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Object Instance<96c70a3c-82db-4adf-8f9b-4e7c1a37b519> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NafBPsmo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:36:54 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:36:54 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:36:54 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6225c7d2-5a36-4b46-bc4d-061dbbcb9cf2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:36:54 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e562f32f-caf7-42dd-a935-93dc88b5a76b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c] added
Nov 18 18:36:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1605d7a-df9b-4692-b604-dbc9b8e90c7a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e1cf2d-747f-46a8-944b-94a8836e65fa]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NafBPsmo {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NafBPsmo" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3591f550-4e53-42e9-940d-94da70db82a0]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NafBPsmo'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7603f909-5a13-421e-85b5-a7f5f71acba9]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[159f867e-a645-48bb-904f-27d86a317e96]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:36:55 user nova-compute[74692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:36:55 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:36:55 user nova-compute[74692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:36:55 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6e1f0f-63c4-442a-b1a7-8286db16c1da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260]
Nov 18 18:36:55 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260] successful.
Nov 18 18:36:55 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4542660d-1baf-4875-8b6b-536d36e58561]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e26b1f-9663-4dc8-bfbb-5b281853612b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:36:55 user nova-compute[74692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:36:55 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:36:55 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:36:55 user nova-compute[74692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:36:55 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:36:55 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d3cb7f-5c8c-4f08-a49d-c3461397bdc3]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NafBPsmo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:55 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:36:56 user nova-compute[74692]: INFO nova.compute.claims [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Claim successful on node user
Nov 18 18:36:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26234303138383966', 'path': '/dev/sdc'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234303138383966', 'path': '/dev/sdc'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1934677203',display_name='tempest-AttachVolumeTestJSON-server-1934677203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1934677203',id=17,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWoJ1g21ysWeKm0aCaq0iDAu6GFhJ4Kgqa/cYa4mb67PyeCSQSB1+k/re9L+dOqnhT2aQmCtGqB0zHW7DLxwgFWBB78ohK6z8iaUSg7A5I+FxwvxJ5cm1dB7niInB9aXw==',key_name='tempest-keypair-29977122',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:33:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='da05b2ed39a3489db70da40991bc8e48',ramdisk_id='',reservation_id='r-xspl17l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-858172900',owner_user_name='tempest-AttachVolumeTestJSON-858172900-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:35:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9dad2e2f1d541bf803b5d923db5242b',uuid=96c70a3c-82db-4adf-8f9b-4e7c1a37b519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converting VIF {"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.objects.instance [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'pci_devices' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.objects.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Object Instance<96c70a3c-82db-4adf-8f9b-4e7c1a37b519> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:36:56 user nova-compute[74692]:   <uuid>96c70a3c-82db-4adf-8f9b-4e7c1a37b519</uuid>
Nov 18 18:36:56 user nova-compute[74692]:   <name>instance-00000011</name>
Nov 18 18:36:56 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:36:56 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:36:56 user nova-compute[74692]:   <metadata>
Nov 18 18:36:56 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:36:56 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:36:56 user nova-compute[74692]:       <nova:name>tempest-AttachVolumeTestJSON-server-1934677203</nova:name>
Nov 18 18:36:56 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:36:54</nova:creationTime>
Nov 18 18:36:56 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:36:56 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:36:56 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:36:56 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:36:56 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:36:56 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:36:56 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:36:56 user nova-compute[74692]:       <nova:owner>
Nov 18 18:36:56 user nova-compute[74692]:         <nova:user uuid="f9dad2e2f1d541bf803b5d923db5242b">tempest-AttachVolumeTestJSON-858172900-project-member</nova:user>
Nov 18 18:36:56 user nova-compute[74692]:         <nova:project uuid="da05b2ed39a3489db70da40991bc8e48">tempest-AttachVolumeTestJSON-858172900</nova:project>
Nov 18 18:36:56 user nova-compute[74692]:       </nova:owner>
Nov 18 18:36:56 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:36:56 user nova-compute[74692]:       <nova:ports>
Nov 18 18:36:56 user nova-compute[74692]:         <nova:port uuid="9753f583-4360-48e8-a59f-43b16198aa36">
Nov 18 18:36:56 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 18:36:56 user nova-compute[74692]:         </nova:port>
Nov 18 18:36:56 user nova-compute[74692]:       </nova:ports>
Nov 18 18:36:56 user nova-compute[74692]:     </nova:instance>
Nov 18 18:36:56 user nova-compute[74692]:   </metadata>
Nov 18 18:36:56 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:36:56 user nova-compute[74692]:     <system>
Nov 18 18:36:56 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:36:56 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:36:56 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:36:56 user nova-compute[74692]:       <entry name="serial">96c70a3c-82db-4adf-8f9b-4e7c1a37b519</entry>
Nov 18 18:36:56 user nova-compute[74692]:       <entry name="uuid">96c70a3c-82db-4adf-8f9b-4e7c1a37b519</entry>
Nov 18 18:36:56 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:36:56 user nova-compute[74692]:     </system>
Nov 18 18:36:56 user nova-compute[74692]:   </sysinfo>
Nov 18 18:36:56 user nova-compute[74692]:   <os>
Nov 18 18:36:56 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:36:56 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:36:56 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:36:56 user nova-compute[74692]:   </os>
Nov 18 18:36:56 user nova-compute[74692]:   <features>
Nov 18 18:36:56 user nova-compute[74692]:     <acpi/>
Nov 18 18:36:56 user nova-compute[74692]:     <apic/>
Nov 18 18:36:56 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:36:56 user nova-compute[74692]:   </features>
Nov 18 18:36:56 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:36:56 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:36:56 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:36:56 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:36:56 user nova-compute[74692]:   </clock>
Nov 18 18:36:56 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:36:56 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:36:56 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:36:56 user nova-compute[74692]:   </cpu>
Nov 18 18:36:56 user nova-compute[74692]:   <devices>
Nov 18 18:36:56 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:36:56 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:36:56 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk"/>
Nov 18 18:36:56 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:36:56 user nova-compute[74692]:     </disk>
Nov 18 18:36:56 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:36:56 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:36:56 user nova-compute[74692]:       <source dev="/dev/sdc"/>
Nov 18 18:36:56 user nova-compute[74692]:       <target dev="vdb" bus="virtio"/>
Nov 18 18:36:56 user nova-compute[74692]:       <serial>ef33492e-0be5-4134-8333-62d26e73d98c</serial>
Nov 18 18:36:56 user nova-compute[74692]:     </disk>
Nov 18 18:36:56 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:36:56 user nova-compute[74692]:       <mac address="fa:16:3e:bb:07:0d"/>
Nov 18 18:36:56 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:36:56 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:36:56 user nova-compute[74692]:       <target dev="tap9753f583-43"/>
Nov 18 18:36:56 user nova-compute[74692]:     </interface>
Nov 18 18:36:56 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:36:56 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/console.log" append="off"/>
Nov 18 18:36:56 user nova-compute[74692]:     </serial>
Nov 18 18:36:56 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:36:56 user nova-compute[74692]:     <video>
Nov 18 18:36:56 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:36:56 user nova-compute[74692]:     </video>
Nov 18 18:36:56 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:36:56 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:36:56 user nova-compute[74692]:     </rng>
Nov 18 18:36:56 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:36:56 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:36:56 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:36:56 user nova-compute[74692]:     </memballoon>
Nov 18 18:36:56 user nova-compute[74692]:   </devices>
Nov 18 18:36:56 user nova-compute[74692]: </domain>
Nov 18 18:36:56 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.objects.instance [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'trusted_certs' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.objects.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Object Instance<96c70a3c-82db-4adf-8f9b-4e7c1a37b519> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:36:56 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.policy [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b74039dc13ac4a03ba772f5b87296e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5e045b95b64117a1f7319ada089654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:36:56 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Creating image(s)
Nov 18 18:36:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "/opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "/opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "/opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Cannot resize image /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.objects.instance [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'migration_context' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.objects.base [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Object Instance<96c70a3c-82db-4adf-8f9b-4e7c1a37b519> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1934677203',display_name='tempest-AttachVolumeTestJSON-server-1934677203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1934677203',id=17,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWoJ1g21ysWeKm0aCaq0iDAu6GFhJ4Kgqa/cYa4mb67PyeCSQSB1+k/re9L+dOqnhT2aQmCtGqB0zHW7DLxwgFWBB78ohK6z8iaUSg7A5I+FxwvxJ5cm1dB7niInB9aXw==',key_name='tempest-keypair-29977122',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:33:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='da05b2ed39a3489db70da40991bc8e48',ramdisk_id='',reservation_id='r-xspl17l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-858172900',owner_user_name='tempest-AttachVolumeTestJSON-858172900-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:35:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9dad2e2f1d541bf803b5d923db5242b',uuid=96c70a3c-82db-4adf-8f9b-4e7c1a37b519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converting VIF {"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG os_vif [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:36:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d88f4da-8f63-58ae-8bc7-979312d8dcdd', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9753f583-43, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9753f583-43, col_values=(('qos', UUID('7f9a40ad-536f-4ca0-ab0f-f98262b9a541')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9753f583-43, col_values=(('external_ids', {'iface-id': '9753f583-4360-48e8-a59f-43b16198aa36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:07:0d', 'vm-uuid': '96c70a3c-82db-4adf-8f9b-4e7c1a37b519'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:57 user nova-compute[74692]: INFO os_vif [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43')
Nov 18 18:36:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk 1073741824" returned: 0 in 0.059s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.185s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Checking if we can resize image /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Successfully created port: 8f2146d5-7fed-448c-a056-be7d4d79eabd {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Cannot resize image /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Ensure instance console log exists: /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:36:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Successfully updated port: 8f2146d5-7fed-448c-a056-be7d4d79eabd {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "refresh_cache-576a5f25-56f7-49d4-9fdc-1429f588f9e3" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquired lock "refresh_cache-576a5f25-56f7-49d4-9fdc-1429f588f9e3" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.compute.manager [req-91a35b35-dbfa-4dc5-ba97-b27df0400c32 req-996c5adb-e923-4716-9879-7961208c4600 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Received event network-changed-8f2146d5-7fed-448c-a056-be7d4d79eabd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.compute.manager [req-91a35b35-dbfa-4dc5-ba97-b27df0400c32 req-996c5adb-e923-4716-9879-7961208c4600 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Refreshing instance network info cache due to event network-changed-8f2146d5-7fed-448c-a056-be7d4d79eabd. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91a35b35-dbfa-4dc5-ba97-b27df0400c32 req-996c5adb-e923-4716-9879-7961208c4600 service nova] Acquiring lock "refresh_cache-576a5f25-56f7-49d4-9fdc-1429f588f9e3" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.network.neutron [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Updating instance_info_cache with network_info: [{"id": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "address": "fa:16:3e:77:21:64", "network": {"id": "eae777ed-faa6-4132-b374-480aab64d54c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1942002881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5e045b95b64117a1f7319ada089654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2146d5-7f", "ovs_interfaceid": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Releasing lock "refresh_cache-576a5f25-56f7-49d4-9fdc-1429f588f9e3" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Instance network_info: |[{"id": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "address": "fa:16:3e:77:21:64", "network": {"id": "eae777ed-faa6-4132-b374-480aab64d54c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1942002881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5e045b95b64117a1f7319ada089654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2146d5-7f", "ovs_interfaceid": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91a35b35-dbfa-4dc5-ba97-b27df0400c32 req-996c5adb-e923-4716-9879-7961208c4600 service nova] Acquired lock "refresh_cache-576a5f25-56f7-49d4-9fdc-1429f588f9e3" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.network.neutron [req-91a35b35-dbfa-4dc5-ba97-b27df0400c32 req-996c5adb-e923-4716-9879-7961208c4600 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Refreshing network info cache for port 8f2146d5-7fed-448c-a056-be7d4d79eabd {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Start _get_guest_xml network_info=[{"id": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "address": "fa:16:3e:77:21:64", "network": {"id": "eae777ed-faa6-4132-b374-480aab64d54c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1942002881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5e045b95b64117a1f7319ada089654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2146d5-7f", "ovs_interfaceid": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:36:58 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:36:58 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1510851468',display_name='tempest-SnapshotDataIntegrityTests-server-1510851468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1510851468',id=25,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDi0O7xQG1rj/A+Q8omoIqLs2ppwaYYia4OQ6Tkrg6rnpqzhULLedUwtoB6naepamiKyou2Y8BKUPHX3E+mIVZqXSra8mLMdy7yKYdTwe/ep0Ik7rsRgvM+Q34m6CGhiyA==',key_name='tempest-keypair-374358210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f5e045b95b64117a1f7319ada089654',ramdisk_id='',reservation_id='r-9v8l0tav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1481466',owner_user_name='tempest-SnapshotDataIntegrityTests-1481466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74039dc13ac4a03ba772f5b87296e20',uuid=576a5f25-56f7-49d4-9fdc-1429f588f9e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "address": "fa:16:3e:77:21:64", "network": {"id": "eae777ed-faa6-4132-b374-480aab64d54c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1942002881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5e045b95b64117a1f7319ada089654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2146d5-7f", "ovs_interfaceid": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Converting VIF {"id": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "address": "fa:16:3e:77:21:64", "network": {"id": "eae777ed-faa6-4132-b374-480aab64d54c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1942002881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5e045b95b64117a1f7319ada089654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2146d5-7f", "ovs_interfaceid": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:64,bridge_name='br-int',has_traffic_filtering=True,id=8f2146d5-7fed-448c-a056-be7d4d79eabd,network=Network(eae777ed-faa6-4132-b374-480aab64d54c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2146d5-7f') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.objects.instance [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lazy-loading 'pci_devices' on Instance uuid 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:36:58 user nova-compute[74692]:   <uuid>576a5f25-56f7-49d4-9fdc-1429f588f9e3</uuid>
Nov 18 18:36:58 user nova-compute[74692]:   <name>instance-00000019</name>
Nov 18 18:36:58 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:36:58 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:36:58 user nova-compute[74692]:   <metadata>
Nov 18 18:36:58 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:36:58 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:36:58 user nova-compute[74692]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1510851468</nova:name>
Nov 18 18:36:58 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:36:58</nova:creationTime>
Nov 18 18:36:58 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:36:58 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:36:58 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:36:58 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:36:58 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:36:58 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:36:58 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:36:58 user nova-compute[74692]:       <nova:owner>
Nov 18 18:36:58 user nova-compute[74692]:         <nova:user uuid="b74039dc13ac4a03ba772f5b87296e20">tempest-SnapshotDataIntegrityTests-1481466-project-member</nova:user>
Nov 18 18:36:58 user nova-compute[74692]:         <nova:project uuid="0f5e045b95b64117a1f7319ada089654">tempest-SnapshotDataIntegrityTests-1481466</nova:project>
Nov 18 18:36:58 user nova-compute[74692]:       </nova:owner>
Nov 18 18:36:58 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:36:58 user nova-compute[74692]:       <nova:ports>
Nov 18 18:36:58 user nova-compute[74692]:         <nova:port uuid="8f2146d5-7fed-448c-a056-be7d4d79eabd">
Nov 18 18:36:58 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 18 18:36:58 user nova-compute[74692]:         </nova:port>
Nov 18 18:36:58 user nova-compute[74692]:       </nova:ports>
Nov 18 18:36:58 user nova-compute[74692]:     </nova:instance>
Nov 18 18:36:58 user nova-compute[74692]:   </metadata>
Nov 18 18:36:58 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:36:58 user nova-compute[74692]:     <system>
Nov 18 18:36:58 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:36:58 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:36:58 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:36:58 user nova-compute[74692]:       <entry name="serial">576a5f25-56f7-49d4-9fdc-1429f588f9e3</entry>
Nov 18 18:36:58 user nova-compute[74692]:       <entry name="uuid">576a5f25-56f7-49d4-9fdc-1429f588f9e3</entry>
Nov 18 18:36:58 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:36:58 user nova-compute[74692]:     </system>
Nov 18 18:36:58 user nova-compute[74692]:   </sysinfo>
Nov 18 18:36:58 user nova-compute[74692]:   <os>
Nov 18 18:36:58 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:36:58 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:36:58 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:36:58 user nova-compute[74692]:   </os>
Nov 18 18:36:58 user nova-compute[74692]:   <features>
Nov 18 18:36:58 user nova-compute[74692]:     <acpi/>
Nov 18 18:36:58 user nova-compute[74692]:     <apic/>
Nov 18 18:36:58 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:36:58 user nova-compute[74692]:   </features>
Nov 18 18:36:58 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:36:58 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:36:58 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:36:58 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:36:58 user nova-compute[74692]:   </clock>
Nov 18 18:36:58 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:36:58 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:36:58 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:36:58 user nova-compute[74692]:   </cpu>
Nov 18 18:36:58 user nova-compute[74692]:   <devices>
Nov 18 18:36:58 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:36:58 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:36:58 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk"/>
Nov 18 18:36:58 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:36:58 user nova-compute[74692]:     </disk>
Nov 18 18:36:58 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:36:58 user nova-compute[74692]:       <mac address="fa:16:3e:77:21:64"/>
Nov 18 18:36:58 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:36:58 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:36:58 user nova-compute[74692]:       <target dev="tap8f2146d5-7f"/>
Nov 18 18:36:58 user nova-compute[74692]:     </interface>
Nov 18 18:36:58 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:36:58 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/console.log" append="off"/>
Nov 18 18:36:58 user nova-compute[74692]:     </serial>
Nov 18 18:36:58 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:36:58 user nova-compute[74692]:     <video>
Nov 18 18:36:58 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:36:58 user nova-compute[74692]:     </video>
Nov 18 18:36:58 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:36:58 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:36:58 user nova-compute[74692]:     </rng>
Nov 18 18:36:58 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:36:58 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:36:58 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:36:58 user nova-compute[74692]:     </memballoon>
Nov 18 18:36:58 user nova-compute[74692]:   </devices>
Nov 18 18:36:58 user nova-compute[74692]: </domain>
Nov 18 18:36:58 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1510851468',display_name='tempest-SnapshotDataIntegrityTests-server-1510851468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1510851468',id=25,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDi0O7xQG1rj/A+Q8omoIqLs2ppwaYYia4OQ6Tkrg6rnpqzhULLedUwtoB6naepamiKyou2Y8BKUPHX3E+mIVZqXSra8mLMdy7yKYdTwe/ep0Ik7rsRgvM+Q34m6CGhiyA==',key_name='tempest-keypair-374358210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f5e045b95b64117a1f7319ada089654',ramdisk_id='',reservation_id='r-9v8l0tav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1481466',owner_user_name='tempest-SnapshotDataIntegrityTests-1481466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74039dc13ac4a03ba772f5b87296e20',uuid=576a5f25-56f7-49d4-9fdc-1429f588f9e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "address": "fa:16:3e:77:21:64", "network": {"id": "eae777ed-faa6-4132-b374-480aab64d54c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1942002881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5e045b95b64117a1f7319ada089654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2146d5-7f", "ovs_interfaceid": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Converting VIF {"id": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "address": "fa:16:3e:77:21:64", "network": {"id": "eae777ed-faa6-4132-b374-480aab64d54c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1942002881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5e045b95b64117a1f7319ada089654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2146d5-7f", "ovs_interfaceid": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:64,bridge_name='br-int',has_traffic_filtering=True,id=8f2146d5-7fed-448c-a056-be7d4d79eabd,network=Network(eae777ed-faa6-4132-b374-480aab64d54c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2146d5-7f') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG os_vif [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:64,bridge_name='br-int',has_traffic_filtering=True,id=8f2146d5-7fed-448c-a056-be7d4d79eabd,network=Network(eae777ed-faa6-4132-b374-480aab64d54c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2146d5-7f') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d1a2f41-c14b-5a8f-882d-e6cb440db5db', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f2146d5-7f, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f2146d5-7f, col_values=(('qos', UUID('9803db4a-0cb2-40c4-8a11-38d0fdcdbaed')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f2146d5-7f, col_values=(('external_ids', {'iface-id': '8f2146d5-7fed-448c-a056-be7d4d79eabd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:21:64', 'vm-uuid': '576a5f25-56f7-49d4-9fdc-1429f588f9e3'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:58 user nova-compute[74692]: INFO os_vif [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:64,bridge_name='br-int',has_traffic_filtering=True,id=8f2146d5-7fed-448c-a056-be7d4d79eabd,network=Network(eae777ed-faa6-4132-b374-480aab64d54c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2146d5-7f')
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] No VIF found with MAC fa:16:3e:77:21:64, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:36:59 user nova-compute[74692]: DEBUG nova.network.neutron [req-91a35b35-dbfa-4dc5-ba97-b27df0400c32 req-996c5adb-e923-4716-9879-7961208c4600 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Updated VIF entry in instance network info cache for port 8f2146d5-7fed-448c-a056-be7d4d79eabd. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:36:59 user nova-compute[74692]: DEBUG nova.network.neutron [req-91a35b35-dbfa-4dc5-ba97-b27df0400c32 req-996c5adb-e923-4716-9879-7961208c4600 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Updating instance_info_cache with network_info: [{"id": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "address": "fa:16:3e:77:21:64", "network": {"id": "eae777ed-faa6-4132-b374-480aab64d54c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1942002881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5e045b95b64117a1f7319ada089654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2146d5-7f", "ovs_interfaceid": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:36:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91a35b35-dbfa-4dc5-ba97-b27df0400c32 req-996c5adb-e923-4716-9879-7961208c4600 service nova] Releasing lock "refresh_cache-576a5f25-56f7-49d4-9fdc-1429f588f9e3" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:36:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-12625bbd-c980-4400-a2c9-42ecdbcdb66a req-b7d7890d-2685-400d-a1f5-73ecfe12d8e1 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-12625bbd-c980-4400-a2c9-42ecdbcdb66a req-b7d7890d-2685-400d-a1f5-73ecfe12d8e1 service nova] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-12625bbd-c980-4400-a2c9-42ecdbcdb66a req-b7d7890d-2685-400d-a1f5-73ecfe12d8e1 service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-12625bbd-c980-4400-a2c9-42ecdbcdb66a req-b7d7890d-2685-400d-a1f5-73ecfe12d8e1 service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-12625bbd-c980-4400-a2c9-42ecdbcdb66a req-b7d7890d-2685-400d-a1f5-73ecfe12d8e1 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] No waiting events found dispatching network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:00 user nova-compute[74692]: WARNING nova.compute.manager [req-12625bbd-c980-4400-a2c9-42ecdbcdb66a req-b7d7890d-2685-400d-a1f5-73ecfe12d8e1 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received unexpected event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 for instance with vm_state stopped and task_state powering-on.
Nov 18 18:37:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-12625bbd-c980-4400-a2c9-42ecdbcdb66a req-b7d7890d-2685-400d-a1f5-73ecfe12d8e1 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-12625bbd-c980-4400-a2c9-42ecdbcdb66a req-b7d7890d-2685-400d-a1f5-73ecfe12d8e1 service nova] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-12625bbd-c980-4400-a2c9-42ecdbcdb66a req-b7d7890d-2685-400d-a1f5-73ecfe12d8e1 service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-12625bbd-c980-4400-a2c9-42ecdbcdb66a req-b7d7890d-2685-400d-a1f5-73ecfe12d8e1 service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-12625bbd-c980-4400-a2c9-42ecdbcdb66a req-b7d7890d-2685-400d-a1f5-73ecfe12d8e1 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] No waiting events found dispatching network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:00 user nova-compute[74692]: WARNING nova.compute.manager [req-12625bbd-c980-4400-a2c9-42ecdbcdb66a req-b7d7890d-2685-400d-a1f5-73ecfe12d8e1 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received unexpected event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 for instance with vm_state stopped and task_state powering-on.
Nov 18 18:37:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-ee4cc211-4466-4dbc-ba71-729776045c04 req-06199282-aae2-4aec-b0b7-6d2f53face59 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Received event network-vif-plugged-8f2146d5-7fed-448c-a056-be7d4d79eabd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ee4cc211-4466-4dbc-ba71-729776045c04 req-06199282-aae2-4aec-b0b7-6d2f53face59 service nova] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ee4cc211-4466-4dbc-ba71-729776045c04 req-06199282-aae2-4aec-b0b7-6d2f53face59 service nova] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ee4cc211-4466-4dbc-ba71-729776045c04 req-06199282-aae2-4aec-b0b7-6d2f53face59 service nova] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-ee4cc211-4466-4dbc-ba71-729776045c04 req-06199282-aae2-4aec-b0b7-6d2f53face59 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] No waiting events found dispatching network-vif-plugged-8f2146d5-7fed-448c-a056-be7d4d79eabd {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:00 user nova-compute[74692]: WARNING nova.compute.manager [req-ee4cc211-4466-4dbc-ba71-729776045c04 req-06199282-aae2-4aec-b0b7-6d2f53face59 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Received unexpected event network-vif-plugged-8f2146d5-7fed-448c-a056-be7d4d79eabd for instance with vm_state building and task_state spawning.
Nov 18 18:37:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:00 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:37:00 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Instance rebooted successfully.
Nov 18 18:37:00 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0f2f50ba-dafa-45c0-908a-afa2e1951de7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:37:02 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:37:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:37:02 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Instance spawned successfully.
Nov 18 18:37:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:37:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:37:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:37:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:37:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:37:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:37:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:37:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-63641031-00aa-43d1-b317-b5f18ecf6b3d req-5f20631e-eba9-4032-bc1a-67e685e81ff4 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Received event network-vif-plugged-8f2146d5-7fed-448c-a056-be7d4d79eabd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-63641031-00aa-43d1-b317-b5f18ecf6b3d req-5f20631e-eba9-4032-bc1a-67e685e81ff4 service nova] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-63641031-00aa-43d1-b317-b5f18ecf6b3d req-5f20631e-eba9-4032-bc1a-67e685e81ff4 service nova] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-63641031-00aa-43d1-b317-b5f18ecf6b3d req-5f20631e-eba9-4032-bc1a-67e685e81ff4 service nova] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-63641031-00aa-43d1-b317-b5f18ecf6b3d req-5f20631e-eba9-4032-bc1a-67e685e81ff4 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] No waiting events found dispatching network-vif-plugged-8f2146d5-7fed-448c-a056-be7d4d79eabd {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:02 user nova-compute[74692]: WARNING nova.compute.manager [req-63641031-00aa-43d1-b317-b5f18ecf6b3d req-5f20631e-eba9-4032-bc1a-67e685e81ff4 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Received unexpected event network-vif-plugged-8f2146d5-7fed-448c-a056-be7d4d79eabd for instance with vm_state building and task_state spawning.
Nov 18 18:37:02 user nova-compute[74692]: INFO nova.compute.manager [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 18 18:37:02 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:37:02 user nova-compute[74692]: INFO nova.compute.manager [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Took 6.43 seconds to build instance.
Nov 18 18:37:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9fd5b653-81a0-4e2e-9532-d0e081d51cbd tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.525s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:07 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:37:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:09 user nova-compute[74692]: INFO nova.compute.manager [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Rescuing
Nov 18 18:37:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:37:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquired lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:37:09 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:37:09 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:37:09 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Updating instance_info_cache with network_info: [{"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:37:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Releasing lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:37:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:09 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-81e75bb9-3675-4ebe-bd55-d5e02a159eec req-389c8578-bfeb-4785-b794-958dcf74e924 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-unplugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-81e75bb9-3675-4ebe-bd55-d5e02a159eec req-389c8578-bfeb-4785-b794-958dcf74e924 service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-81e75bb9-3675-4ebe-bd55-d5e02a159eec req-389c8578-bfeb-4785-b794-958dcf74e924 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-81e75bb9-3675-4ebe-bd55-d5e02a159eec req-389c8578-bfeb-4785-b794-958dcf74e924 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-81e75bb9-3675-4ebe-bd55-d5e02a159eec req-389c8578-bfeb-4785-b794-958dcf74e924 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-unplugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:10 user nova-compute[74692]: WARNING nova.compute.manager [req-81e75bb9-3675-4ebe-bd55-d5e02a159eec req-389c8578-bfeb-4785-b794-958dcf74e924 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received unexpected event network-vif-unplugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with vm_state active and task_state rescuing.
Nov 18 18:37:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:10 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Instance destroyed successfully.
Nov 18 18:37:10 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Attempting rescue
Nov 18 18:37:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74692) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Instance directory exists: not creating {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 18:37:10 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Creating image(s)
Nov 18 18:37:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "/opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "/opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "/opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7540540c-af3e-4992-8756-3497a3bd4bf6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.188s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.rescue {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.rescue" returned: 0 in 0.054s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'migration_context' on Instance uuid 7540540c-af3e-4992-8756-3497a3bd4bf6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.objects.base [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Object Instance<7540540c-af3e-4992-8756-3497a3bd4bf6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Start _get_guest_xml network_info=[{"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "vif_mac": "fa:16:3e:05:a8:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'resources' on Instance uuid 7540540c-af3e-4992-8756-3497a3bd4bf6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.objects.base [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Object Instance<7540540c-af3e-4992-8756-3497a3bd4bf6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'numa_topology' on Instance uuid 7540540c-af3e-4992-8756-3497a3bd4bf6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.objects.base [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Object Instance<7540540c-af3e-4992-8756-3497a3bd4bf6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:37:11 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:37:11 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7540540c-af3e-4992-8756-3497a3bd4bf6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.objects.base [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Object Instance<7540540c-af3e-4992-8756-3497a3bd4bf6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-165218259',display_name='tempest-ServerRescueNegativeTestJSON-server-165218259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-165218259',id=14,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:32:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fead685ad47d4e96bb7c5225029f82ce',ramdisk_id='',reservation_id='r-w164i9re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-88342386',owner_user_name='tempest-ServerRescueNegativeTestJSON-88342386-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:32:35Z,user_data=None,user_id='c418956015544fb8ac0a8acb6af6aacd',uuid=7540540c-af3e-4992-8756-3497a3bd4bf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "vif_mac": "fa:16:3e:05:a8:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converting VIF {"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "vif_mac": "fa:16:3e:05:a8:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=256c4bff-9e08-4f42-9a9a-ba78ede662e8,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256c4bff-9e') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'pci_devices' on Instance uuid 7540540c-af3e-4992-8756-3497a3bd4bf6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.objects.base [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Object Instance<7540540c-af3e-4992-8756-3497a3bd4bf6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:37:11 user nova-compute[74692]:   <uuid>7540540c-af3e-4992-8756-3497a3bd4bf6</uuid>
Nov 18 18:37:11 user nova-compute[74692]:   <name>instance-0000000e</name>
Nov 18 18:37:11 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:37:11 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:37:11 user nova-compute[74692]:   <metadata>
Nov 18 18:37:11 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:37:11 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:37:11 user nova-compute[74692]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-165218259</nova:name>
Nov 18 18:37:11 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:37:11</nova:creationTime>
Nov 18 18:37:11 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:37:11 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:37:11 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:37:11 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:37:11 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:37:11 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:37:11 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:37:11 user nova-compute[74692]:       <nova:owner>
Nov 18 18:37:11 user nova-compute[74692]:         <nova:user uuid="c418956015544fb8ac0a8acb6af6aacd">tempest-ServerRescueNegativeTestJSON-88342386-project-member</nova:user>
Nov 18 18:37:11 user nova-compute[74692]:         <nova:project uuid="fead685ad47d4e96bb7c5225029f82ce">tempest-ServerRescueNegativeTestJSON-88342386</nova:project>
Nov 18 18:37:11 user nova-compute[74692]:       </nova:owner>
Nov 18 18:37:11 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:37:11 user nova-compute[74692]:       <nova:ports>
Nov 18 18:37:11 user nova-compute[74692]:         <nova:port uuid="256c4bff-9e08-4f42-9a9a-ba78ede662e8">
Nov 18 18:37:11 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 18 18:37:11 user nova-compute[74692]:         </nova:port>
Nov 18 18:37:11 user nova-compute[74692]:       </nova:ports>
Nov 18 18:37:11 user nova-compute[74692]:     </nova:instance>
Nov 18 18:37:11 user nova-compute[74692]:   </metadata>
Nov 18 18:37:11 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:37:11 user nova-compute[74692]:     <system>
Nov 18 18:37:11 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:37:11 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:37:11 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:37:11 user nova-compute[74692]:       <entry name="serial">7540540c-af3e-4992-8756-3497a3bd4bf6</entry>
Nov 18 18:37:11 user nova-compute[74692]:       <entry name="uuid">7540540c-af3e-4992-8756-3497a3bd4bf6</entry>
Nov 18 18:37:11 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:37:11 user nova-compute[74692]:     </system>
Nov 18 18:37:11 user nova-compute[74692]:   </sysinfo>
Nov 18 18:37:11 user nova-compute[74692]:   <os>
Nov 18 18:37:11 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:37:11 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:37:11 user nova-compute[74692]:   </os>
Nov 18 18:37:11 user nova-compute[74692]:   <features>
Nov 18 18:37:11 user nova-compute[74692]:     <acpi/>
Nov 18 18:37:11 user nova-compute[74692]:     <apic/>
Nov 18 18:37:11 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:37:11 user nova-compute[74692]:   </features>
Nov 18 18:37:11 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:37:11 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:37:11 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:37:11 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:37:11 user nova-compute[74692]:   </clock>
Nov 18 18:37:11 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:37:11 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:37:11 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:37:11 user nova-compute[74692]:   </cpu>
Nov 18 18:37:11 user nova-compute[74692]:   <devices>
Nov 18 18:37:11 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:37:11 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:37:11 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.rescue"/>
Nov 18 18:37:11 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:37:11 user nova-compute[74692]:     </disk>
Nov 18 18:37:11 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:37:11 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:37:11 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk"/>
Nov 18 18:37:11 user nova-compute[74692]:       <target dev="vdb" bus="virtio"/>
Nov 18 18:37:11 user nova-compute[74692]:     </disk>
Nov 18 18:37:11 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:37:11 user nova-compute[74692]:       <mac address="fa:16:3e:05:a8:7e"/>
Nov 18 18:37:11 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:37:11 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:37:11 user nova-compute[74692]:       <target dev="tap256c4bff-9e"/>
Nov 18 18:37:11 user nova-compute[74692]:     </interface>
Nov 18 18:37:11 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:37:11 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/console.log" append="off"/>
Nov 18 18:37:11 user nova-compute[74692]:     </serial>
Nov 18 18:37:11 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:37:11 user nova-compute[74692]:     <video>
Nov 18 18:37:11 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:37:11 user nova-compute[74692]:     </video>
Nov 18 18:37:11 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:37:11 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:37:11 user nova-compute[74692]:     </rng>
Nov 18 18:37:11 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:37:11 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:37:11 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:37:11 user nova-compute[74692]:     </memballoon>
Nov 18 18:37:11 user nova-compute[74692]:   </devices>
Nov 18 18:37:11 user nova-compute[74692]: </domain>
Nov 18 18:37:11 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:37:11 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Instance destroyed successfully.
Nov 18 18:37:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No VIF found with MAC fa:16:3e:05:a8:7e, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG nova.compute.manager [req-0f3f1d17-4a14-4df3-95a0-1fb9fb472071 req-36874134-4c7d-4db1-9569-b5628f608a63 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0f3f1d17-4a14-4df3-95a0-1fb9fb472071 req-36874134-4c7d-4db1-9569-b5628f608a63 service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0f3f1d17-4a14-4df3-95a0-1fb9fb472071 req-36874134-4c7d-4db1-9569-b5628f608a63 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0f3f1d17-4a14-4df3-95a0-1fb9fb472071 req-36874134-4c7d-4db1-9569-b5628f608a63 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG nova.compute.manager [req-0f3f1d17-4a14-4df3-95a0-1fb9fb472071 req-36874134-4c7d-4db1-9569-b5628f608a63 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:12 user nova-compute[74692]: WARNING nova.compute.manager [req-0f3f1d17-4a14-4df3-95a0-1fb9fb472071 req-36874134-4c7d-4db1-9569-b5628f608a63 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received unexpected event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with vm_state active and task_state rescuing.
Nov 18 18:37:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:12 user nova-compute[74692]: INFO nova.compute.manager [None req-07cfe171-18e7-45bc-b943-0a520b398fe8 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Unrescuing
Nov 18 18:37:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-07cfe171-18e7-45bc-b943-0a520b398fe8 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-07cfe171-18e7-45bc-b943-0a520b398fe8 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquired lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG nova.network.neutron [None req-07cfe171-18e7-45bc-b943-0a520b398fe8 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:37:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:37:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:37:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG nova.network.neutron [None req-07cfe171-18e7-45bc-b943-0a520b398fe8 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Updating instance_info_cache with network_info: [{"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-07cfe171-18e7-45bc-b943-0a520b398fe8 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Releasing lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG nova.objects.instance [None req-07cfe171-18e7-45bc-b943-0a520b398fe8 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lazy-loading 'flavor' on Instance uuid 153d4723-7ede-41b3-9f64-a0487f617ed2 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-0f80dd98-f366-428c-9ed9-dea8cf243bae req-8b0288f1-01ae-4b9c-b3e7-436e4aeec8f2 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0f80dd98-f366-428c-9ed9-dea8cf243bae req-8b0288f1-01ae-4b9c-b3e7-436e4aeec8f2 service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0f80dd98-f366-428c-9ed9-dea8cf243bae req-8b0288f1-01ae-4b9c-b3e7-436e4aeec8f2 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0f80dd98-f366-428c-9ed9-dea8cf243bae req-8b0288f1-01ae-4b9c-b3e7-436e4aeec8f2 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-0f80dd98-f366-428c-9ed9-dea8cf243bae req-8b0288f1-01ae-4b9c-b3e7-436e4aeec8f2 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:14 user nova-compute[74692]: WARNING nova.compute.manager [req-0f80dd98-f366-428c-9ed9-dea8cf243bae req-8b0288f1-01ae-4b9c-b3e7-436e4aeec8f2 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received unexpected event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with vm_state active and task_state rescuing.
Nov 18 18:37:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-0f80dd98-f366-428c-9ed9-dea8cf243bae req-8b0288f1-01ae-4b9c-b3e7-436e4aeec8f2 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0f80dd98-f366-428c-9ed9-dea8cf243bae req-8b0288f1-01ae-4b9c-b3e7-436e4aeec8f2 service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0f80dd98-f366-428c-9ed9-dea8cf243bae req-8b0288f1-01ae-4b9c-b3e7-436e4aeec8f2 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0f80dd98-f366-428c-9ed9-dea8cf243bae req-8b0288f1-01ae-4b9c-b3e7-436e4aeec8f2 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-0f80dd98-f366-428c-9ed9-dea8cf243bae req-8b0288f1-01ae-4b9c-b3e7-436e4aeec8f2 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:14 user nova-compute[74692]: WARNING nova.compute.manager [req-0f80dd98-f366-428c-9ed9-dea8cf243bae req-8b0288f1-01ae-4b9c-b3e7-436e4aeec8f2 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received unexpected event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with vm_state active and task_state rescuing.
Nov 18 18:37:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-efe0f37e-35a1-44fc-a680-719df58b9a52 req-bd7514ab-5fab-46c1-9ac2-aa51c101921b service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-changed-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-efe0f37e-35a1-44fc-a680-719df58b9a52 req-bd7514ab-5fab-46c1-9ac2-aa51c101921b service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Refreshing instance network info cache due to event network-changed-b1bcdb35-95f4-4010-b94b-75cfb5ec082e. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-efe0f37e-35a1-44fc-a680-719df58b9a52 req-bd7514ab-5fab-46c1-9ac2-aa51c101921b service nova] Acquiring lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-efe0f37e-35a1-44fc-a680-719df58b9a52 req-bd7514ab-5fab-46c1-9ac2-aa51c101921b service nova] Acquired lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG nova.network.neutron [req-efe0f37e-35a1-44fc-a680-719df58b9a52 req-bd7514ab-5fab-46c1-9ac2-aa51c101921b service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Refreshing network info cache for port b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:15 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Instance destroyed successfully.
Nov 18 18:37:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG nova.network.neutron [req-efe0f37e-35a1-44fc-a680-719df58b9a52 req-bd7514ab-5fab-46c1-9ac2-aa51c101921b service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Updated VIF entry in instance network info cache for port b1bcdb35-95f4-4010-b94b-75cfb5ec082e. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG nova.network.neutron [req-efe0f37e-35a1-44fc-a680-719df58b9a52 req-bd7514ab-5fab-46c1-9ac2-aa51c101921b service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Updating instance_info_cache with network_info: [{"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-efe0f37e-35a1-44fc-a680-719df58b9a52 req-bd7514ab-5fab-46c1-9ac2-aa51c101921b service nova] Releasing lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "df36071b-3fe8-48fb-9a17-818eb391779e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "df36071b-3fe8-48fb-9a17-818eb391779e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c6b462e4-dd8b-47f8-ae8f-0d3c2129dbef tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG nova.compute.manager [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:37:15 user nova-compute[74692]: INFO nova.compute.claims [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Claim successful on node user
Nov 18 18:37:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.814s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-unplugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-unplugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:16 user nova-compute[74692]: WARNING nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received unexpected event network-vif-unplugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:16 user nova-compute[74692]: WARNING nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received unexpected event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:16 user nova-compute[74692]: WARNING nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received unexpected event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:16 user nova-compute[74692]: WARNING nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received unexpected event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-unplugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-unplugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:16 user nova-compute[74692]: WARNING nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received unexpected event network-vif-unplugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:16 user nova-compute[74692]: WARNING nova.compute.manager [req-126ae037-5321-4367-8bdb-1a9f57369cfe req-22343e36-7b5e-401e-9278-3505f929c833 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received unexpected event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.network.neutron [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:37:16 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-4193b2ea-bd85-4c8e-bdc9-12f267a94b7b req-967715c2-e60c-4a25-a20f-ed8aa2e8aeb5 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-changed-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-4193b2ea-bd85-4c8e-bdc9-12f267a94b7b req-967715c2-e60c-4a25-a20f-ed8aa2e8aeb5 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Refreshing instance network info cache due to event network-changed-b1bcdb35-95f4-4010-b94b-75cfb5ec082e. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4193b2ea-bd85-4c8e-bdc9-12f267a94b7b req-967715c2-e60c-4a25-a20f-ed8aa2e8aeb5 service nova] Acquiring lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4193b2ea-bd85-4c8e-bdc9-12f267a94b7b req-967715c2-e60c-4a25-a20f-ed8aa2e8aeb5 service nova] Acquired lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.network.neutron [req-4193b2ea-bd85-4c8e-bdc9-12f267a94b7b req-967715c2-e60c-4a25-a20f-ed8aa2e8aeb5 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Refreshing network info cache for port b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.policy [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd126349e69864417bb5e02666efd534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb006c6267b42fab703cfc24d93052e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:37:16 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Creating image(s)
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "/opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "/opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "/opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.manager [None req-07cfe171-18e7-45bc-b943-0a520b398fe8 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-e48a75e5-ac65-4d0c-a436-58a2737457be req-356e4580-0b0b-4a0b-ac1a-f2dec514fce4 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e48a75e5-ac65-4d0c-a436-58a2737457be req-356e4580-0b0b-4a0b-ac1a-f2dec514fce4 service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e48a75e5-ac65-4d0c-a436-58a2737457be req-356e4580-0b0b-4a0b-ac1a-f2dec514fce4 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e48a75e5-ac65-4d0c-a436-58a2737457be req-356e4580-0b0b-4a0b-ac1a-f2dec514fce4 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-e48a75e5-ac65-4d0c-a436-58a2737457be req-356e4580-0b0b-4a0b-ac1a-f2dec514fce4 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:19 user nova-compute[74692]: WARNING nova.compute.manager [req-e48a75e5-ac65-4d0c-a436-58a2737457be req-356e4580-0b0b-4a0b-ac1a-f2dec514fce4 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received unexpected event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-e48a75e5-ac65-4d0c-a436-58a2737457be req-356e4580-0b0b-4a0b-ac1a-f2dec514fce4 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e48a75e5-ac65-4d0c-a436-58a2737457be req-356e4580-0b0b-4a0b-ac1a-f2dec514fce4 service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e48a75e5-ac65-4d0c-a436-58a2737457be req-356e4580-0b0b-4a0b-ac1a-f2dec514fce4 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e48a75e5-ac65-4d0c-a436-58a2737457be req-356e4580-0b0b-4a0b-ac1a-f2dec514fce4 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-e48a75e5-ac65-4d0c-a436-58a2737457be req-356e4580-0b0b-4a0b-ac1a-f2dec514fce4 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:19 user nova-compute[74692]: WARNING nova.compute.manager [req-e48a75e5-ac65-4d0c-a436-58a2737457be req-356e4580-0b0b-4a0b-ac1a-f2dec514fce4 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received unexpected event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 2.446s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:19 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:37:19 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7228MB free_disk=24.93050765991211GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.196s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk 1073741824" returned: 0 in 0.054s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 153d4723-7ede-41b3-9f64-a0487f617ed2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance c9c2ea43-093a-48ea-a464-373482eb1638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 873169f2-f1a7-4c16-8b8c-88767fea7fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance c80bfaf1-4f8f-4131-8591-d4c70a62a6ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance f3140c56-acf5-4cde-bd8c-273563540451 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 4a20894d-58ea-4ebb-a39f-9746ccb277eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance df36071b-3fe8-48fb-9a17-818eb391779e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.218s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:37:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Successfully created port: 1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-4193b2ea-bd85-4c8e-bdc9-12f267a94b7b req-967715c2-e60c-4a25-a20f-ed8aa2e8aeb5 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Updated VIF entry in instance network info cache for port b1bcdb35-95f4-4010-b94b-75cfb5ec082e. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-4193b2ea-bd85-4c8e-bdc9-12f267a94b7b req-967715c2-e60c-4a25-a20f-ed8aa2e8aeb5 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Updating instance_info_cache with network_info: [{"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4193b2ea-bd85-4c8e-bdc9-12f267a94b7b req-967715c2-e60c-4a25-a20f-ed8aa2e8aeb5 service nova] Releasing lock "refresh_cache-153d4723-7ede-41b3-9f64-a0487f617ed2" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Cannot resize image /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Ensure instance console log exists: /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.802s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Successfully updated port: 1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "refresh_cache-df36071b-3fe8-48fb-9a17-818eb391779e" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquired lock "refresh_cache-df36071b-3fe8-48fb-9a17-818eb391779e" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-56dfcba9-1cb4-492a-bab2-43cf5ffe4a50 req-8e93104e-9c14-4a15-bcd1-778f88201649 service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received event network-changed-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-56dfcba9-1cb4-492a-bab2-43cf5ffe4a50 req-8e93104e-9c14-4a15-bcd1-778f88201649 service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Refreshing instance network info cache due to event network-changed-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-56dfcba9-1cb4-492a-bab2-43cf5ffe4a50 req-8e93104e-9c14-4a15-bcd1-778f88201649 service nova] Acquiring lock "refresh_cache-df36071b-3fe8-48fb-9a17-818eb391779e" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:37:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.network.neutron [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Updating instance_info_cache with network_info: [{"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Releasing lock "refresh_cache-df36071b-3fe8-48fb-9a17-818eb391779e" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.compute.manager [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Instance network_info: |[{"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-56dfcba9-1cb4-492a-bab2-43cf5ffe4a50 req-8e93104e-9c14-4a15-bcd1-778f88201649 service nova] Acquired lock "refresh_cache-df36071b-3fe8-48fb-9a17-818eb391779e" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.network.neutron [req-56dfcba9-1cb4-492a-bab2-43cf5ffe4a50 req-8e93104e-9c14-4a15-bcd1-778f88201649 service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Refreshing network info cache for port 1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Start _get_guest_xml network_info=[{"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:37:21 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:37:21 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:37:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1958383659',display_name='tempest-tempest.common.compute-instance-1958383659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1958383659',id=26,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEepvhZskUYCdoSVABjCMgkFhwHmKrLIlSb5MlTcYjLz28VYCfC+0IzqpuCb73UGLxPXmt6l+8kjRWWYRsZLnLqwdnSFiKEGucHC8txk27WtUcZ44pwuuyqHzczpHxGwIg==',key_name='tempest-keypair-916762113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb006c6267b42fab703cfc24d93052e',ramdisk_id='',reservation_id='r-5javkpip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2047740053',owner_user_name='tempest-ServerActionsTestOtherA-2047740053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d126349e69864417bb5e02666efd534c',uuid=df36071b-3fe8-48fb-9a17-818eb391779e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converting VIF {"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:85:0a,bridge_name='br-int',has_traffic_filtering=True,id=1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a60bdb4-d4') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.objects.instance [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lazy-loading 'pci_devices' on Instance uuid df36071b-3fe8-48fb-9a17-818eb391779e {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:37:21 user nova-compute[74692]:   <uuid>df36071b-3fe8-48fb-9a17-818eb391779e</uuid>
Nov 18 18:37:21 user nova-compute[74692]:   <name>instance-0000001a</name>
Nov 18 18:37:21 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:37:21 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:37:21 user nova-compute[74692]:   <metadata>
Nov 18 18:37:21 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:37:21 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:37:21 user nova-compute[74692]:       <nova:name>tempest-tempest.common.compute-instance-1958383659</nova:name>
Nov 18 18:37:21 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:37:21</nova:creationTime>
Nov 18 18:37:21 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:37:21 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:37:21 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:37:21 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:37:21 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:37:21 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:37:21 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:37:21 user nova-compute[74692]:       <nova:owner>
Nov 18 18:37:21 user nova-compute[74692]:         <nova:user uuid="d126349e69864417bb5e02666efd534c">tempest-ServerActionsTestOtherA-2047740053-project-member</nova:user>
Nov 18 18:37:21 user nova-compute[74692]:         <nova:project uuid="fdb006c6267b42fab703cfc24d93052e">tempest-ServerActionsTestOtherA-2047740053</nova:project>
Nov 18 18:37:21 user nova-compute[74692]:       </nova:owner>
Nov 18 18:37:21 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:37:21 user nova-compute[74692]:       <nova:ports>
Nov 18 18:37:21 user nova-compute[74692]:         <nova:port uuid="1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6">
Nov 18 18:37:21 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 18:37:21 user nova-compute[74692]:         </nova:port>
Nov 18 18:37:21 user nova-compute[74692]:       </nova:ports>
Nov 18 18:37:21 user nova-compute[74692]:     </nova:instance>
Nov 18 18:37:21 user nova-compute[74692]:   </metadata>
Nov 18 18:37:21 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:37:21 user nova-compute[74692]:     <system>
Nov 18 18:37:21 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:37:21 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:37:21 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:37:21 user nova-compute[74692]:       <entry name="serial">df36071b-3fe8-48fb-9a17-818eb391779e</entry>
Nov 18 18:37:21 user nova-compute[74692]:       <entry name="uuid">df36071b-3fe8-48fb-9a17-818eb391779e</entry>
Nov 18 18:37:21 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:37:21 user nova-compute[74692]:     </system>
Nov 18 18:37:21 user nova-compute[74692]:   </sysinfo>
Nov 18 18:37:21 user nova-compute[74692]:   <os>
Nov 18 18:37:21 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:37:21 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:37:21 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:37:21 user nova-compute[74692]:   </os>
Nov 18 18:37:21 user nova-compute[74692]:   <features>
Nov 18 18:37:21 user nova-compute[74692]:     <acpi/>
Nov 18 18:37:21 user nova-compute[74692]:     <apic/>
Nov 18 18:37:21 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:37:21 user nova-compute[74692]:   </features>
Nov 18 18:37:21 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:37:21 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:37:21 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:37:21 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:37:21 user nova-compute[74692]:   </clock>
Nov 18 18:37:21 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:37:21 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:37:21 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:37:21 user nova-compute[74692]:   </cpu>
Nov 18 18:37:21 user nova-compute[74692]:   <devices>
Nov 18 18:37:21 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:37:21 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:37:21 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk"/>
Nov 18 18:37:21 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:37:21 user nova-compute[74692]:     </disk>
Nov 18 18:37:21 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:37:21 user nova-compute[74692]:       <mac address="fa:16:3e:a8:85:0a"/>
Nov 18 18:37:21 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:37:21 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:37:21 user nova-compute[74692]:       <target dev="tap1a60bdb4-d4"/>
Nov 18 18:37:21 user nova-compute[74692]:     </interface>
Nov 18 18:37:21 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:37:21 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/console.log" append="off"/>
Nov 18 18:37:21 user nova-compute[74692]:     </serial>
Nov 18 18:37:21 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:37:21 user nova-compute[74692]:     <video>
Nov 18 18:37:21 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:37:21 user nova-compute[74692]:     </video>
Nov 18 18:37:21 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:37:21 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:37:21 user nova-compute[74692]:     </rng>
Nov 18 18:37:21 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:37:21 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:37:21 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:37:21 user nova-compute[74692]:     </memballoon>
Nov 18 18:37:21 user nova-compute[74692]:   </devices>
Nov 18 18:37:21 user nova-compute[74692]: </domain>
Nov 18 18:37:21 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:37:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1958383659',display_name='tempest-tempest.common.compute-instance-1958383659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1958383659',id=26,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEepvhZskUYCdoSVABjCMgkFhwHmKrLIlSb5MlTcYjLz28VYCfC+0IzqpuCb73UGLxPXmt6l+8kjRWWYRsZLnLqwdnSFiKEGucHC8txk27WtUcZ44pwuuyqHzczpHxGwIg==',key_name='tempest-keypair-916762113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb006c6267b42fab703cfc24d93052e',ramdisk_id='',reservation_id='r-5javkpip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2047740053',owner_user_name='tempest-ServerActionsTestOtherA-2047740053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d126349e69864417bb5e02666efd534c',uuid=df36071b-3fe8-48fb-9a17-818eb391779e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converting VIF {"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:85:0a,bridge_name='br-int',has_traffic_filtering=True,id=1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a60bdb4-d4') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG os_vif [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:85:0a,bridge_name='br-int',has_traffic_filtering=True,id=1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a60bdb4-d4') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3192da7a-992b-58ae-b89e-a83a43f589e5', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a60bdb4-d4, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a60bdb4-d4, col_values=(('qos', UUID('108656b1-4429-47f8-8f37-71c43bdcc202')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a60bdb4-d4, col_values=(('external_ids', {'iface-id': '1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:85:0a', 'vm-uuid': 'df36071b-3fe8-48fb-9a17-818eb391779e'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:21 user nova-compute[74692]: INFO os_vif [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:85:0a,bridge_name='br-int',has_traffic_filtering=True,id=1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a60bdb4-d4')
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] No VIF found with MAC fa:16:3e:a8:85:0a, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.network.neutron [req-56dfcba9-1cb4-492a-bab2-43cf5ffe4a50 req-8e93104e-9c14-4a15-bcd1-778f88201649 service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Updated VIF entry in instance network info cache for port 1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG nova.network.neutron [req-56dfcba9-1cb4-492a-bab2-43cf5ffe4a50 req-8e93104e-9c14-4a15-bcd1-778f88201649 service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Updating instance_info_cache with network_info: [{"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:37:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-56dfcba9-1cb4-492a-bab2-43cf5ffe4a50 req-8e93104e-9c14-4a15-bcd1-778f88201649 service nova] Releasing lock "refresh_cache-df36071b-3fe8-48fb-9a17-818eb391779e" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:37:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:37:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:37:22 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:37:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-c9c2ea43-093a-48ea-a464-373482eb1638" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:37:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-c9c2ea43-093a-48ea-a464-373482eb1638" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:37:22 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:37:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:23 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Updating instance_info_cache with network_info: [{"id": "fe82ba82-5046-473f-b0a7-7212a924e5de", "address": "fa:16:3e:f3:04:2c", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe82ba82-50", "ovs_interfaceid": "fe82ba82-5046-473f-b0a7-7212a924e5de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:37:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-c9c2ea43-093a-48ea-a464-373482eb1638" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:37:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:37:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:37:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:37:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:37:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:37:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:37:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:37:23 user nova-compute[74692]: DEBUG nova.compute.manager [req-fa07993f-9de5-4395-9f30-597a21c8e2c4 req-f4615db9-2904-449e-9b03-1d5c2edf3b67 service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received event network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fa07993f-9de5-4395-9f30-597a21c8e2c4 req-f4615db9-2904-449e-9b03-1d5c2edf3b67 service nova] Acquiring lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fa07993f-9de5-4395-9f30-597a21c8e2c4 req-f4615db9-2904-449e-9b03-1d5c2edf3b67 service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fa07993f-9de5-4395-9f30-597a21c8e2c4 req-f4615db9-2904-449e-9b03-1d5c2edf3b67 service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:23 user nova-compute[74692]: DEBUG nova.compute.manager [req-fa07993f-9de5-4395-9f30-597a21c8e2c4 req-f4615db9-2904-449e-9b03-1d5c2edf3b67 service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] No waiting events found dispatching network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:23 user nova-compute[74692]: WARNING nova.compute.manager [req-fa07993f-9de5-4395-9f30-597a21c8e2c4 req-f4615db9-2904-449e-9b03-1d5c2edf3b67 service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received unexpected event network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 for instance with vm_state building and task_state spawning.
Nov 18 18:37:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:37:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:37:25 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Instance spawned successfully.
Nov 18 18:37:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:37:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:37:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:37:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:37:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:37:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:37:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:37:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-e26d22bd-d5a7-400f-8399-81494e34ce38 req-687ecaa8-10c5-4c45-98a5-f37d2559fdaf service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received event network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e26d22bd-d5a7-400f-8399-81494e34ce38 req-687ecaa8-10c5-4c45-98a5-f37d2559fdaf service nova] Acquiring lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e26d22bd-d5a7-400f-8399-81494e34ce38 req-687ecaa8-10c5-4c45-98a5-f37d2559fdaf service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e26d22bd-d5a7-400f-8399-81494e34ce38 req-687ecaa8-10c5-4c45-98a5-f37d2559fdaf service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-e26d22bd-d5a7-400f-8399-81494e34ce38 req-687ecaa8-10c5-4c45-98a5-f37d2559fdaf service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] No waiting events found dispatching network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:25 user nova-compute[74692]: WARNING nova.compute.manager [req-e26d22bd-d5a7-400f-8399-81494e34ce38 req-687ecaa8-10c5-4c45-98a5-f37d2559fdaf service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received unexpected event network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 for instance with vm_state building and task_state spawning.
Nov 18 18:37:25 user nova-compute[74692]: INFO nova.compute.manager [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Took 8.46 seconds to spawn the instance on the hypervisor.
Nov 18 18:37:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:37:25 user nova-compute[74692]: INFO nova.compute.manager [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Took 9.85 seconds to build instance.
Nov 18 18:37:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-584214e4-7890-4c73-94a4-75114002b8b5 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "df36071b-3fe8-48fb-9a17-818eb391779e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.975s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:26 user nova-compute[74692]: INFO nova.compute.manager [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Terminating instance
Nov 18 18:37:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:26 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Instance destroyed successfully.
Nov 18 18:37:26 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lazy-loading 'resources' on Instance uuid c80bfaf1-4f8f-4131-8591-d4c70a62a6ec {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:35:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1976852103',display_name='tempest-VolumesAdminNegativeTest-server-1976852103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1976852103',id=21,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:35:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1029d1e2110746d3af205df825090efa',ramdisk_id='',reservation_id='r-mnioclef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1838367509',owner_user_name='tempest-VolumesAdminNegativeTest-1838367509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:35:36Z,user_data=None,user_id='a97cd00e39c84616a0d114827b66687a',uuid=c80bfaf1-4f8f-4131-8591-d4c70a62a6ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e492ce0-54ec-436d-9a85-3a15428538bb", "address": "fa:16:3e:2f:4f:77", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e492ce0-54", "ovs_interfaceid": "4e492ce0-54ec-436d-9a85-3a15428538bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Converting VIF {"id": "4e492ce0-54ec-436d-9a85-3a15428538bb", "address": "fa:16:3e:2f:4f:77", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e492ce0-54", "ovs_interfaceid": "4e492ce0-54ec-436d-9a85-3a15428538bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4f:77,bridge_name='br-int',has_traffic_filtering=True,id=4e492ce0-54ec-436d-9a85-3a15428538bb,network=Network(8f7fd586-cc31-4828-bd1b-b9c67e164813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e492ce0-54') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG os_vif [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4f:77,bridge_name='br-int',has_traffic_filtering=True,id=4e492ce0-54ec-436d-9a85-3a15428538bb,network=Network(8f7fd586-cc31-4828-bd1b-b9c67e164813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e492ce0-54') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e492ce0-54, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=616c104f-91e4-48d9-b85d-7adb44926cb9) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:37:26 user nova-compute[74692]: INFO os_vif [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4f:77,bridge_name='br-int',has_traffic_filtering=True,id=4e492ce0-54ec-436d-9a85-3a15428538bb,network=Network(8f7fd586-cc31-4828-bd1b-b9c67e164813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e492ce0-54')
Nov 18 18:37:26 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Deleting instance files /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec_del
Nov 18 18:37:26 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Deletion of /opt/stack/data/nova/instances/c80bfaf1-4f8f-4131-8591-d4c70a62a6ec_del complete
Nov 18 18:37:26 user nova-compute[74692]: INFO nova.compute.manager [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 18 18:37:26 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:37:26 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:37:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-64ef6b80-75a8-4b0c-8d86-40c4fa2a33fe req-634969a9-3c13-41e0-b1c2-176fa7d578a8 service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Received event network-vif-unplugged-4e492ce0-54ec-436d-9a85-3a15428538bb {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-64ef6b80-75a8-4b0c-8d86-40c4fa2a33fe req-634969a9-3c13-41e0-b1c2-176fa7d578a8 service nova] Acquiring lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-64ef6b80-75a8-4b0c-8d86-40c4fa2a33fe req-634969a9-3c13-41e0-b1c2-176fa7d578a8 service nova] Lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-64ef6b80-75a8-4b0c-8d86-40c4fa2a33fe req-634969a9-3c13-41e0-b1c2-176fa7d578a8 service nova] Lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-64ef6b80-75a8-4b0c-8d86-40c4fa2a33fe req-634969a9-3c13-41e0-b1c2-176fa7d578a8 service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] No waiting events found dispatching network-vif-unplugged-4e492ce0-54ec-436d-9a85-3a15428538bb {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-64ef6b80-75a8-4b0c-8d86-40c4fa2a33fe req-634969a9-3c13-41e0-b1c2-176fa7d578a8 service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Received event network-vif-unplugged-4e492ce0-54ec-436d-9a85-3a15428538bb for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:37:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-64ef6b80-75a8-4b0c-8d86-40c4fa2a33fe req-634969a9-3c13-41e0-b1c2-176fa7d578a8 service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Received event network-vif-plugged-4e492ce0-54ec-436d-9a85-3a15428538bb {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-64ef6b80-75a8-4b0c-8d86-40c4fa2a33fe req-634969a9-3c13-41e0-b1c2-176fa7d578a8 service nova] Acquiring lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-64ef6b80-75a8-4b0c-8d86-40c4fa2a33fe req-634969a9-3c13-41e0-b1c2-176fa7d578a8 service nova] Lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-64ef6b80-75a8-4b0c-8d86-40c4fa2a33fe req-634969a9-3c13-41e0-b1c2-176fa7d578a8 service nova] Lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-64ef6b80-75a8-4b0c-8d86-40c4fa2a33fe req-634969a9-3c13-41e0-b1c2-176fa7d578a8 service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] No waiting events found dispatching network-vif-plugged-4e492ce0-54ec-436d-9a85-3a15428538bb {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:27 user nova-compute[74692]: WARNING nova.compute.manager [req-64ef6b80-75a8-4b0c-8d86-40c4fa2a33fe req-634969a9-3c13-41e0-b1c2-176fa7d578a8 service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Received unexpected event network-vif-plugged-4e492ce0-54ec-436d-9a85-3a15428538bb for instance with vm_state active and task_state deleting.
Nov 18 18:37:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:27 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:37:27 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Took 0.69 seconds to deallocate network for instance.
Nov 18 18:37:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:28 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:37:28 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:37:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:28 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Deleted allocations for instance c80bfaf1-4f8f-4131-8591-d4c70a62a6ec
Nov 18 18:37:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3a4b3df0-45cf-4254-8fea-9e13481723f3 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c80bfaf1-4f8f-4131-8591-d4c70a62a6ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.177s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-fd884e55-2e5b-46cc-96e2-d56f6d3924e5 req-c3f7da4f-e60b-4e55-80dc-5a3662db5679 service nova] [instance: c80bfaf1-4f8f-4131-8591-d4c70a62a6ec] Received event network-vif-deleted-4e492ce0-54ec-436d-9a85-3a15428538bb {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-35c13811-94c5-4be5-ac5f-1474504d29a5 req-ee680098-2a99-4d08-ae5a-71fa6c2edf67 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received event network-changed-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-35c13811-94c5-4be5-ac5f-1474504d29a5 req-ee680098-2a99-4d08-ae5a-71fa6c2edf67 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Refreshing instance network info cache due to event network-changed-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:37:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-35c13811-94c5-4be5-ac5f-1474504d29a5 req-ee680098-2a99-4d08-ae5a-71fa6c2edf67 service nova] Acquiring lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:37:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-35c13811-94c5-4be5-ac5f-1474504d29a5 req-ee680098-2a99-4d08-ae5a-71fa6c2edf67 service nova] Acquired lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:37:35 user nova-compute[74692]: DEBUG nova.network.neutron [req-35c13811-94c5-4be5-ac5f-1474504d29a5 req-ee680098-2a99-4d08-ae5a-71fa6c2edf67 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Refreshing network info cache for port 1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:37:35 user nova-compute[74692]: DEBUG nova.network.neutron [req-35c13811-94c5-4be5-ac5f-1474504d29a5 req-ee680098-2a99-4d08-ae5a-71fa6c2edf67 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Updated VIF entry in instance network info cache for port 1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:37:35 user nova-compute[74692]: DEBUG nova.network.neutron [req-35c13811-94c5-4be5-ac5f-1474504d29a5 req-ee680098-2a99-4d08-ae5a-71fa6c2edf67 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Updating instance_info_cache with network_info: [{"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:37:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-35c13811-94c5-4be5-ac5f-1474504d29a5 req-ee680098-2a99-4d08-ae5a-71fa6c2edf67 service nova] Releasing lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:37:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "f3140c56-acf5-4cde-bd8c-273563540451" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "f3140c56-acf5-4cde-bd8c-273563540451" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:39 user nova-compute[74692]: INFO nova.compute.manager [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Shelving
Nov 18 18:37:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-b7607811-9cd2-4341-9712-0d33a63faaa2 req-bad9a6d5-58c7-4a94-a81b-795c2539fb2e service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received event network-vif-unplugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b7607811-9cd2-4341-9712-0d33a63faaa2 req-bad9a6d5-58c7-4a94-a81b-795c2539fb2e service nova] Acquiring lock "f3140c56-acf5-4cde-bd8c-273563540451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b7607811-9cd2-4341-9712-0d33a63faaa2 req-bad9a6d5-58c7-4a94-a81b-795c2539fb2e service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b7607811-9cd2-4341-9712-0d33a63faaa2 req-bad9a6d5-58c7-4a94-a81b-795c2539fb2e service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-b7607811-9cd2-4341-9712-0d33a63faaa2 req-bad9a6d5-58c7-4a94-a81b-795c2539fb2e service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] No waiting events found dispatching network-vif-unplugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:39 user nova-compute[74692]: WARNING nova.compute.manager [req-b7607811-9cd2-4341-9712-0d33a63faaa2 req-bad9a6d5-58c7-4a94-a81b-795c2539fb2e service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received unexpected event network-vif-unplugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 for instance with vm_state active and task_state shelving.
Nov 18 18:37:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:39 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Instance destroyed successfully.
Nov 18 18:37:39 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Beginning cold snapshot process
Nov 18 18:37:39 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:37:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk /opt/stack/data/nova/instances/snapshots/tmp9ub9e0dw/72ffde437fbd4cb0b53abb48d2c14177 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:37:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk /opt/stack/data/nova/instances/snapshots/tmp9ub9e0dw/72ffde437fbd4cb0b53abb48d2c14177" returned: 0 in 0.958s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:37:40 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Snapshot extracted, beginning image upload
Nov 18 18:37:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-eb27a6d4-3aab-4246-aab6-c675c2dd1293 req-6e94dae3-55d0-4d33-835b-0083777b8658 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received event network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eb27a6d4-3aab-4246-aab6-c675c2dd1293 req-6e94dae3-55d0-4d33-835b-0083777b8658 service nova] Acquiring lock "f3140c56-acf5-4cde-bd8c-273563540451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eb27a6d4-3aab-4246-aab6-c675c2dd1293 req-6e94dae3-55d0-4d33-835b-0083777b8658 service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eb27a6d4-3aab-4246-aab6-c675c2dd1293 req-6e94dae3-55d0-4d33-835b-0083777b8658 service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-eb27a6d4-3aab-4246-aab6-c675c2dd1293 req-6e94dae3-55d0-4d33-835b-0083777b8658 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] No waiting events found dispatching network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:37:41 user nova-compute[74692]: WARNING nova.compute.manager [req-eb27a6d4-3aab-4246-aab6-c675c2dd1293 req-6e94dae3-55d0-4d33-835b-0083777b8658 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received unexpected event network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 for instance with vm_state active and task_state shelving_image_uploading.
Nov 18 18:37:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:43 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Snapshot image upload complete
Nov 18 18:37:43 user nova-compute[74692]: DEBUG nova.compute.manager [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:37:43 user nova-compute[74692]: INFO nova.compute.manager [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Shelve offloading
Nov 18 18:37:43 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Instance destroyed successfully.
Nov 18 18:37:43 user nova-compute[74692]: DEBUG nova.compute.manager [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:37:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:37:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquired lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:37:43 user nova-compute[74692]: DEBUG nova.network.neutron [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:37:43 user nova-compute[74692]: DEBUG nova.network.neutron [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Updating instance_info_cache with network_info: [{"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:37:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Releasing lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:37:45 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Instance destroyed successfully.
Nov 18 18:37:45 user nova-compute[74692]: DEBUG nova.objects.instance [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'resources' on Instance uuid f3140c56-acf5-4cde-bd8c-273563540451 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:35:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-539204829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-539204829',id=22,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOthkNNTFNmgshDO1rX52xwX9XJ2lO5YQxpyk5EEQ45Um8FR6Asz93Cp5prjGn6ddTJuKrAt7f9xLeqnxRgRZvpIVIpYI1gtVx59eDLtxaX+ya8P9H3FJZI+qzQmvQeDHw==',key_name='tempest-keypair-151002570',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:35:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1f169f28da1640d9b03b4ba44b4e7b7c',ramdisk_id='',reservation_id='r-f44p51kz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1768400085',owner_user_name='tempest-AttachVolumeShelveTestJSON-1768400085-project-member',shelved_at='2023-11-18T18:37:43.367812',shelved_host='user',shelved_image_id='5f236026-0c3a-41da-a305-aba3787aae1d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:37:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a005c7c46c46ad9217578412ec906f',uuid=f3140c56-acf5-4cde-bd8c-273563540451,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converting VIF {"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6b:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c5f8cc6-74') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG os_vif [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6b:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c5f8cc6-74') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c5f8cc6-74, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4016bc66-bcf6-4df1-9d2d-e985a8ce0a99) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG nova.compute.manager [req-d173e0a9-06dc-4aec-8794-5ca21e15546c req-2e4e520b-54e3-4f37-bbfd-bef87fc8d06c service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received event network-changed-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG nova.compute.manager [req-d173e0a9-06dc-4aec-8794-5ca21e15546c req-2e4e520b-54e3-4f37-bbfd-bef87fc8d06c service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Refreshing instance network info cache due to event network-changed-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d173e0a9-06dc-4aec-8794-5ca21e15546c req-2e4e520b-54e3-4f37-bbfd-bef87fc8d06c service nova] Acquiring lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d173e0a9-06dc-4aec-8794-5ca21e15546c req-2e4e520b-54e3-4f37-bbfd-bef87fc8d06c service nova] Acquired lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG nova.network.neutron [req-d173e0a9-06dc-4aec-8794-5ca21e15546c req-2e4e520b-54e3-4f37-bbfd-bef87fc8d06c service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Refreshing network info cache for port 1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:37:45 user nova-compute[74692]: INFO os_vif [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6b:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c5f8cc6-74')
Nov 18 18:37:45 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Deleting instance files /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451_del
Nov 18 18:37:45 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Deletion of /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451_del complete
Nov 18 18:37:45 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Deleted allocations for instance f3140c56-acf5-4cde-bd8c-273563540451
Nov 18 18:37:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG nova.objects.instance [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'numa_topology' on Instance uuid f3140c56-acf5-4cde-bd8c-273563540451 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG nova.objects.base [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Object Instance<f3140c56-acf5-4cde-bd8c-273563540451> lazy-loaded attributes: resources,numa_topology {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG nova.network.neutron [req-d173e0a9-06dc-4aec-8794-5ca21e15546c req-2e4e520b-54e3-4f37-bbfd-bef87fc8d06c service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Updated VIF entry in instance network info cache for port 1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG nova.network.neutron [req-d173e0a9-06dc-4aec-8794-5ca21e15546c req-2e4e520b-54e3-4f37-bbfd-bef87fc8d06c service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Updating instance_info_cache with network_info: [{"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d173e0a9-06dc-4aec-8794-5ca21e15546c req-2e4e520b-54e3-4f37-bbfd-bef87fc8d06c service nova] Releasing lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-dcfc8692-7310-4fdb-87e4-804a75a54d20 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "f3140c56-acf5-4cde-bd8c-273563540451" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.698s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:37:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:37:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:37:46 user nova-compute[74692]: INFO nova.compute.manager [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Detaching volume 38159c1d-b012-4fd2-8ce5-96216e7822e3
Nov 18 18:37:46 user nova-compute[74692]: INFO nova.virt.block_device [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Attempting to driver detach volume 38159c1d-b012-4fd2-8ce5-96216e7822e3 from mountpoint /dev/vdb
Nov 18 18:37:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Attempting to detach device vdb from instance 153d4723-7ede-41b3-9f64-a0487f617ed2 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:37:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:37:46 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:37:46 user nova-compute[74692]:   <source dev="/dev/sde"/>
Nov 18 18:37:46 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:37:46 user nova-compute[74692]:   <serial>38159c1d-b012-4fd2-8ce5-96216e7822e3</serial>
Nov 18 18:37:46 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:37:46 user nova-compute[74692]: </disk>
Nov 18 18:37:46 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:37:46 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Successfully detached device vdb from instance 153d4723-7ede-41b3-9f64-a0487f617ed2 from the persistent domain config.
Nov 18 18:37:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 153d4723-7ede-41b3-9f64-a0487f617ed2 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:37:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:37:46 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:37:46 user nova-compute[74692]:   <source dev="/dev/sde"/>
Nov 18 18:37:46 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:37:46 user nova-compute[74692]:   <serial>38159c1d-b012-4fd2-8ce5-96216e7822e3</serial>
Nov 18 18:37:46 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:37:46 user nova-compute[74692]: </disk>
Nov 18 18:37:46 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:37:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 153d4723-7ede-41b3-9f64-a0487f617ed2 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:37:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:37:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:03 user nova-compute[74692]: INFO nova.compute.manager [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Rescuing
Nov 18 18:38:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "refresh_cache-d17071fc-5d5b-4e06-8a47-05174014167c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:38:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquired lock "refresh_cache-d17071fc-5d5b-4e06-8a47-05174014167c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:38:03 user nova-compute[74692]: DEBUG nova.network.neutron [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:38:03 user nova-compute[74692]: DEBUG nova.network.neutron [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Updating instance_info_cache with network_info: [{"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:38:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Releasing lock "refresh_cache-d17071fc-5d5b-4e06-8a47-05174014167c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:38:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-604d94f6-41af-4d07-ba45-9f934a85e055 req-57a0f773-b8a2-4978-b6fb-bba0007d2132 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received event network-vif-unplugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:38:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-604d94f6-41af-4d07-ba45-9f934a85e055 req-57a0f773-b8a2-4978-b6fb-bba0007d2132 service nova] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-604d94f6-41af-4d07-ba45-9f934a85e055 req-57a0f773-b8a2-4978-b6fb-bba0007d2132 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-604d94f6-41af-4d07-ba45-9f934a85e055 req-57a0f773-b8a2-4978-b6fb-bba0007d2132 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-604d94f6-41af-4d07-ba45-9f934a85e055 req-57a0f773-b8a2-4978-b6fb-bba0007d2132 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] No waiting events found dispatching network-vif-unplugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:38:04 user nova-compute[74692]: WARNING nova.compute.manager [req-604d94f6-41af-4d07-ba45-9f934a85e055 req-57a0f773-b8a2-4978-b6fb-bba0007d2132 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received unexpected event network-vif-unplugged-14c60d63-2b64-480b-bd2e-8a26567cab7e for instance with vm_state active and task_state rescuing.
Nov 18 18:38:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Instance destroyed successfully.
Nov 18 18:38:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Attempting a stable device rescue
Nov 18 18:38:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74692) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 18:38:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Instance directory exists: not creating {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 18:38:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Creating image(s)
Nov 18 18:38:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "/opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "/opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "/opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:04 user nova-compute[74692]: DEBUG nova.objects.instance [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'trusted_certs' on Instance uuid d17071fc-5d5b-4e06-8a47-05174014167c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:38:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "253ee24bfac4c97da6febfa762d33b0bc2aa69ee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "253ee24bfac4c97da6febfa762d33b0bc2aa69ee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/253ee24bfac4c97da6febfa762d33b0bc2aa69ee.part --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/253ee24bfac4c97da6febfa762d33b0bc2aa69ee.part --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:05 user nova-compute[74692]: DEBUG nova.virt.images [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] 01c84daf-bb0d-42ef-9c01-ecad71f41b1b was qcow2, converting to raw {{(pid=74692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 18:38:05 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:38:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/253ee24bfac4c97da6febfa762d33b0bc2aa69ee.part /opt/stack/data/nova/instances/_base/253ee24bfac4c97da6febfa762d33b0bc2aa69ee.converted {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/253ee24bfac4c97da6febfa762d33b0bc2aa69ee.part /opt/stack/data/nova/instances/_base/253ee24bfac4c97da6febfa762d33b0bc2aa69ee.converted" returned: 0 in 0.314s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/253ee24bfac4c97da6febfa762d33b0bc2aa69ee.converted --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-eb788f31-c0a0-4a61-b2b3-c16176c9db45 req-834fe834-0943-4cb4-b0b6-e7c4d3cc87c5 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eb788f31-c0a0-4a61-b2b3-c16176c9db45 req-834fe834-0943-4cb4-b0b6-e7c4d3cc87c5 service nova] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eb788f31-c0a0-4a61-b2b3-c16176c9db45 req-834fe834-0943-4cb4-b0b6-e7c4d3cc87c5 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eb788f31-c0a0-4a61-b2b3-c16176c9db45 req-834fe834-0943-4cb4-b0b6-e7c4d3cc87c5 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-eb788f31-c0a0-4a61-b2b3-c16176c9db45 req-834fe834-0943-4cb4-b0b6-e7c4d3cc87c5 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] No waiting events found dispatching network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:38:06 user nova-compute[74692]: WARNING nova.compute.manager [req-eb788f31-c0a0-4a61-b2b3-c16176c9db45 req-834fe834-0943-4cb4-b0b6-e7c4d3cc87c5 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received unexpected event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e for instance with vm_state active and task_state rescuing.
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/253ee24bfac4c97da6febfa762d33b0bc2aa69ee.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "253ee24bfac4c97da6febfa762d33b0bc2aa69ee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.602s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "253ee24bfac4c97da6febfa762d33b0bc2aa69ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "253ee24bfac4c97da6febfa762d33b0bc2aa69ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/253ee24bfac4c97da6febfa762d33b0bc2aa69ee --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/253ee24bfac4c97da6febfa762d33b0bc2aa69ee --force-share --output=json" returned: 0 in 0.197s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/253ee24bfac4c97da6febfa762d33b0bc2aa69ee,backing_fmt=raw /opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/disk.rescue {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/253ee24bfac4c97da6febfa762d33b0bc2aa69ee,backing_fmt=raw /opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/disk.rescue" returned: 0 in 0.046s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "253ee24bfac4c97da6febfa762d33b0bc2aa69ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.objects.instance [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'migration_context' on Instance uuid d17071fc-5d5b-4e06-8a47-05174014167c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.objects.base [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Object Instance<d17071fc-5d5b-4e06-8a47-05174014167c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Start _get_guest_xml network_info=[{"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "vif_mac": "fa:16:3e:f2:01:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '01c84daf-bb0d-42ef-9c01-ecad71f41b1b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXzvMjCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd17071fc-5d5b-4e06-8a47-05174014167c', 'attached_at': '', 'detached_at': '', 'volume_id': 'f918f8b1-52ea-4a14-8217-1c1fe0d18962', 'serial': 'f918f8b1-52ea-4a14-8217-1c1fe0d18962'}, 'attachment_id': '9110e5cb-9405-4204-9b25-f9797a42cb60', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.objects.instance [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'resources' on Instance uuid d17071fc-5d5b-4e06-8a47-05174014167c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.objects.base [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Object Instance<d17071fc-5d5b-4e06-8a47-05174014167c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.objects.instance [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'numa_topology' on Instance uuid d17071fc-5d5b-4e06-8a47-05174014167c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.objects.base [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Object Instance<d17071fc-5d5b-4e06-8a47-05174014167c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:38:06 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:38:06 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.objects.instance [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'vcpu_model' on Instance uuid d17071fc-5d5b-4e06-8a47-05174014167c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.objects.base [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Object Instance<d17071fc-5d5b-4e06-8a47-05174014167c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXzvMjCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:38:06 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:38:06 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:38:06 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e42ae9-41a1-429d-9b99-c9feb66f84a2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LXzvMjCH\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 18 18:38:06 user nova-compute[74692]: node.name = iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:38:06 user nova-compute[74692]: node.tpgt = -1
Nov 18 18:38:06 user nova-compute[74692]: node.startup = automatic
Nov 18 18:38:06 user nova-compute[74692]: node.leading_login = No
Nov 18 18:38:06 user nova-compute[74692]: iface.iscsi_ifacename = default
Nov 18 18:38:06 user nova-compute[74692]: iface.net_ifacename = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.ipaddress = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.prefix_len = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.hwaddress = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.transport_name = tcp
Nov 18 18:38:06 user nova-compute[74692]: iface.initiatorname = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.state = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.vlan_id = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.vlan_priority = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.vlan_state = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.iface_num = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.mtu = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.port = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.bootproto = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.subnet_mask = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.gateway = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.dhcp_alt_client_id_state = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.dhcp_alt_client_id = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.dhcp_dns = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.dhcp_learn_iqn = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.dhcp_req_vendor_id_state = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.dhcp_vendor_id_state = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.dhcp_vendor_id = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.dhcp_slp_da = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.fragmentation = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.gratuitous_arp = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.incoming_forwarding = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.tos_state = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.tos = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.ttl = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.delayed_ack = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.tcp_nagle = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.tcp_wsf_state = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.tcp_wsf = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.tcp_timer_scale = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.tcp_timestamp = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.redirect = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.def_task_mgmt_timeout = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.header_digest = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.data_digest = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.immediate_data = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.initial_r2t = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.data_seq_inorder = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.data_pdu_inorder = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.erl = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.max_receive_data_len = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.first_burst_len = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.max_outstanding_r2t = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.max_burst_len = 0
Nov 18 18:38:06 user nova-compute[74692]: iface.chap_auth = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.bidi_chap = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.strict_login_compliance = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.discovery_auth = <empty>
Nov 18 18:38:06 user nova-compute[74692]: iface.discovery_logout = <empty>
Nov 18 18:38:06 user nova-compute[74692]: node.discovery_address = <empty>
Nov 18 18:38:06 user nova-compute[74692]: node.discovery_port = 0
Nov 18 18:38:06 user nova-compute[74692]: node.discovery_type = static
Nov 18 18:38:06 user nova-compute[74692]: node.session.initial_cmdsn = 0
Nov 18 18:38:06 user nova-compute[74692]: node.session.initial_login_retry_max = 8
Nov 18 18:38:06 user nova-compute[74692]: node.session.xmit_thread_priority = -20
Nov 18 18:38:06 user nova-compute[74692]: node.session.cmds_max = 128
Nov 18 18:38:06 user nova-compute[74692]: node.session.queue_depth = 32
Nov 18 18:38:06 user nova-compute[74692]: node.session.nr_sessions = 1
Nov 18 18:38:06 user nova-compute[74692]: node.session.auth.authmethod = CHAP
Nov 18 18:38:06 user nova-compute[74692]: node.session.auth.username = LXzvMjCH
Nov 18 18:38:06 user nova-compute[74692]: node.session.auth.password = ***
Nov 18 18:38:06 user nova-compute[74692]: node.session.auth.username_in = <empty>
Nov 18 18:38:06 user nova-compute[74692]: node.session.auth.password_in = <empty>
Nov 18 18:38:06 user nova-compute[74692]: node.session.auth.chap_algs = MD5
Nov 18 18:38:06 user nova-compute[74692]: node.session.timeo.replacement_timeout = 120
Nov 18 18:38:06 user nova-compute[74692]: node.session.err_timeo.abort_timeout = 15
Nov 18 18:38:06 user nova-compute[74692]: node.session.err_timeo.lu_reset_timeout = 30
Nov 18 18:38:06 user nova-compute[74692]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 18 18:38:06 user nova-compute[74692]: node.session.err_timeo.host_reset_timeout = 60
Nov 18 18:38:06 user nova-compute[74692]: node.session.iscsi.FastAbort = Yes
Nov 18 18:38:06 user nova-compute[74692]: node.session.iscsi.InitialR2T = No
Nov 18 18:38:06 user nova-compute[74692]: node.session.iscsi.ImmediateData = Yes
Nov 18 18:38:06 user nova-compute[74692]: node.session.iscsi.FirstBurstLength = 262144
Nov 18 18:38:06 user nova-compute[74692]: node.session.iscsi.MaxBurstLength = 16776192
Nov 18 18:38:06 user nova-compute[74692]: node.session.iscsi.DefaultTime2Retain = 0
Nov 18 18:38:06 user nova-compute[74692]: node.session.iscsi.DefaultTime2Wait = 2
Nov 18 18:38:06 user nova-compute[74692]: node.session.iscsi.MaxConnections = 1
Nov 18 18:38:06 user nova-compute[74692]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 18 18:38:06 user nova-compute[74692]: node.session.iscsi.ERL = 0
Nov 18 18:38:06 user nova-compute[74692]: node.session.scan = manual
Nov 18 18:38:06 user nova-compute[74692]: node.session.reopen_max = 0
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].address = 172.16.0.220
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].port = 3260
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].startup = manual
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].tcp.window_size = 524288
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].tcp.type_of_service = 0
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].timeo.logout_timeout = 15
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].timeo.login_timeout = 15
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].timeo.auth_timeout = 45
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].timeo.noop_out_interval = 5
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].timeo.noop_out_timeout = 5
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].iscsi.HeaderDigest = None
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].iscsi.DataDigest = None
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].iscsi.IFMarker = No
Nov 18 18:38:06 user nova-compute[74692]: node.conn[0].iscsi.OFMarker = No
Nov 18 18:38:06 user nova-compute[74692]: # END RECORD
Nov 18 18:38:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[531a8e1e-6b39-4835-87c1-8249a0bf8866]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cf3565-0028-49c5-af3d-63e6d1276359]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LXzvMjCH {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LXzvMjCH" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[13698e74-16c4-41b7-87b8-f2d7edf586e2]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LXzvMjCH'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e84eac-fe90-4f4f-b7de-fea50d46a540]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70b7462-434c-4e01-b1be-493966ac9d49]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:38:06 user nova-compute[74692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:38:06 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:38:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:38:06 user nova-compute[74692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:38:06 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:38:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.134s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] HCTL ('33', '0', '0', 0) found on session 29 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e335052-e42d-4872-b798-b803c384a110]: (4, ('0 0 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching for a device in session 29 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXzvMjCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.156s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] <== connect_volume: return (157ms) {'type': 'block', 'scsi_wwn': '23165363731636133', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165363731636133', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-677677591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-677677591',id=23,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:36:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='704ef46081d04fc7a0ed88456cbe9fe8',ramdisk_id='',reservation_id='r-428x2dz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-199647198',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:36:32Z,user_data=None,user_id='1233b31e12dc4d5796a60327d93c3bfb',uuid=d17071fc-5d5b-4e06-8a47-05174014167c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "vif_mac": "fa:16:3e:f2:01:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converting VIF {"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "vif_mac": "fa:16:3e:f2:01:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:01:49,bridge_name='br-int',has_traffic_filtering=True,id=14c60d63-2b64-480b-bd2e-8a26567cab7e,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c60d63-2b') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.objects.instance [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'pci_devices' on Instance uuid d17071fc-5d5b-4e06-8a47-05174014167c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.objects.base [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Object Instance<d17071fc-5d5b-4e06-8a47-05174014167c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:38:06 user nova-compute[74692]:   <uuid>d17071fc-5d5b-4e06-8a47-05174014167c</uuid>
Nov 18 18:38:06 user nova-compute[74692]:   <name>instance-00000017</name>
Nov 18 18:38:06 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:38:06 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:38:06 user nova-compute[74692]:   <metadata>
Nov 18 18:38:06 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:38:06 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:38:06 user nova-compute[74692]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-677677591</nova:name>
Nov 18 18:38:06 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:38:06</nova:creationTime>
Nov 18 18:38:06 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:38:06 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:38:06 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:38:06 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:38:06 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:38:06 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:38:06 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:38:06 user nova-compute[74692]:       <nova:owner>
Nov 18 18:38:06 user nova-compute[74692]:         <nova:user uuid="1233b31e12dc4d5796a60327d93c3bfb">tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member</nova:user>
Nov 18 18:38:06 user nova-compute[74692]:         <nova:project uuid="704ef46081d04fc7a0ed88456cbe9fe8">tempest-ServerBootFromVolumeStableRescueTest-199647198</nova:project>
Nov 18 18:38:06 user nova-compute[74692]:       </nova:owner>
Nov 18 18:38:06 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:38:06 user nova-compute[74692]:       <nova:ports>
Nov 18 18:38:06 user nova-compute[74692]:         <nova:port uuid="14c60d63-2b64-480b-bd2e-8a26567cab7e">
Nov 18 18:38:06 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 18:38:06 user nova-compute[74692]:         </nova:port>
Nov 18 18:38:06 user nova-compute[74692]:       </nova:ports>
Nov 18 18:38:06 user nova-compute[74692]:     </nova:instance>
Nov 18 18:38:06 user nova-compute[74692]:   </metadata>
Nov 18 18:38:06 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:38:06 user nova-compute[74692]:     <system>
Nov 18 18:38:06 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:38:06 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:38:06 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:38:06 user nova-compute[74692]:       <entry name="serial">d17071fc-5d5b-4e06-8a47-05174014167c</entry>
Nov 18 18:38:06 user nova-compute[74692]:       <entry name="uuid">d17071fc-5d5b-4e06-8a47-05174014167c</entry>
Nov 18 18:38:06 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:38:06 user nova-compute[74692]:     </system>
Nov 18 18:38:06 user nova-compute[74692]:   </sysinfo>
Nov 18 18:38:06 user nova-compute[74692]:   <os>
Nov 18 18:38:06 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:38:06 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:38:06 user nova-compute[74692]:   </os>
Nov 18 18:38:06 user nova-compute[74692]:   <features>
Nov 18 18:38:06 user nova-compute[74692]:     <acpi/>
Nov 18 18:38:06 user nova-compute[74692]:     <apic/>
Nov 18 18:38:06 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:38:06 user nova-compute[74692]:   </features>
Nov 18 18:38:06 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:38:06 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:38:06 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:38:06 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:38:06 user nova-compute[74692]:   </clock>
Nov 18 18:38:06 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:38:06 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:38:06 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:38:06 user nova-compute[74692]:   </cpu>
Nov 18 18:38:06 user nova-compute[74692]:   <devices>
Nov 18 18:38:06 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:38:06 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:38:06 user nova-compute[74692]:       <source dev="/dev/sdb"/>
Nov 18 18:38:06 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:38:06 user nova-compute[74692]:       <serial>f918f8b1-52ea-4a14-8217-1c1fe0d18962</serial>
Nov 18 18:38:06 user nova-compute[74692]:     </disk>
Nov 18 18:38:06 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:38:06 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:38:06 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/disk.rescue"/>
Nov 18 18:38:06 user nova-compute[74692]:       <target dev="vdb" bus="virtio"/>
Nov 18 18:38:06 user nova-compute[74692]:       <boot order="1"/>
Nov 18 18:38:06 user nova-compute[74692]:     </disk>
Nov 18 18:38:06 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:38:06 user nova-compute[74692]:       <mac address="fa:16:3e:f2:01:49"/>
Nov 18 18:38:06 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:38:06 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:38:06 user nova-compute[74692]:       <target dev="tap14c60d63-2b"/>
Nov 18 18:38:06 user nova-compute[74692]:     </interface>
Nov 18 18:38:06 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:38:06 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/console.log" append="off"/>
Nov 18 18:38:06 user nova-compute[74692]:     </serial>
Nov 18 18:38:06 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:38:06 user nova-compute[74692]:     <video>
Nov 18 18:38:06 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:38:06 user nova-compute[74692]:     </video>
Nov 18 18:38:06 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:38:06 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:38:06 user nova-compute[74692]:     </rng>
Nov 18 18:38:06 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:38:06 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:38:06 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:38:06 user nova-compute[74692]:     </memballoon>
Nov 18 18:38:06 user nova-compute[74692]:   </devices>
Nov 18 18:38:06 user nova-compute[74692]: </domain>
Nov 18 18:38:06 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:38:06 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Instance destroyed successfully.
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:38:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] No VIF found with MAC fa:16:3e:f2:01:49, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:38:07 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 153d4723-7ede-41b3-9f64-a0487f617ed2 is timed out.
Nov 18 18:38:07 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Successfully detached device vdb from instance 153d4723-7ede-41b3-9f64-a0487f617ed2 from the live domain config.
Nov 18 18:38:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhwRojrn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:38:07 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[57615fe1-0a85-4e0d-bcf0-8a659d304fa5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:38:07 user nova-compute[74692]: No targets found.
Nov 18 18:38:07 user nova-compute[74692]: iSNS:
Nov 18 18:38:07 user nova-compute[74692]: No targets found.
Nov 18 18:38:07 user nova-compute[74692]: STATIC:
Nov 18 18:38:07 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3
Nov 18 18:38:07 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:38:07 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:38:07 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c
Nov 18 18:38:07 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:38:07 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:38:07 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:38:07 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:38:07 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:38:07 user nova-compute[74692]: FIRMWARE:
Nov 18 18:38:07 user nova-compute[74692]: No targets found.
Nov 18 18:38:07 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:38:07 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:38:07 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc2e671-116c-4da7-bd4e-2dafe9d3bbdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[42711cd0-817d-4a0e-98cb-723dc1896ca7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:38:07 user nova-compute[74692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:38:07 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:38:07 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 (non-flash)
Nov 18 18:38:07 user nova-compute[74692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:38:07 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:38:07 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a4568670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3'): ({'sde'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Removing single pathed devices sde {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9018ffda-9369-4ad0-a580-a0258ab7bf98]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4a101f-b6e6-44ce-9d7e-7f24f0812e55]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Flushing IO for device /dev/sde {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.011s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[beed6e20-33d8-4210-8ea3-1c0dd20d6d57]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6430915-fee1-4c87-9cb2-44330477d841]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] SCSI volumes sde have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f61b3bc-b07e-437c-bb2b-4a535fe86cba]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c607302-47b5-4af2-b88a-64f720bfa761]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3, portal: 172.16.0.220,3260]
Nov 18 18:38:07 user nova-compute[74692]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3, portal: 172.16.0.220,3260] successful.
Nov 18 18:38:07 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38159c1d-b012-4fd2-8ce5-96216e7822e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a5f75d-ff0f-4745-a2b5-bdfc890233e6]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] <== disconnect_volume: return (279ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:07 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:38:08 user nova-compute[74692]: DEBUG nova.objects.instance [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lazy-loading 'flavor' on Instance uuid 153d4723-7ede-41b3-9f64-a0487f617ed2 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:38:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b8a55c0e-d5c5-4d92-aa35-083d23ebe602 tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.597s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:08 user nova-compute[74692]: DEBUG nova.compute.manager [req-643dd920-134d-4324-9afe-1b96b5ade85d req-d06fac8f-90a0-443d-88ce-bda8e62aa084 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:38:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-643dd920-134d-4324-9afe-1b96b5ade85d req-d06fac8f-90a0-443d-88ce-bda8e62aa084 service nova] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-643dd920-134d-4324-9afe-1b96b5ade85d req-d06fac8f-90a0-443d-88ce-bda8e62aa084 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-643dd920-134d-4324-9afe-1b96b5ade85d req-d06fac8f-90a0-443d-88ce-bda8e62aa084 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:08 user nova-compute[74692]: DEBUG nova.compute.manager [req-643dd920-134d-4324-9afe-1b96b5ade85d req-d06fac8f-90a0-443d-88ce-bda8e62aa084 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] No waiting events found dispatching network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:38:08 user nova-compute[74692]: WARNING nova.compute.manager [req-643dd920-134d-4324-9afe-1b96b5ade85d req-d06fac8f-90a0-443d-88ce-bda8e62aa084 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received unexpected event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e for instance with vm_state active and task_state rescuing.
Nov 18 18:38:08 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:38:10 user nova-compute[74692]: DEBUG nova.compute.manager [None req-7ed2b60f-4921-4435-bdf3-18d354f003d5 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:38:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-751104ac-ce13-497a-a150-1557e4a34288 req-ab43712b-c5eb-4b74-a0a3-6d089bbd76d0 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:38:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-751104ac-ce13-497a-a150-1557e4a34288 req-ab43712b-c5eb-4b74-a0a3-6d089bbd76d0 service nova] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-751104ac-ce13-497a-a150-1557e4a34288 req-ab43712b-c5eb-4b74-a0a3-6d089bbd76d0 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-751104ac-ce13-497a-a150-1557e4a34288 req-ab43712b-c5eb-4b74-a0a3-6d089bbd76d0 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-751104ac-ce13-497a-a150-1557e4a34288 req-ab43712b-c5eb-4b74-a0a3-6d089bbd76d0 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] No waiting events found dispatching network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:38:10 user nova-compute[74692]: WARNING nova.compute.manager [req-751104ac-ce13-497a-a150-1557e4a34288 req-ab43712b-c5eb-4b74-a0a3-6d089bbd76d0 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received unexpected event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e for instance with vm_state rescued and task_state None.
Nov 18 18:38:11 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:38:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:11 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:38:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:38:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:38:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:17 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:38:17 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:38:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7152MB free_disk=24.774925231933594GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:38:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 153d4723-7ede-41b3-9f64-a0487f617ed2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance c9c2ea43-093a-48ea-a464-373482eb1638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 873169f2-f1a7-4c16-8b8c-88767fea7fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 4a20894d-58ea-4ebb-a39f-9746ccb277eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance df36071b-3fe8-48fb-9a17-818eb391779e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:38:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "c9c2ea43-093a-48ea-a464-373482eb1638" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c9c2ea43-093a-48ea-a464-373482eb1638" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "c9c2ea43-093a-48ea-a464-373482eb1638-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c9c2ea43-093a-48ea-a464-373482eb1638-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c9c2ea43-093a-48ea-a464-373482eb1638-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:20 user nova-compute[74692]: INFO nova.compute.manager [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Terminating instance
Nov 18 18:38:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-dfb7ca55-160b-4652-9a9c-5849e93fbe01 req-26ad3bd5-3020-4191-8120-54013261fae6 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Received event network-vif-unplugged-fe82ba82-5046-473f-b0a7-7212a924e5de {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-dfb7ca55-160b-4652-9a9c-5849e93fbe01 req-26ad3bd5-3020-4191-8120-54013261fae6 service nova] Acquiring lock "c9c2ea43-093a-48ea-a464-373482eb1638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-dfb7ca55-160b-4652-9a9c-5849e93fbe01 req-26ad3bd5-3020-4191-8120-54013261fae6 service nova] Lock "c9c2ea43-093a-48ea-a464-373482eb1638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-dfb7ca55-160b-4652-9a9c-5849e93fbe01 req-26ad3bd5-3020-4191-8120-54013261fae6 service nova] Lock "c9c2ea43-093a-48ea-a464-373482eb1638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-dfb7ca55-160b-4652-9a9c-5849e93fbe01 req-26ad3bd5-3020-4191-8120-54013261fae6 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] No waiting events found dispatching network-vif-unplugged-fe82ba82-5046-473f-b0a7-7212a924e5de {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-dfb7ca55-160b-4652-9a9c-5849e93fbe01 req-26ad3bd5-3020-4191-8120-54013261fae6 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Received event network-vif-unplugged-fe82ba82-5046-473f-b0a7-7212a924e5de for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Instance destroyed successfully.
Nov 18 18:38:20 user nova-compute[74692]: DEBUG nova.objects.instance [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lazy-loading 'resources' on Instance uuid c9c2ea43-093a-48ea-a464-373482eb1638 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1186102364',display_name='tempest-VolumesAdminNegativeTest-server-1186102364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1186102364',id=16,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAF2Ywzij3VucBz1XLsbwKcgHwEsTK0Irec0nyxrif+FcUy4bo0LAMKR8naJ4FgnEke1cr9SguD/JRU4MFhyFldVLAtYbbeulntOYL3dMRM6QzqEIAV3IGludvP9//8kbw==',key_name='tempest-keypair-1475509525',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:32:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1029d1e2110746d3af205df825090efa',ramdisk_id='',reservation_id='r-q6ivqvhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1838367509',owner_user_name='tempest-VolumesAdminNegativeTest-1838367509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:32:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a97cd00e39c84616a0d114827b66687a',uuid=c9c2ea43-093a-48ea-a464-373482eb1638,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe82ba82-5046-473f-b0a7-7212a924e5de", "address": "fa:16:3e:f3:04:2c", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe82ba82-50", "ovs_interfaceid": "fe82ba82-5046-473f-b0a7-7212a924e5de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Converting VIF {"id": "fe82ba82-5046-473f-b0a7-7212a924e5de", "address": "fa:16:3e:f3:04:2c", "network": {"id": "8f7fd586-cc31-4828-bd1b-b9c67e164813", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-383955497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1029d1e2110746d3af205df825090efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe82ba82-50", "ovs_interfaceid": "fe82ba82-5046-473f-b0a7-7212a924e5de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:04:2c,bridge_name='br-int',has_traffic_filtering=True,id=fe82ba82-5046-473f-b0a7-7212a924e5de,network=Network(8f7fd586-cc31-4828-bd1b-b9c67e164813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe82ba82-50') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG os_vif [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:04:2c,bridge_name='br-int',has_traffic_filtering=True,id=fe82ba82-5046-473f-b0a7-7212a924e5de,network=Network(8f7fd586-cc31-4828-bd1b-b9c67e164813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe82ba82-50') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe82ba82-50, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a77b2709-4410-4e1f-937e-d8c2da297b45) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:20 user nova-compute[74692]: INFO os_vif [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:04:2c,bridge_name='br-int',has_traffic_filtering=True,id=fe82ba82-5046-473f-b0a7-7212a924e5de,network=Network(8f7fd586-cc31-4828-bd1b-b9c67e164813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe82ba82-50')
Nov 18 18:38:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Deleting instance files /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638_del
Nov 18 18:38:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Deletion of /opt/stack/data/nova/instances/c9c2ea43-093a-48ea-a464-373482eb1638_del complete
Nov 18 18:38:21 user nova-compute[74692]: INFO nova.compute.manager [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 18 18:38:21 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:38:21 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:38:21 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:38:21 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:38:21 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Took 0.77 seconds to deallocate network for instance.
Nov 18 18:38:21 user nova-compute[74692]: DEBUG nova.compute.manager [req-a3bf5e67-0197-4e41-9095-e93de6c39c9d req-ed524e29-5015-4b6d-8e19-6acc4952d29d service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Received event network-vif-deleted-fe82ba82-5046-473f-b0a7-7212a924e5de {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:38:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:22 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:38:22 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:38:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:22 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Deleted allocations for instance c9c2ea43-093a-48ea-a464-373482eb1638
Nov 18 18:38:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b86e0f7a-e1b6-4f60-86c3-5d87acb61a61 tempest-VolumesAdminNegativeTest-1838367509 tempest-VolumesAdminNegativeTest-1838367509-project-member] Lock "c9c2ea43-093a-48ea-a464-373482eb1638" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.218s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:22 user nova-compute[74692]: DEBUG nova.compute.manager [req-2fea27a5-b508-448b-b7fd-9a1e5a4d712f req-8ce5e038-d70e-41e5-824a-a998bf3925e6 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Received event network-vif-plugged-fe82ba82-5046-473f-b0a7-7212a924e5de {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:38:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2fea27a5-b508-448b-b7fd-9a1e5a4d712f req-8ce5e038-d70e-41e5-824a-a998bf3925e6 service nova] Acquiring lock "c9c2ea43-093a-48ea-a464-373482eb1638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2fea27a5-b508-448b-b7fd-9a1e5a4d712f req-8ce5e038-d70e-41e5-824a-a998bf3925e6 service nova] Lock "c9c2ea43-093a-48ea-a464-373482eb1638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2fea27a5-b508-448b-b7fd-9a1e5a4d712f req-8ce5e038-d70e-41e5-824a-a998bf3925e6 service nova] Lock "c9c2ea43-093a-48ea-a464-373482eb1638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:22 user nova-compute[74692]: DEBUG nova.compute.manager [req-2fea27a5-b508-448b-b7fd-9a1e5a4d712f req-8ce5e038-d70e-41e5-824a-a998bf3925e6 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] No waiting events found dispatching network-vif-plugged-fe82ba82-5046-473f-b0a7-7212a924e5de {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:38:22 user nova-compute[74692]: WARNING nova.compute.manager [req-2fea27a5-b508-448b-b7fd-9a1e5a4d712f req-8ce5e038-d70e-41e5-824a-a998bf3925e6 service nova] [instance: c9c2ea43-093a-48ea-a464-373482eb1638] Received unexpected event network-vif-plugged-fe82ba82-5046-473f-b0a7-7212a924e5de for instance with vm_state deleted and task_state None.
Nov 18 18:38:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:38:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:38:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:38:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:38:24 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:38:24 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Updating instance_info_cache with network_info: [{"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:38:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:38:24 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:38:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-010637ee-010c-4c8e-ae75-8b01082d405b req-68fdf919-95cf-41c9-92e9-ded309903511 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Received event network-changed-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:38:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-010637ee-010c-4c8e-ae75-8b01082d405b req-68fdf919-95cf-41c9-92e9-ded309903511 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Refreshing instance network info cache due to event network-changed-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:38:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-010637ee-010c-4c8e-ae75-8b01082d405b req-68fdf919-95cf-41c9-92e9-ded309903511 service nova] Acquiring lock "refresh_cache-4a20894d-58ea-4ebb-a39f-9746ccb277eb" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:38:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-010637ee-010c-4c8e-ae75-8b01082d405b req-68fdf919-95cf-41c9-92e9-ded309903511 service nova] Acquired lock "refresh_cache-4a20894d-58ea-4ebb-a39f-9746ccb277eb" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:38:29 user nova-compute[74692]: DEBUG nova.network.neutron [req-010637ee-010c-4c8e-ae75-8b01082d405b req-68fdf919-95cf-41c9-92e9-ded309903511 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Refreshing network info cache for port 932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:38:29 user nova-compute[74692]: DEBUG nova.network.neutron [req-010637ee-010c-4c8e-ae75-8b01082d405b req-68fdf919-95cf-41c9-92e9-ded309903511 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Updated VIF entry in instance network info cache for port 932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:38:29 user nova-compute[74692]: DEBUG nova.network.neutron [req-010637ee-010c-4c8e-ae75-8b01082d405b req-68fdf919-95cf-41c9-92e9-ded309903511 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Updating instance_info_cache with network_info: [{"id": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "address": "fa:16:3e:27:c6:e2", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932b913e-8e", "ovs_interfaceid": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:38:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-010637ee-010c-4c8e-ae75-8b01082d405b req-68fdf919-95cf-41c9-92e9-ded309903511 service nova] Releasing lock "refresh_cache-4a20894d-58ea-4ebb-a39f-9746ccb277eb" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:38:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:30 user nova-compute[74692]: DEBUG nova.objects.instance [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lazy-loading 'flavor' on Instance uuid 4a20894d-58ea-4ebb-a39f-9746ccb277eb {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:38:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:30 user nova-compute[74692]: INFO nova.compute.manager [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Attaching volume be2da036-b6f3-4401-985a-a5d275f1f241 to /dev/vdb
Nov 18 18:38:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG os_brick.utils [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd77bbdb-59ea-49c2-b4e7-cdf56ef45661]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d57dede-d605-45dc-9dd5-e78263780245]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4117ac7f-4f4a-43d0-8688-2ba0e6a7c1ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a676a1-0576-4858-a006-b46c4c94f31c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:38:31 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:38:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3c6947-f5ca-4370-bec8-78bf50cf563c]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG os_brick.utils [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:38:31 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Updating existing volume attachment record: 15a2df94-306a-466c-a84d-98a1c2021faf {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:38:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBarnPvO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:38:36 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:38:36 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:38:36 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fe5792-ee36-4c3e-bc4e-12f9cc33eefe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:38:36 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[161675a4-f37c-4f50-8cf5-7d3022157157]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241] added
Nov 18 18:38:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d73c7b8-2894-496d-9374-3270abcd4cf9]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37b4f88-3945-4164-a98e-dd5eeb246b6d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBarnPvO {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBarnPvO" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cfee48-d04b-4ffb-8725-dc63a61c4878]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CBarnPvO'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cc48ad-3902-4233-b16c-b1c387612f10]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd16bd93-8248-478e-8117-025ee3c165a9]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:38:36 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:38:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:38:36 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:38:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d59e6d-7463-4eba-8e5a-77cf2b7c41ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241, portal: 172.16.0.220,3260]
Nov 18 18:38:36 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241, portal: 172.16.0.220,3260] successful.
Nov 18 18:38:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e072d6-06db-46a1-978d-8c5854133588]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd70c143-f1a0-45da-b9a8-1e2772dcbcc6]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:38:36 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:38:36 user nova-compute[74692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 (non-flash)
Nov 18 18:38:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:38:36 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:38:36 user nova-compute[74692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 (non-flash)
Nov 18 18:38:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f507d79e-6293-4bd5-9261-71ec73c652fc]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:38:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBarnPvO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:37 user nova-compute[74692]: INFO nova.compute.manager [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Terminating instance
Nov 18 18:38:37 user nova-compute[74692]: DEBUG nova.compute.manager [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG nova.compute.manager [req-1472fe85-72a8-4bb7-802f-763b9f611577 req-72e2b407-1435-4546-aa66-d9b849afb029 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-unplugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1472fe85-72a8-4bb7-802f-763b9f611577 req-72e2b407-1435-4546-aa66-d9b849afb029 service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1472fe85-72a8-4bb7-802f-763b9f611577 req-72e2b407-1435-4546-aa66-d9b849afb029 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1472fe85-72a8-4bb7-802f-763b9f611577 req-72e2b407-1435-4546-aa66-d9b849afb029 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG nova.compute.manager [req-1472fe85-72a8-4bb7-802f-763b9f611577 req-72e2b407-1435-4546-aa66-d9b849afb029 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-unplugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG nova.compute.manager [req-1472fe85-72a8-4bb7-802f-763b9f611577 req-72e2b407-1435-4546-aa66-d9b849afb029 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-unplugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23237343830313131', 'path': '/dev/sdd'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237343830313131', 'path': '/dev/sdd'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG nova.objects.instance [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lazy-loading 'flavor' on Instance uuid 4a20894d-58ea-4ebb-a39f-9746ccb277eb {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:38:37 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:38:37 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:38:37 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:38:37 user nova-compute[74692]:   <serial>be2da036-b6f3-4401-985a-a5d275f1f241</serial>
Nov 18 18:38:37 user nova-compute[74692]: </disk>
Nov 18 18:38:37 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:38 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Instance destroyed successfully.
Nov 18 18:38:38 user nova-compute[74692]: DEBUG nova.objects.instance [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lazy-loading 'resources' on Instance uuid 153d4723-7ede-41b3-9f64-a0487f617ed2 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1812438622',display_name='tempest-ServerStableDeviceRescueTest-server-1812438622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1812438622',id=12,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXCGEJULwKPqzrmPp7Bsfx2IXbS6p9gZQ9/X6kg1yFYuvYoFt8pfMiAIEibdhQ14zBwHFYVMkEm/mgvVZz9WHejA2ywEe2B9BeRswQ0UHrDkkvMcoV8X7zJEUd0zFmwsg==',key_name='tempest-keypair-1872300764',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:35:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37858e7bb5cb41d082a4b0ee86658f08',ramdisk_id='',reservation_id='r-ivtc64el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1647655097',owner_user_name='tempest-ServerStableDeviceRescueTest-1647655097-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:37:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3279e5607e8462caa50f6cf4ff5d98e',uuid=153d4723-7ede-41b3-9f64-a0487f617ed2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Converting VIF {"id": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "address": "fa:16:3e:fe:ea:27", "network": {"id": "52a674cd-fbb9-409f-9547-8c85726f9e3b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822870560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37858e7bb5cb41d082a4b0ee86658f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bcdb35-95", "ovs_interfaceid": "b1bcdb35-95f4-4010-b94b-75cfb5ec082e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ea:27,bridge_name='br-int',has_traffic_filtering=True,id=b1bcdb35-95f4-4010-b94b-75cfb5ec082e,network=Network(52a674cd-fbb9-409f-9547-8c85726f9e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bcdb35-95') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG os_vif [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ea:27,bridge_name='br-int',has_traffic_filtering=True,id=b1bcdb35-95f4-4010-b94b-75cfb5ec082e,network=Network(52a674cd-fbb9-409f-9547-8c85726f9e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bcdb35-95') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1bcdb35-95, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=843c76bd-217f-41f0-867c-4b9d98249c91) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:38 user nova-compute[74692]: INFO os_vif [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ea:27,bridge_name='br-int',has_traffic_filtering=True,id=b1bcdb35-95f4-4010-b94b-75cfb5ec082e,network=Network(52a674cd-fbb9-409f-9547-8c85726f9e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bcdb35-95')
Nov 18 18:38:38 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Deleting instance files /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2_del
Nov 18 18:38:38 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Deletion of /opt/stack/data/nova/instances/153d4723-7ede-41b3-9f64-a0487f617ed2_del complete
Nov 18 18:38:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] No VIF found with MAC fa:16:3e:27:c6:e2, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:38:38 user nova-compute[74692]: INFO nova.compute.manager [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 18 18:38:38 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:38:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2e09cc3e-352d-41e0-84c7-736890edbc11 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.505s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:39 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:38:39 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Took 0.87 seconds to deallocate network for instance.
Nov 18 18:38:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-66071ef0-9ffc-4e16-85da-70b4e73b3425 req-2cb02600-7988-4410-b179-baed664df8f8 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:38:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-66071ef0-9ffc-4e16-85da-70b4e73b3425 req-2cb02600-7988-4410-b179-baed664df8f8 service nova] Acquiring lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-66071ef0-9ffc-4e16-85da-70b4e73b3425 req-2cb02600-7988-4410-b179-baed664df8f8 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-66071ef0-9ffc-4e16-85da-70b4e73b3425 req-2cb02600-7988-4410-b179-baed664df8f8 service nova] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-66071ef0-9ffc-4e16-85da-70b4e73b3425 req-2cb02600-7988-4410-b179-baed664df8f8 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] No waiting events found dispatching network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:38:39 user nova-compute[74692]: WARNING nova.compute.manager [req-66071ef0-9ffc-4e16-85da-70b4e73b3425 req-2cb02600-7988-4410-b179-baed664df8f8 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received unexpected event network-vif-plugged-b1bcdb35-95f4-4010-b94b-75cfb5ec082e for instance with vm_state deleted and task_state None.
Nov 18 18:38:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-66071ef0-9ffc-4e16-85da-70b4e73b3425 req-2cb02600-7988-4410-b179-baed664df8f8 service nova] [instance: 153d4723-7ede-41b3-9f64-a0487f617ed2] Received event network-vif-deleted-b1bcdb35-95f4-4010-b94b-75cfb5ec082e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:38:39 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:38:39 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:38:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:39 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Deleted allocations for instance 153d4723-7ede-41b3-9f64-a0487f617ed2
Nov 18 18:38:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-70a0fbb0-eee5-4486-9f15-a717da321cfe tempest-ServerStableDeviceRescueTest-1647655097 tempest-ServerStableDeviceRescueTest-1647655097-project-member] Lock "153d4723-7ede-41b3-9f64-a0487f617ed2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.541s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:40 user nova-compute[74692]: INFO nova.compute.manager [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Detaching volume be2da036-b6f3-4401-985a-a5d275f1f241
Nov 18 18:38:40 user nova-compute[74692]: INFO nova.virt.block_device [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Attempting to driver detach volume be2da036-b6f3-4401-985a-a5d275f1f241 from mountpoint /dev/vdb
Nov 18 18:38:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Attempting to detach device vdb from instance 4a20894d-58ea-4ebb-a39f-9746ccb277eb from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:38:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:38:40 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:38:40 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:38:40 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:38:40 user nova-compute[74692]:   <serial>be2da036-b6f3-4401-985a-a5d275f1f241</serial>
Nov 18 18:38:40 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:38:40 user nova-compute[74692]: </disk>
Nov 18 18:38:40 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:38:40 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Successfully detached device vdb from instance 4a20894d-58ea-4ebb-a39f-9746ccb277eb from the persistent domain config.
Nov 18 18:38:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a20894d-58ea-4ebb-a39f-9746ccb277eb from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:38:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:38:40 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:38:40 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:38:40 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:38:40 user nova-compute[74692]:   <serial>be2da036-b6f3-4401-985a-a5d275f1f241</serial>
Nov 18 18:38:40 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:38:40 user nova-compute[74692]: </disk>
Nov 18 18:38:40 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:38:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a20894d-58ea-4ebb-a39f-9746ccb277eb {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:38:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:45 user nova-compute[74692]: INFO nova.compute.manager [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Detaching volume ef33492e-0be5-4134-8333-62d26e73d98c
Nov 18 18:38:45 user nova-compute[74692]: INFO nova.virt.block_device [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Attempting to driver detach volume ef33492e-0be5-4134-8333-62d26e73d98c from mountpoint /dev/vdb
Nov 18 18:38:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Attempting to detach device vdb from instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:38:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:38:45 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:38:45 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:38:45 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:38:45 user nova-compute[74692]:   <serial>ef33492e-0be5-4134-8333-62d26e73d98c</serial>
Nov 18 18:38:45 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 18:38:45 user nova-compute[74692]: </disk>
Nov 18 18:38:45 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:38:45 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Successfully detached device vdb from instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 from the persistent domain config.
Nov 18 18:38:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:38:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:38:45 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:38:45 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:38:45 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:38:45 user nova-compute[74692]:   <serial>ef33492e-0be5-4134-8333-62d26e73d98c</serial>
Nov 18 18:38:45 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 18:38:45 user nova-compute[74692]: </disk>
Nov 18 18:38:45 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:38:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:38:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-da49a213-8452-4359-830f-0bd58e804ec5 req-96faeb9c-7bb7-43ab-bc6f-052b1153cc22 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Received event network-changed-8f2146d5-7fed-448c-a056-be7d4d79eabd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:38:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-da49a213-8452-4359-830f-0bd58e804ec5 req-96faeb9c-7bb7-43ab-bc6f-052b1153cc22 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Refreshing instance network info cache due to event network-changed-8f2146d5-7fed-448c-a056-be7d4d79eabd. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:38:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-da49a213-8452-4359-830f-0bd58e804ec5 req-96faeb9c-7bb7-43ab-bc6f-052b1153cc22 service nova] Acquiring lock "refresh_cache-576a5f25-56f7-49d4-9fdc-1429f588f9e3" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:38:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-da49a213-8452-4359-830f-0bd58e804ec5 req-96faeb9c-7bb7-43ab-bc6f-052b1153cc22 service nova] Acquired lock "refresh_cache-576a5f25-56f7-49d4-9fdc-1429f588f9e3" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:38:46 user nova-compute[74692]: DEBUG nova.network.neutron [req-da49a213-8452-4359-830f-0bd58e804ec5 req-96faeb9c-7bb7-43ab-bc6f-052b1153cc22 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Refreshing network info cache for port 8f2146d5-7fed-448c-a056-be7d4d79eabd {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:38:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-da49a213-8452-4359-830f-0bd58e804ec5 req-96faeb9c-7bb7-43ab-bc6f-052b1153cc22 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Updated VIF entry in instance network info cache for port 8f2146d5-7fed-448c-a056-be7d4d79eabd. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:38:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-da49a213-8452-4359-830f-0bd58e804ec5 req-96faeb9c-7bb7-43ab-bc6f-052b1153cc22 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Updating instance_info_cache with network_info: [{"id": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "address": "fa:16:3e:77:21:64", "network": {"id": "eae777ed-faa6-4132-b374-480aab64d54c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1942002881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5e045b95b64117a1f7319ada089654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2146d5-7f", "ovs_interfaceid": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:38:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-da49a213-8452-4359-830f-0bd58e804ec5 req-96faeb9c-7bb7-43ab-bc6f-052b1153cc22 service nova] Releasing lock "refresh_cache-576a5f25-56f7-49d4-9fdc-1429f588f9e3" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:38:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lazy-loading 'flavor' on Instance uuid 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:38:50 user nova-compute[74692]: INFO nova.compute.manager [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Attaching volume 98da4bed-2d6c-465d-8ef2-5931e7bd204b to /dev/vdb
Nov 18 18:38:50 user nova-compute[74692]: DEBUG os_brick.utils [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfc5dbf-6087-4e81-90dd-8aac84d0731a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cf517b-7c42-4eeb-9e1c-566d1b511c8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[de71f110-7a1d-46e0-8849-09b75f3ca815]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5597c4-5371-43fa-898f-666c5a36f3f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:38:50 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:38:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7244103-11e1-4c99-89cb-e1accfad5597]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG os_brick.utils [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:38:50 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Updating existing volume attachment record: c181b45d-5153-459d-9a6a-235e41fe5454 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:38:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRjIkmBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:38:56 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:38:56 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:38:56 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8854781-f63b-4172-81e2-8b99edf1115e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:38:56 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ca8586-e6ab-46be-b069-8cec8e052f90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b] added
Nov 18 18:38:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[57420092-2a1c-47b2-85b9-7da6619fc0fe]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[293995cf-ecc6-4685-9d3c-e6dd88a155d2]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nRjIkmBc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nRjIkmBc" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0543d82-186d-4979-ae67-26a341e74584]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nRjIkmBc'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6910411d-1d69-4490-b206-ca5462a11131]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a15f1d-6be3-47cc-bc40-fbf3c37de391]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:38:56 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:38:56 user nova-compute[74692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 (non-flash)
Nov 18 18:38:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:38:56 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:38:56 user nova-compute[74692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 (non-flash)
Nov 18 18:38:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[00989936-fec6-4c9b-8717-8a07be012e75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b, portal: 172.16.0.220,3260]
Nov 18 18:38:56 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b, portal: 172.16.0.220,3260] successful.
Nov 18 18:38:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[649fca38-7ee5-4117-9118-44183bc2a82c]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad25e2b-05fa-4a8d-a1d3-b0589ed80495]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:38:56 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:38:56 user nova-compute[74692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 (non-flash)
Nov 18 18:38:56 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:38:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:38:56 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:38:56 user nova-compute[74692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 (non-flash)
Nov 18 18:38:56 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:38:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2739928e-9e19-4aef-9988-177ae670a084]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:38:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRjIkmBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:38:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:38:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26332346337386665', 'path': '/dev/sde'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:38:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332346337386665', 'path': '/dev/sde'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:38:57 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lazy-loading 'flavor' on Instance uuid 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:38:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:38:57 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:38:57 user nova-compute[74692]:   <source dev="/dev/sde"/>
Nov 18 18:38:57 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:38:57 user nova-compute[74692]:   <serial>98da4bed-2d6c-465d-8ef2-5931e7bd204b</serial>
Nov 18 18:38:57 user nova-compute[74692]: </disk>
Nov 18 18:38:57 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:38:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:38:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:38:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:38:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] No VIF found with MAC fa:16:3e:77:21:64, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:38:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3f4da2d8-f15c-4162-afb0-a6c8db1dc021 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.381s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:38:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:00 user nova-compute[74692]: INFO nova.compute.manager [None req-455ed6a0-ddaa-4b44-b506-ceb5c6930af2 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Unrescuing
Nov 18 18:39:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-455ed6a0-ddaa-4b44-b506-ceb5c6930af2 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:39:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-455ed6a0-ddaa-4b44-b506-ceb5c6930af2 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquired lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:39:00 user nova-compute[74692]: DEBUG nova.network.neutron [None req-455ed6a0-ddaa-4b44-b506-ceb5c6930af2 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG nova.network.neutron [None req-455ed6a0-ddaa-4b44-b506-ceb5c6930af2 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Updating instance_info_cache with network_info: [{"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-455ed6a0-ddaa-4b44-b506-ceb5c6930af2 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Releasing lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG nova.objects.instance [None req-455ed6a0-ddaa-4b44-b506-ceb5c6930af2 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'flavor' on Instance uuid 7540540c-af3e-4992-8756-3497a3bd4bf6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:01 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4a20894d-58ea-4ebb-a39f-9746ccb277eb is timed out.
Nov 18 18:39:01 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Successfully detached device vdb from instance 4a20894d-58ea-4ebb-a39f-9746ccb277eb from the live domain config.
Nov 18 18:39:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBarnPvO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:39:01 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2d00ba-115b-4db4-9b96-7054bf0b112f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:39:01 user nova-compute[74692]: No targets found.
Nov 18 18:39:01 user nova-compute[74692]: iSNS:
Nov 18 18:39:01 user nova-compute[74692]: No targets found.
Nov 18 18:39:01 user nova-compute[74692]: STATIC:
Nov 18 18:39:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b
Nov 18 18:39:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:39:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:39:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241
Nov 18 18:39:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:39:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:39:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c
Nov 18 18:39:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:39:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:39:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:39:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:39:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:39:01 user nova-compute[74692]: FIRMWARE:
Nov 18 18:39:01 user nova-compute[74692]: No targets found.
Nov 18 18:39:01 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:39:01 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:39:01 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99d55d3-e5a0-4f2c-a4c0-3820aa33754e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-1bc9cb0d-4511-4f9a-9040-ed1afd30455d req-a38c8ee1-d433-4985-aaf9-11d5e5986b74 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-unplugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1bc9cb0d-4511-4f9a-9040-ed1afd30455d req-a38c8ee1-d433-4985-aaf9-11d5e5986b74 service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1bc9cb0d-4511-4f9a-9040-ed1afd30455d req-a38c8ee1-d433-4985-aaf9-11d5e5986b74 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1bc9cb0d-4511-4f9a-9040-ed1afd30455d req-a38c8ee1-d433-4985-aaf9-11d5e5986b74 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-1bc9cb0d-4511-4f9a-9040-ed1afd30455d req-a38c8ee1-d433-4985-aaf9-11d5e5986b74 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-unplugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:01 user nova-compute[74692]: WARNING nova.compute.manager [req-1bc9cb0d-4511-4f9a-9040-ed1afd30455d req-a38c8ee1-d433-4985-aaf9-11d5e5986b74 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received unexpected event network-vif-unplugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde48621-ac90-4e6e-bc82-4101917a20d0]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:01 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:39:01 user nova-compute[74692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 (non-flash)
Nov 18 18:39:01 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:01 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:01 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:39:01 user nova-compute[74692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 (non-flash)
Nov 18 18:39:01 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:01 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a4529510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241'): ({'sdd'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Removing single pathed devices sdd {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f61e3d1-0855-4279-ae20-d462d5d06c8e]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04f3648-eddc-4d37-a8a0-37035df52062]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Flushing IO for device /dev/sdd {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cf5ca6-20d9-4026-a11f-31dd60aaf292]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb137292-60f6-4458-a169-500476644a20]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[896c2d1b-3e23-404c-86f9-d97245140d05]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96f9050-c2e3-46e6-abad-c04c3bbcbf31]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241, portal: 172.16.0.220,3260]
Nov 18 18:39:01 user nova-compute[74692]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241, portal: 172.16.0.220,3260] successful.
Nov 18 18:39:01 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2da036-b6f3-4401-985a-a5d275f1f241 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[96231f10-266f-4b8f-9ddd-36ac55e157f3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] <== disconnect_volume: return (332ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:01 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Instance destroyed successfully.
Nov 18 18:39:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:02 user nova-compute[74692]: DEBUG nova.objects.instance [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lazy-loading 'flavor' on Instance uuid 4a20894d-58ea-4ebb-a39f-9746ccb277eb {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-37ff3919-fffb-4eaa-b5de-49e7fdadab21 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.715s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:03 user nova-compute[74692]: WARNING nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received unexpected event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:39:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:03 user nova-compute[74692]: WARNING nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received unexpected event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:39:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:03 user nova-compute[74692]: WARNING nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received unexpected event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:39:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-unplugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-unplugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:03 user nova-compute[74692]: WARNING nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received unexpected event network-vif-unplugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:39:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:03 user nova-compute[74692]: WARNING nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received unexpected event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:39:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:03 user nova-compute[74692]: WARNING nova.compute.manager [req-ce22bf06-6f59-40f2-ac43-c2d35a862228 req-2a7ed066-5e9f-44d7-9103-62e8823bee56 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received unexpected event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:39:05 user nova-compute[74692]: DEBUG nova.compute.manager [None req-455ed6a0-ddaa-4b44-b506-ceb5c6930af2 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-1af32e83-5f4c-4383-a5f5-63eea54dcbc5 req-e4bf44c7-e761-4dc9-858f-9e744f78df70 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1af32e83-5f4c-4383-a5f5-63eea54dcbc5 req-e4bf44c7-e761-4dc9-858f-9e744f78df70 service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1af32e83-5f4c-4383-a5f5-63eea54dcbc5 req-e4bf44c7-e761-4dc9-858f-9e744f78df70 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1af32e83-5f4c-4383-a5f5-63eea54dcbc5 req-e4bf44c7-e761-4dc9-858f-9e744f78df70 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-1af32e83-5f4c-4383-a5f5-63eea54dcbc5 req-e4bf44c7-e761-4dc9-858f-9e744f78df70 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:05 user nova-compute[74692]: WARNING nova.compute.manager [req-1af32e83-5f4c-4383-a5f5-63eea54dcbc5 req-e4bf44c7-e761-4dc9-858f-9e744f78df70 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received unexpected event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with vm_state active and task_state None.
Nov 18 18:39:05 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 is timed out.
Nov 18 18:39:05 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Successfully detached device vdb from instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 from the live domain config.
Nov 18 18:39:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NafBPsmo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:39:05 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:39:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5475b55f-e56c-454c-b541-94721402eec4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:39:05 user nova-compute[74692]: No targets found.
Nov 18 18:39:05 user nova-compute[74692]: iSNS:
Nov 18 18:39:05 user nova-compute[74692]: No targets found.
Nov 18 18:39:05 user nova-compute[74692]: STATIC:
Nov 18 18:39:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b
Nov 18 18:39:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:39:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:39:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c
Nov 18 18:39:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:39:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:39:05 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:39:05 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:39:05 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:39:05 user nova-compute[74692]: FIRMWARE:
Nov 18 18:39:05 user nova-compute[74692]: No targets found.
Nov 18 18:39:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:39:05 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:39:05 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c12908-0073-4c65-8a81-4e8335af4509]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[563b4c36-40a7-481f-8d00-c0ae916a4591]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:05 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:39:05 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:05 user nova-compute[74692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c (non-flash)
Nov 18 18:39:05 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a447c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c'): ({'sdc'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Removing single pathed devices sdc {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:39:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa59bd70-8078-4d66-bfe6-84a865df7bee]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83ce0e4-a849-432c-ae41-3c126171a12c]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Flushing IO for device /dev/sdc {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bac642-9588-45c2-ab32-812745b6aebf]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8732c54b-63b0-48ec-ba04-626d3861cb06]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[82575879-c27d-486c-8eb7-d00f18a4eb45]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec11dcbb-a6fb-4247-a65b-13e8f4802ace]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260]
Nov 18 18:39:06 user nova-compute[74692]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c, portal: 172.16.0.220,3260] successful.
Nov 18 18:39:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef33492e-0be5-4134-8333-62d26e73d98c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abc9f22-5b29-4148-8233-ad3387d24520]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] <== disconnect_volume: return (355ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-caca7c93-1255-4092-9b20-908cc8012caf req-f0e469ac-1b3d-4a69-a0a6-8d3bfe52976d service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received event network-changed-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-caca7c93-1255-4092-9b20-908cc8012caf req-f0e469ac-1b3d-4a69-a0a6-8d3bfe52976d service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Refreshing instance network info cache due to event network-changed-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-caca7c93-1255-4092-9b20-908cc8012caf req-f0e469ac-1b3d-4a69-a0a6-8d3bfe52976d service nova] Acquiring lock "refresh_cache-df36071b-3fe8-48fb-9a17-818eb391779e" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-caca7c93-1255-4092-9b20-908cc8012caf req-f0e469ac-1b3d-4a69-a0a6-8d3bfe52976d service nova] Acquired lock "refresh_cache-df36071b-3fe8-48fb-9a17-818eb391779e" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG nova.network.neutron [req-caca7c93-1255-4092-9b20-908cc8012caf req-f0e469ac-1b3d-4a69-a0a6-8d3bfe52976d service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Refreshing network info cache for port 1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:39:06 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'flavor' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG nova.network.neutron [req-caca7c93-1255-4092-9b20-908cc8012caf req-f0e469ac-1b3d-4a69-a0a6-8d3bfe52976d service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Updated VIF entry in instance network info cache for port 1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG nova.network.neutron [req-caca7c93-1255-4092-9b20-908cc8012caf req-f0e469ac-1b3d-4a69-a0a6-8d3bfe52976d service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Updating instance_info_cache with network_info: [{"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-caca7c93-1255-4092-9b20-908cc8012caf req-f0e469ac-1b3d-4a69-a0a6-8d3bfe52976d service nova] Releasing lock "refresh_cache-df36071b-3fe8-48fb-9a17-818eb391779e" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3c1e7d1f-cee9-432c-8427-3f2f18a53541 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.811s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "df36071b-3fe8-48fb-9a17-818eb391779e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "df36071b-3fe8-48fb-9a17-818eb391779e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG nova.objects.instance [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lazy-loading 'flavor' on Instance uuid df36071b-3fe8-48fb-9a17-818eb391779e {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "df36071b-3fe8-48fb-9a17-818eb391779e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "df36071b-3fe8-48fb-9a17-818eb391779e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "df36071b-3fe8-48fb-9a17-818eb391779e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:07 user nova-compute[74692]: INFO nova.compute.manager [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Attaching volume 7ab0cca8-8f41-4c5e-a481-854949a71d2a to /dev/vdb
Nov 18 18:39:07 user nova-compute[74692]: DEBUG os_brick.utils [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af8c780-b4e7-4f72-a5a8-3f29c7db8662]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2f826c-39ec-4ac2-9d9a-da21a2c669a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d598980-a786-4d18-b228-f3ea3b8144ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f09ad5c-ca74-44cd-9691-7f34a27d318e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:39:07 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4359a06a-e70c-4c03-b96f-8bb7e33428fd]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG os_brick.utils [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Updating existing volume attachment record: a3744a62-fa17-438d-9da5-2de465901cf5 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3ac73610-f11d-4a01-b51f-3c9b237694d1 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3ac73610-f11d-4a01-b51f-3c9b237694d1 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3ac73610-f11d-4a01-b51f-3c9b237694d1 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3ac73610-f11d-4a01-b51f-3c9b237694d1 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74692) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 18 18:39:07 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3ac73610-f11d-4a01-b51f-3c9b237694d1 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'flavor' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:08 user nova-compute[74692]: DEBUG nova.compute.manager [req-74ea85b1-d0c2-42eb-bd69-b03b56524653 req-b4ccaa9b-b4ca-431c-9419-4dc423b4bf1c service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-vif-unplugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-74ea85b1-d0c2-42eb-bd69-b03b56524653 req-b4ccaa9b-b4ca-431c-9419-4dc423b4bf1c service nova] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-74ea85b1-d0c2-42eb-bd69-b03b56524653 req-b4ccaa9b-b4ca-431c-9419-4dc423b4bf1c service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-74ea85b1-d0c2-42eb-bd69-b03b56524653 req-b4ccaa9b-b4ca-431c-9419-4dc423b4bf1c service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:08 user nova-compute[74692]: DEBUG nova.compute.manager [req-74ea85b1-d0c2-42eb-bd69-b03b56524653 req-b4ccaa9b-b4ca-431c-9419-4dc423b4bf1c service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] No waiting events found dispatching network-vif-unplugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:08 user nova-compute[74692]: WARNING nova.compute.manager [req-74ea85b1-d0c2-42eb-bd69-b03b56524653 req-b4ccaa9b-b4ca-431c-9419-4dc423b4bf1c service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received unexpected event network-vif-unplugged-9753f583-4360-48e8-a59f-43b16198aa36 for instance with vm_state active and task_state powering-off.
Nov 18 18:39:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:08 user nova-compute[74692]: INFO nova.compute.manager [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Detaching volume 98da4bed-2d6c-465d-8ef2-5931e7bd204b
Nov 18 18:39:08 user nova-compute[74692]: INFO nova.virt.block_device [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Attempting to driver detach volume 98da4bed-2d6c-465d-8ef2-5931e7bd204b from mountpoint /dev/vdb
Nov 18 18:39:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Attempting to detach device vdb from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:39:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:39:08 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:39:08 user nova-compute[74692]:   <source dev="/dev/sde"/>
Nov 18 18:39:08 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:39:08 user nova-compute[74692]:   <serial>98da4bed-2d6c-465d-8ef2-5931e7bd204b</serial>
Nov 18 18:39:08 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:39:08 user nova-compute[74692]: </disk>
Nov 18 18:39:08 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:39:08 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Successfully detached device vdb from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the persistent domain config.
Nov 18 18:39:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:39:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:39:08 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:39:08 user nova-compute[74692]:   <source dev="/dev/sde"/>
Nov 18 18:39:08 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:39:08 user nova-compute[74692]:   <serial>98da4bed-2d6c-465d-8ef2-5931e7bd204b</serial>
Nov 18 18:39:08 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:39:08 user nova-compute[74692]: </disk>
Nov 18 18:39:08 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:39:08 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Instance destroyed successfully.
Nov 18 18:39:08 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3ac73610-f11d-4a01-b51f-3c9b237694d1 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:39:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3ac73610-f11d-4a01-b51f-3c9b237694d1 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.942s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:39:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-5e4216fc-5c91-459b-b8af-16bcbdb550fa req-dce64946-ceac-4335-ab5f-51e6f6187d44 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5e4216fc-5c91-459b-b8af-16bcbdb550fa req-dce64946-ceac-4335-ab5f-51e6f6187d44 service nova] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5e4216fc-5c91-459b-b8af-16bcbdb550fa req-dce64946-ceac-4335-ab5f-51e6f6187d44 service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5e4216fc-5c91-459b-b8af-16bcbdb550fa req-dce64946-ceac-4335-ab5f-51e6f6187d44 service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-5e4216fc-5c91-459b-b8af-16bcbdb550fa req-dce64946-ceac-4335-ab5f-51e6f6187d44 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] No waiting events found dispatching network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:10 user nova-compute[74692]: WARNING nova.compute.manager [req-5e4216fc-5c91-459b-b8af-16bcbdb550fa req-dce64946-ceac-4335-ab5f-51e6f6187d44 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received unexpected event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 for instance with vm_state stopped and task_state None.
Nov 18 18:39:10 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:39:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:12 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:39:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNOYnzqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:39:13 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:39:13 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:39:13 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2702daf-85e2-4e85-badc-b98455af1f61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:39:13 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[76690857-4d94-4b9d-9556-5b3c0ca692ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a] added
Nov 18 18:39:13 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c1677f-3cdd-41bb-a7f6-3e7ad25ec086]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff7d76c-47a8-4953-925f-ed2b04d77a0e]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNOYnzqi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNOYnzqi" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b235104-bd02-47ab-a972-5125f277cd0b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eNOYnzqi'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d7c955-a030-498a-9dc6-57289fec3d08]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1e2464-2dd9-4892-aada-5febeaf532fc]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:13 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:13 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:13 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:13 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3942454a-7a3a-4818-b68f-644b34f8f87a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260]
Nov 18 18:39:13 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260] successful.
Nov 18 18:39:13 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4eb68c-56ef-43fc-b041-213c88690d85]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dc4943-6c19-4c26-87d8-9876099da5cf]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:13 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:13 user nova-compute[74692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:39:13 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:13 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:13 user nova-compute[74692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:39:13 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:39:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d884de6-d2ab-4555-9dad-e310f50795b4]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:14 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:39:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNOYnzqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:39:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23665663166653965', 'path': '/dev/sdc'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665663166653965', 'path': '/dev/sdc'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG nova.objects.instance [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lazy-loading 'flavor' on Instance uuid df36071b-3fe8-48fb-9a17-818eb391779e {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:39:15 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:39:15 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:39:15 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:39:15 user nova-compute[74692]:   <serial>7ab0cca8-8f41-4c5e-a481-854949a71d2a</serial>
Nov 18 18:39:15 user nova-compute[74692]: </disk>
Nov 18 18:39:15 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/disk.rescue --force-share --output=json" returned: 0 in 0.261s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] No VIF found with MAC fa:16:3e:a8:85:0a, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-96c5d060-d9c6-4110-8f64-d9156abae4c0 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "df36071b-3fe8-48fb-9a17-818eb391779e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.269s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:39:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:16 user nova-compute[74692]: INFO nova.compute.manager [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Rebuilding instance
Nov 18 18:39:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:17 user nova-compute[74692]: DEBUG nova.compute.manager [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:39:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-7c17c73a-b611-44a3-8788-4b4c85083720 req-27d93084-f082-40cc-a451-4d062f47e9cd service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received event network-vif-unplugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7c17c73a-b611-44a3-8788-4b4c85083720 req-27d93084-f082-40cc-a451-4d062f47e9cd service nova] Acquiring lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7c17c73a-b611-44a3-8788-4b4c85083720 req-27d93084-f082-40cc-a451-4d062f47e9cd service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7c17c73a-b611-44a3-8788-4b4c85083720 req-27d93084-f082-40cc-a451-4d062f47e9cd service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-7c17c73a-b611-44a3-8788-4b4c85083720 req-27d93084-f082-40cc-a451-4d062f47e9cd service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] No waiting events found dispatching network-vif-unplugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:18 user nova-compute[74692]: WARNING nova.compute.manager [req-7c17c73a-b611-44a3-8788-4b4c85083720 req-27d93084-f082-40cc-a451-4d062f47e9cd service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received unexpected event network-vif-unplugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 for instance with vm_state active and task_state rebuilding.
Nov 18 18:39:18 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Instance destroyed successfully.
Nov 18 18:39:18 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:39:18 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7689MB free_disk=24.92363739013672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 873169f2-f1a7-4c16-8b8c-88767fea7fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 4a20894d-58ea-4ebb-a39f-9746ccb277eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance df36071b-3fe8-48fb-9a17-818eb391779e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:39:18 user nova-compute[74692]: INFO nova.compute.manager [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Detaching volume 7ab0cca8-8f41-4c5e-a481-854949a71d2a
Nov 18 18:39:18 user nova-compute[74692]: INFO nova.virt.block_device [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Attempting to driver detach volume 7ab0cca8-8f41-4c5e-a481-854949a71d2a from mountpoint /dev/vdb
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Attempting to detach device vdb from instance df36071b-3fe8-48fb-9a17-818eb391779e from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:39:18 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:39:18 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:39:18 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:39:18 user nova-compute[74692]:   <serial>7ab0cca8-8f41-4c5e-a481-854949a71d2a</serial>
Nov 18 18:39:18 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:39:18 user nova-compute[74692]: </disk>
Nov 18 18:39:18 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:39:18 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Successfully detached device vdb from instance df36071b-3fe8-48fb-9a17-818eb391779e from the persistent domain config.
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNOYnzqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:39:18 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e6db0c-9512-405f-b52b-630479a1529e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:39:18 user nova-compute[74692]: No targets found.
Nov 18 18:39:18 user nova-compute[74692]: iSNS:
Nov 18 18:39:18 user nova-compute[74692]: No targets found.
Nov 18 18:39:18 user nova-compute[74692]: STATIC:
Nov 18 18:39:18 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b
Nov 18 18:39:18 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:39:18 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:39:18 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a
Nov 18 18:39:18 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:39:18 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:39:18 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:39:18 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:39:18 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:39:18 user nova-compute[74692]: FIRMWARE:
Nov 18 18:39:18 user nova-compute[74692]: No targets found.
Nov 18 18:39:18 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:39:18 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:39:18 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb54e07-91d4-4cbb-9929-4a5cd24f3446]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d319cb-aeab-4519-b75f-75382662944a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:18 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:18 user nova-compute[74692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:39:18 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:18 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:18 user nova-compute[74692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:39:18 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c465fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a'): ({'sdc'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Removing single pathed devices sdc {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7daeb2-cda8-4d2a-9049-793de65c25d4]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bc1a9c-5711-4adf-8a2c-b2fc0ae0d59d]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Flushing IO for device /dev/sdc {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b3c522-6cb4-4764-8137-aafbc121643b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b33579-cd1d-4af9-bdc9-0b903b4f22d1]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0931afb9-18b6-403e-97ca-ce308b607f98]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] There are 0 instances to clean {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcea901c-f530-4bba-91e5-0b873c9d70c4]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260]
Nov 18 18:39:18 user nova-compute[74692]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260] successful.
Nov 18 18:39:18 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eb3d98-9d73-41cc-a7f3-3008ec08b894]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] <== disconnect_volume: return (295ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-b02efd26-09f7-448f-be18-72a64ba60314 req-0ca3fd53-b46e-4a95-af19-e578e22bda8c service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received event network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b02efd26-09f7-448f-be18-72a64ba60314 req-0ca3fd53-b46e-4a95-af19-e578e22bda8c service nova] Acquiring lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b02efd26-09f7-448f-be18-72a64ba60314 req-0ca3fd53-b46e-4a95-af19-e578e22bda8c service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b02efd26-09f7-448f-be18-72a64ba60314 req-0ca3fd53-b46e-4a95-af19-e578e22bda8c service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-b02efd26-09f7-448f-be18-72a64ba60314 req-0ca3fd53-b46e-4a95-af19-e578e22bda8c service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] No waiting events found dispatching network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:19 user nova-compute[74692]: WARNING nova.compute.manager [req-b02efd26-09f7-448f-be18-72a64ba60314 req-0ca3fd53-b46e-4a95-af19-e578e22bda8c service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received unexpected event network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 for instance with vm_state active and task_state rebuilding.
Nov 18 18:39:19 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Instance destroyed successfully.
Nov 18 18:39:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:37:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1958383659',display_name='tempest-ServerActionsTestOtherA-server-1949595915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1958383659',id=26,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEepvhZskUYCdoSVABjCMgkFhwHmKrLIlSb5MlTcYjLz28VYCfC+0IzqpuCb73UGLxPXmt6l+8kjRWWYRsZLnLqwdnSFiKEGucHC8txk27WtUcZ44pwuuyqHzczpHxGwIg==',key_name='tempest-keypair-916762113',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:37:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fdb006c6267b42fab703cfc24d93052e',ramdisk_id='',reservation_id='r-5javkpip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2047740053',owner_user_name='tempest-ServerActionsTestOtherA-2047740053-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:39:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d126349e69864417bb5e02666efd534c',uuid=df36071b-3fe8-48fb-9a17-818eb391779e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converting VIF {"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:85:0a,bridge_name='br-int',has_traffic_filtering=True,id=1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a60bdb4-d4') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_vif [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:85:0a,bridge_name='br-int',has_traffic_filtering=True,id=1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a60bdb4-d4') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a60bdb4-d4, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=108656b1-4429-47f8-8f37-71c43bdcc202) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:19 user nova-compute[74692]: INFO os_vif [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:85:0a,bridge_name='br-int',has_traffic_filtering=True,id=1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a60bdb4-d4')
Nov 18 18:39:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNOYnzqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:39:19 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dfdb9c-819f-4d68-b36a-53f1b3afd146]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:39:19 user nova-compute[74692]: No targets found.
Nov 18 18:39:19 user nova-compute[74692]: iSNS:
Nov 18 18:39:19 user nova-compute[74692]: No targets found.
Nov 18 18:39:19 user nova-compute[74692]: STATIC:
Nov 18 18:39:19 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b
Nov 18 18:39:19 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:39:19 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:39:19 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:39:19 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:39:19 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:39:19 user nova-compute[74692]: FIRMWARE:
Nov 18 18:39:19 user nova-compute[74692]: No targets found.
Nov 18 18:39:19 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:39:19 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:39:19 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f7f863-d81c-4d69-b2f4-3444fa57c6b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8cf059-81cf-4c8c-b170-3d583afc0fa5]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:19 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:19 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:19 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:19 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a4568790>, {}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Disconnecting from: [] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] <== disconnect_volume: return (73ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:39:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:39:19 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Deleting instance files /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e_del
Nov 18 18:39:19 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Deletion of /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e_del complete
Nov 18 18:39:20 user nova-compute[74692]: INFO nova.virt.block_device [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Booting with volume 7ab0cca8-8f41-4c5e-a481-854949a71d2a at /dev/vdb
Nov 18 18:39:20 user nova-compute[74692]: DEBUG os_brick.utils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfae5d5-2733-4090-95d2-83e7a5f601ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f33a23-d22b-4503-bbc1-00ccc79d3679]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97510be-d72e-4e51-8cd6-d74017d25b75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbca805-0bff-4416-9c22-3f20e53d0ac1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:39:20 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1f2316-007a-4de5-afb6-b1d68b69de81]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG os_brick.utils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Updating existing volume attachment record: 72a3b349-034f-4dc9-81d0-5a4974ecfac8 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:39:20 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:39:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:39:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:39:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-dd434b0c-593a-47ad-9109-0f8b5f545b6c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:39:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-dd434b0c-593a-47ad-9109-0f8b5f545b6c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:39:24 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:39:24 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Updating instance_info_cache with network_info: [{"id": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "address": "fa:16:3e:93:8d:60", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc879593e-46", "ovs_interfaceid": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:39:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-dd434b0c-593a-47ad-9109-0f8b5f545b6c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:39:24 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:39:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:39:26 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Creating image(s)
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "/opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "/opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "/opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "30beb8e4-0363-41e0-8089-04bef2539f4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk 1073741824" returned: 0 in 0.048s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:39:26 user nova-compute[74692]: INFO nova.compute.claims [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Claim successful on node user
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:39:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Cannot resize image /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Ensure instance console log exists: /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Start _get_guest_xml network_info=[{"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNOYnzqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'df36071b-3fe8-48fb-9a17-818eb391779e', 'attached_at': '', 'detached_at': '', 'volume_id': '7ab0cca8-8f41-4c5e-a481-854949a71d2a', 'serial': '7ab0cca8-8f41-4c5e-a481-854949a71d2a'}, 'attachment_id': '72a3b349-034f-4dc9-81d0-5a4974ecfac8', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:39:27 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 18 18:39:27 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.objects.instance [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lazy-loading 'vcpu_model' on Instance uuid df36071b-3fe8-48fb-9a17-818eb391779e {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNOYnzqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:39:27 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:39:27 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:39:27 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab412c12-9303-45f7-a104-2842547d873a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:39:27 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[00573bda-4ac0-41f9-b2ca-85d696002564]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a] added
Nov 18 18:39:27 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1032ccb-a7e2-43a9-a654-34d2f0241fa6]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0e646d-c87f-4ede-ab16-a73efb683a0a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNOYnzqi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNOYnzqi" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bbb5dc-42ac-496b-921a-b37accc71b8e]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eNOYnzqi'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9d166d-c3be-4df6-8b00-6f529993a667]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[800982c2-7948-4720-8ce3-d0cf4176cb8d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:27 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:27 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:27 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:27 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.compute.manager [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[002ea627-6429-4ed9-bb23-8f70c08834fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260]
Nov 18 18:39:27 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260] successful.
Nov 18 18:39:27 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9474cefd-b04f-4067-9154-d90211f1d445]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.compute.manager [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.network.neutron [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:27 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa2d376-c4e3-4925-bedb-293cf2db0ecc]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:27 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:27 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:39:27 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:27 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:27 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:39:27 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.compute.manager [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8cb76c-fdb7-43c3-9d16-17b056e61f3c]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNOYnzqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.policy [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4286ee787ba4de8b4318f8e14259b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2df1316b5841adb2eadb476e70fcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.compute.manager [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:39:27 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Creating image(s)
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "/opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "/opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "/opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk 1073741824" returned: 0 in 0.059s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.network.neutron [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Successfully created port: 6f50121f-e38b-4e98-a37f-a9f272ded70a {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Cannot resize image /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Ensure instance console log exists: /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23665663166653965', 'path': '/dev/sdc'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665663166653965', 'path': '/dev/sdc'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T18:37:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1958383659',display_name='tempest-ServerActionsTestOtherA-server-1949595915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1958383659',id=26,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEepvhZskUYCdoSVABjCMgkFhwHmKrLIlSb5MlTcYjLz28VYCfC+0IzqpuCb73UGLxPXmt6l+8kjRWWYRsZLnLqwdnSFiKEGucHC8txk27WtUcZ44pwuuyqHzczpHxGwIg==',key_name='tempest-keypair-916762113',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:37:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fdb006c6267b42fab703cfc24d93052e',ramdisk_id='',reservation_id='r-5javkpip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2047740053',owner_user_name='tempest-ServerActionsTestOtherA-2047740053-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:39:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d126349e69864417bb5e02666efd534c',uuid=df36071b-3fe8-48fb-9a17-818eb391779e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converting VIF {"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:85:0a,bridge_name='br-int',has_traffic_filtering=True,id=1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a60bdb4-d4') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:39:28 user nova-compute[74692]:   <uuid>df36071b-3fe8-48fb-9a17-818eb391779e</uuid>
Nov 18 18:39:28 user nova-compute[74692]:   <name>instance-0000001a</name>
Nov 18 18:39:28 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:39:28 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:39:28 user nova-compute[74692]:   <metadata>
Nov 18 18:39:28 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:39:28 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:39:28 user nova-compute[74692]:       <nova:name>tempest-ServerActionsTestOtherA-server-1949595915</nova:name>
Nov 18 18:39:28 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:39:27</nova:creationTime>
Nov 18 18:39:28 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:39:28 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:39:28 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:39:28 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:39:28 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:39:28 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:39:28 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:39:28 user nova-compute[74692]:       <nova:owner>
Nov 18 18:39:28 user nova-compute[74692]:         <nova:user uuid="d126349e69864417bb5e02666efd534c">tempest-ServerActionsTestOtherA-2047740053-project-member</nova:user>
Nov 18 18:39:28 user nova-compute[74692]:         <nova:project uuid="fdb006c6267b42fab703cfc24d93052e">tempest-ServerActionsTestOtherA-2047740053</nova:project>
Nov 18 18:39:28 user nova-compute[74692]:       </nova:owner>
Nov 18 18:39:28 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:39:28 user nova-compute[74692]:       <nova:ports>
Nov 18 18:39:28 user nova-compute[74692]:         <nova:port uuid="1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6">
Nov 18 18:39:28 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 18:39:28 user nova-compute[74692]:         </nova:port>
Nov 18 18:39:28 user nova-compute[74692]:       </nova:ports>
Nov 18 18:39:28 user nova-compute[74692]:     </nova:instance>
Nov 18 18:39:28 user nova-compute[74692]:   </metadata>
Nov 18 18:39:28 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:39:28 user nova-compute[74692]:     <system>
Nov 18 18:39:28 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:39:28 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:39:28 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:39:28 user nova-compute[74692]:       <entry name="serial">df36071b-3fe8-48fb-9a17-818eb391779e</entry>
Nov 18 18:39:28 user nova-compute[74692]:       <entry name="uuid">df36071b-3fe8-48fb-9a17-818eb391779e</entry>
Nov 18 18:39:28 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:39:28 user nova-compute[74692]:     </system>
Nov 18 18:39:28 user nova-compute[74692]:   </sysinfo>
Nov 18 18:39:28 user nova-compute[74692]:   <os>
Nov 18 18:39:28 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:39:28 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:39:28 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:39:28 user nova-compute[74692]:   </os>
Nov 18 18:39:28 user nova-compute[74692]:   <features>
Nov 18 18:39:28 user nova-compute[74692]:     <acpi/>
Nov 18 18:39:28 user nova-compute[74692]:     <apic/>
Nov 18 18:39:28 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:39:28 user nova-compute[74692]:   </features>
Nov 18 18:39:28 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:39:28 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:39:28 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:39:28 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:39:28 user nova-compute[74692]:   </clock>
Nov 18 18:39:28 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:39:28 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:39:28 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:39:28 user nova-compute[74692]:   </cpu>
Nov 18 18:39:28 user nova-compute[74692]:   <devices>
Nov 18 18:39:28 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:39:28 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:39:28 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk"/>
Nov 18 18:39:28 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:39:28 user nova-compute[74692]:     </disk>
Nov 18 18:39:28 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:39:28 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:39:28 user nova-compute[74692]:       <source dev="/dev/sdc"/>
Nov 18 18:39:28 user nova-compute[74692]:       <target dev="vdb" bus="virtio"/>
Nov 18 18:39:28 user nova-compute[74692]:       <serial>7ab0cca8-8f41-4c5e-a481-854949a71d2a</serial>
Nov 18 18:39:28 user nova-compute[74692]:     </disk>
Nov 18 18:39:28 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:39:28 user nova-compute[74692]:       <mac address="fa:16:3e:a8:85:0a"/>
Nov 18 18:39:28 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:39:28 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:39:28 user nova-compute[74692]:       <target dev="tap1a60bdb4-d4"/>
Nov 18 18:39:28 user nova-compute[74692]:     </interface>
Nov 18 18:39:28 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:39:28 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/console.log" append="off"/>
Nov 18 18:39:28 user nova-compute[74692]:     </serial>
Nov 18 18:39:28 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:39:28 user nova-compute[74692]:     <video>
Nov 18 18:39:28 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:39:28 user nova-compute[74692]:     </video>
Nov 18 18:39:28 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:39:28 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:39:28 user nova-compute[74692]:     </rng>
Nov 18 18:39:28 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:39:28 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:39:28 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:39:28 user nova-compute[74692]:     </memballoon>
Nov 18 18:39:28 user nova-compute[74692]:   </devices>
Nov 18 18:39:28 user nova-compute[74692]: </domain>
Nov 18 18:39:28 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T18:37:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1958383659',display_name='tempest-ServerActionsTestOtherA-server-1949595915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1958383659',id=26,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEepvhZskUYCdoSVABjCMgkFhwHmKrLIlSb5MlTcYjLz28VYCfC+0IzqpuCb73UGLxPXmt6l+8kjRWWYRsZLnLqwdnSFiKEGucHC8txk27WtUcZ44pwuuyqHzczpHxGwIg==',key_name='tempest-keypair-916762113',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:37:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fdb006c6267b42fab703cfc24d93052e',ramdisk_id='',reservation_id='r-5javkpip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2047740053',owner_user_name='tempest-ServerActionsTestOtherA-2047740053-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:39:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d126349e69864417bb5e02666efd534c',uuid=df36071b-3fe8-48fb-9a17-818eb391779e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converting VIF {"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:85:0a,bridge_name='br-int',has_traffic_filtering=True,id=1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a60bdb4-d4') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG os_vif [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:85:0a,bridge_name='br-int',has_traffic_filtering=True,id=1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a60bdb4-d4') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3192da7a-992b-58ae-b89e-a83a43f589e5', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a60bdb4-d4, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a60bdb4-d4, col_values=(('qos', UUID('53c6d156-6450-4714-8c05-e5da24fa6ddc')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a60bdb4-d4, col_values=(('external_ids', {'iface-id': '1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:85:0a', 'vm-uuid': 'df36071b-3fe8-48fb-9a17-818eb391779e'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:28 user nova-compute[74692]: INFO os_vif [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:85:0a,bridge_name='br-int',has_traffic_filtering=True,id=1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a60bdb4-d4')
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] No VIF found with MAC fa:16:3e:a8:85:0a, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.network.neutron [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Successfully updated port: 6f50121f-e38b-4e98-a37f-a9f272ded70a {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "refresh_cache-30beb8e4-0363-41e0-8089-04bef2539f4d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquired lock "refresh_cache-30beb8e4-0363-41e0-8089-04bef2539f4d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.network.neutron [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-829381cb-10be-4dc6-aaf9-317de44c6c76 req-4002b820-5f1e-4c5f-a8f3-31b38952d4aa service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Received event network-changed-6f50121f-e38b-4e98-a37f-a9f272ded70a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-829381cb-10be-4dc6-aaf9-317de44c6c76 req-4002b820-5f1e-4c5f-a8f3-31b38952d4aa service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Refreshing instance network info cache due to event network-changed-6f50121f-e38b-4e98-a37f-a9f272ded70a. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-829381cb-10be-4dc6-aaf9-317de44c6c76 req-4002b820-5f1e-4c5f-a8f3-31b38952d4aa service nova] Acquiring lock "refresh_cache-30beb8e4-0363-41e0-8089-04bef2539f4d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:39:28 user nova-compute[74692]: DEBUG nova.network.neutron [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.network.neutron [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Updating instance_info_cache with network_info: [{"id": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "address": "fa:16:3e:13:6d:73", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f50121f-e3", "ovs_interfaceid": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Releasing lock "refresh_cache-30beb8e4-0363-41e0-8089-04bef2539f4d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.compute.manager [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Instance network_info: |[{"id": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "address": "fa:16:3e:13:6d:73", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f50121f-e3", "ovs_interfaceid": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-829381cb-10be-4dc6-aaf9-317de44c6c76 req-4002b820-5f1e-4c5f-a8f3-31b38952d4aa service nova] Acquired lock "refresh_cache-30beb8e4-0363-41e0-8089-04bef2539f4d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.network.neutron [req-829381cb-10be-4dc6-aaf9-317de44c6c76 req-4002b820-5f1e-4c5f-a8f3-31b38952d4aa service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Refreshing network info cache for port 6f50121f-e38b-4e98-a37f-a9f272ded70a {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Start _get_guest_xml network_info=[{"id": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "address": "fa:16:3e:13:6d:73", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f50121f-e3", "ovs_interfaceid": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:39:29 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:39:29 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2092295282',display_name='tempest-ServersNegativeTestJSON-server-2092295282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2092295282',id=27,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e2df1316b5841adb2eadb476e70fcb1',ramdisk_id='',reservation_id='r-th6l80oi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1078755651',owner_user_name='tempest-ServersNegativeTestJSON-1078755651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:39:27Z,user_data=None,user_id='b4286ee787ba4de8b4318f8e14259b52',uuid=30beb8e4-0363-41e0-8089-04bef2539f4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "address": "fa:16:3e:13:6d:73", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f50121f-e3", "ovs_interfaceid": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Converting VIF {"id": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "address": "fa:16:3e:13:6d:73", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f50121f-e3", "ovs_interfaceid": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6d:73,bridge_name='br-int',has_traffic_filtering=True,id=6f50121f-e38b-4e98-a37f-a9f272ded70a,network=Network(096fe7c9-e167-4c06-a783-984e868249dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f50121f-e3') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.objects.instance [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lazy-loading 'pci_devices' on Instance uuid 30beb8e4-0363-41e0-8089-04bef2539f4d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:29 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 is timed out.
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:39:29 user nova-compute[74692]:   <uuid>30beb8e4-0363-41e0-8089-04bef2539f4d</uuid>
Nov 18 18:39:29 user nova-compute[74692]:   <name>instance-0000001b</name>
Nov 18 18:39:29 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:39:29 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:39:29 user nova-compute[74692]:   <metadata>
Nov 18 18:39:29 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:39:29 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:39:29 user nova-compute[74692]:       <nova:name>tempest-ServersNegativeTestJSON-server-2092295282</nova:name>
Nov 18 18:39:29 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:39:29</nova:creationTime>
Nov 18 18:39:29 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:39:29 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:39:29 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:39:29 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:39:29 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:39:29 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:39:29 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:39:29 user nova-compute[74692]:       <nova:owner>
Nov 18 18:39:29 user nova-compute[74692]:         <nova:user uuid="b4286ee787ba4de8b4318f8e14259b52">tempest-ServersNegativeTestJSON-1078755651-project-member</nova:user>
Nov 18 18:39:29 user nova-compute[74692]:         <nova:project uuid="3e2df1316b5841adb2eadb476e70fcb1">tempest-ServersNegativeTestJSON-1078755651</nova:project>
Nov 18 18:39:29 user nova-compute[74692]:       </nova:owner>
Nov 18 18:39:29 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:39:29 user nova-compute[74692]:       <nova:ports>
Nov 18 18:39:29 user nova-compute[74692]:         <nova:port uuid="6f50121f-e38b-4e98-a37f-a9f272ded70a">
Nov 18 18:39:29 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 18:39:29 user nova-compute[74692]:         </nova:port>
Nov 18 18:39:29 user nova-compute[74692]:       </nova:ports>
Nov 18 18:39:29 user nova-compute[74692]:     </nova:instance>
Nov 18 18:39:29 user nova-compute[74692]:   </metadata>
Nov 18 18:39:29 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:39:29 user nova-compute[74692]:     <system>
Nov 18 18:39:29 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:39:29 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:39:29 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:39:29 user nova-compute[74692]:       <entry name="serial">30beb8e4-0363-41e0-8089-04bef2539f4d</entry>
Nov 18 18:39:29 user nova-compute[74692]:       <entry name="uuid">30beb8e4-0363-41e0-8089-04bef2539f4d</entry>
Nov 18 18:39:29 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:39:29 user nova-compute[74692]:     </system>
Nov 18 18:39:29 user nova-compute[74692]:   </sysinfo>
Nov 18 18:39:29 user nova-compute[74692]:   <os>
Nov 18 18:39:29 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:39:29 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:39:29 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:39:29 user nova-compute[74692]:   </os>
Nov 18 18:39:29 user nova-compute[74692]:   <features>
Nov 18 18:39:29 user nova-compute[74692]:     <acpi/>
Nov 18 18:39:29 user nova-compute[74692]:     <apic/>
Nov 18 18:39:29 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:39:29 user nova-compute[74692]:   </features>
Nov 18 18:39:29 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:39:29 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:39:29 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:39:29 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:39:29 user nova-compute[74692]:   </clock>
Nov 18 18:39:29 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:39:29 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:39:29 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:39:29 user nova-compute[74692]:   </cpu>
Nov 18 18:39:29 user nova-compute[74692]:   <devices>
Nov 18 18:39:29 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:39:29 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:39:29 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk"/>
Nov 18 18:39:29 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:39:29 user nova-compute[74692]:     </disk>
Nov 18 18:39:29 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:39:29 user nova-compute[74692]:       <mac address="fa:16:3e:13:6d:73"/>
Nov 18 18:39:29 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:39:29 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:39:29 user nova-compute[74692]:       <target dev="tap6f50121f-e3"/>
Nov 18 18:39:29 user nova-compute[74692]:     </interface>
Nov 18 18:39:29 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:39:29 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/console.log" append="off"/>
Nov 18 18:39:29 user nova-compute[74692]:     </serial>
Nov 18 18:39:29 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:39:29 user nova-compute[74692]:     <video>
Nov 18 18:39:29 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:39:29 user nova-compute[74692]:     </video>
Nov 18 18:39:29 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:39:29 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:39:29 user nova-compute[74692]:     </rng>
Nov 18 18:39:29 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:39:29 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:39:29 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:39:29 user nova-compute[74692]:     </memballoon>
Nov 18 18:39:29 user nova-compute[74692]:   </devices>
Nov 18 18:39:29 user nova-compute[74692]: </domain>
Nov 18 18:39:29 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2092295282',display_name='tempest-ServersNegativeTestJSON-server-2092295282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2092295282',id=27,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e2df1316b5841adb2eadb476e70fcb1',ramdisk_id='',reservation_id='r-th6l80oi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1078755651',owner_user_name='tempest-ServersNegativeTestJSON-1078755651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:39:27Z,user_data=None,user_id='b4286ee787ba4de8b4318f8e14259b52',uuid=30beb8e4-0363-41e0-8089-04bef2539f4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "address": "fa:16:3e:13:6d:73", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f50121f-e3", "ovs_interfaceid": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Converting VIF {"id": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "address": "fa:16:3e:13:6d:73", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f50121f-e3", "ovs_interfaceid": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6d:73,bridge_name='br-int',has_traffic_filtering=True,id=6f50121f-e38b-4e98-a37f-a9f272ded70a,network=Network(096fe7c9-e167-4c06-a783-984e868249dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f50121f-e3') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_vif [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6d:73,bridge_name='br-int',has_traffic_filtering=True,id=6f50121f-e38b-4e98-a37f-a9f272ded70a,network=Network(096fe7c9-e167-4c06-a783-984e868249dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f50121f-e3') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:39:29 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Successfully detached device vdb from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the live domain config.
Nov 18 18:39:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e41bb966-b58d-5e01-8468-ede575f38f20', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRjIkmBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:39:29 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f50121f-e3, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f50121f-e3, col_values=(('qos', UUID('221a3d3a-2a5c-4229-9d99-7f5f539b8b98')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f50121f-e3, col_values=(('external_ids', {'iface-id': '6f50121f-e38b-4e98-a37f-a9f272ded70a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:6d:73', 'vm-uuid': '30beb8e4-0363-41e0-8089-04bef2539f4d'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b360a927-ab82-4be5-aea5-60b9ad62d9d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:39:29 user nova-compute[74692]: No targets found.
Nov 18 18:39:29 user nova-compute[74692]: iSNS:
Nov 18 18:39:29 user nova-compute[74692]: No targets found.
Nov 18 18:39:29 user nova-compute[74692]: STATIC:
Nov 18 18:39:29 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b
Nov 18 18:39:29 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:39:29 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:39:29 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a
Nov 18 18:39:29 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:39:29 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:39:29 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:39:29 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:39:29 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:39:29 user nova-compute[74692]: FIRMWARE:
Nov 18 18:39:29 user nova-compute[74692]: No targets found.
Nov 18 18:39:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:39:29 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:39:29 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:29 user nova-compute[74692]: INFO os_vif [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6d:73,bridge_name='br-int',has_traffic_filtering=True,id=6f50121f-e38b-4e98-a37f-a9f272ded70a,network=Network(096fe7c9-e167-4c06-a783-984e868249dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f50121f-e3')
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f241cb-30c3-4bce-aad0-b534037f0cda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6ede85-2a59-4158-96c4-761975afaf05]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:29 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:29 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:39:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:39:29 user nova-compute[74692]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b (non-flash)
Nov 18 18:39:29 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:39:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a4785c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b'): ({'sde'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Removing single pathed devices sde {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7c76eb-b358-4a7f-b905-bc677031b484]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] No VIF found with MAC fa:16:3e:13:6d:73, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fe8f54-7ac5-4feb-8e5c-5532e27a547c]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Flushing IO for device /dev/sde {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e834a30-4b9b-4ef7-be66-7f5087c6f1c5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[014635ba-bae4-42b9-848d-5f9fcf7bf653]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] SCSI volumes sde have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8904bb9c-b54a-4272-b464-0c902d501075]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.network.neutron [req-829381cb-10be-4dc6-aaf9-317de44c6c76 req-4002b820-5f1e-4c5f-a8f3-31b38952d4aa service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Updated VIF entry in instance network info cache for port 6f50121f-e38b-4e98-a37f-a9f272ded70a. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.network.neutron [req-829381cb-10be-4dc6-aaf9-317de44c6c76 req-4002b820-5f1e-4c5f-a8f3-31b38952d4aa service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Updating instance_info_cache with network_info: [{"id": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "address": "fa:16:3e:13:6d:73", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f50121f-e3", "ovs_interfaceid": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[637e5169-726f-45f7-b6a4-d83de887417a]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b, portal: 172.16.0.220,3260]
Nov 18 18:39:29 user nova-compute[74692]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b, portal: 172.16.0.220,3260] successful.
Nov 18 18:39:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-829381cb-10be-4dc6-aaf9-317de44c6c76 req-4002b820-5f1e-4c5f-a8f3-31b38952d4aa service nova] Releasing lock "refresh_cache-30beb8e4-0363-41e0-8089-04bef2539f4d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98da4bed-2d6c-465d-8ef2-5931e7bd204b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b4eaaa-6e5c-4f58-b1d4-a5088d0e1160]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] <== disconnect_volume: return (339ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:39:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG nova.objects.instance [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lazy-loading 'flavor' on Instance uuid 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-02048943-f390-4067-82f0-58a42d0dc53c tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.773s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-ace73298-68ba-4c91-b741-e4d6e928e0a4 req-6e70e9b5-2d94-4f6c-b637-45eac1825883 service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received event network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ace73298-68ba-4c91-b741-e4d6e928e0a4 req-6e70e9b5-2d94-4f6c-b637-45eac1825883 service nova] Acquiring lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ace73298-68ba-4c91-b741-e4d6e928e0a4 req-6e70e9b5-2d94-4f6c-b637-45eac1825883 service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ace73298-68ba-4c91-b741-e4d6e928e0a4 req-6e70e9b5-2d94-4f6c-b637-45eac1825883 service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-ace73298-68ba-4c91-b741-e4d6e928e0a4 req-6e70e9b5-2d94-4f6c-b637-45eac1825883 service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] No waiting events found dispatching network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:30 user nova-compute[74692]: WARNING nova.compute.manager [req-ace73298-68ba-4c91-b741-e4d6e928e0a4 req-6e70e9b5-2d94-4f6c-b637-45eac1825883 service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received unexpected event network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 for instance with vm_state active and task_state rebuild_spawning.
Nov 18 18:39:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-ace73298-68ba-4c91-b741-e4d6e928e0a4 req-6e70e9b5-2d94-4f6c-b637-45eac1825883 service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received event network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ace73298-68ba-4c91-b741-e4d6e928e0a4 req-6e70e9b5-2d94-4f6c-b637-45eac1825883 service nova] Acquiring lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ace73298-68ba-4c91-b741-e4d6e928e0a4 req-6e70e9b5-2d94-4f6c-b637-45eac1825883 service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ace73298-68ba-4c91-b741-e4d6e928e0a4 req-6e70e9b5-2d94-4f6c-b637-45eac1825883 service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-ace73298-68ba-4c91-b741-e4d6e928e0a4 req-6e70e9b5-2d94-4f6c-b637-45eac1825883 service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] No waiting events found dispatching network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:30 user nova-compute[74692]: WARNING nova.compute.manager [req-ace73298-68ba-4c91-b741-e4d6e928e0a4 req-6e70e9b5-2d94-4f6c-b637-45eac1825883 service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received unexpected event network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 for instance with vm_state active and task_state rebuild_spawning.
Nov 18 18:39:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:31 user nova-compute[74692]: INFO nova.compute.manager [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Terminating instance
Nov 18 18:39:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:39:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "f3140c56-acf5-4cde-bd8c-273563540451" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "f3140c56-acf5-4cde-bd8c-273563540451" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:31 user nova-compute[74692]: INFO nova.compute.manager [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Unshelving
Nov 18 18:39:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:31 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'pci_requests' on Instance uuid f3140c56-acf5-4cde-bd8c-273563540451 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'numa_topology' on Instance uuid f3140c56-acf5-4cde-bd8c-273563540451 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:39:32 user nova-compute[74692]: INFO nova.compute.claims [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Claim successful on node user
Nov 18 18:39:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-3e07ee8c-0efb-4e7f-843f-9b4e70570d3a req-b64e67d1-1283-4ca7-94d2-0abaaea4cbfb service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Received event network-vif-plugged-6f50121f-e38b-4e98-a37f-a9f272ded70a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3e07ee8c-0efb-4e7f-843f-9b4e70570d3a req-b64e67d1-1283-4ca7-94d2-0abaaea4cbfb service nova] Acquiring lock "30beb8e4-0363-41e0-8089-04bef2539f4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3e07ee8c-0efb-4e7f-843f-9b4e70570d3a req-b64e67d1-1283-4ca7-94d2-0abaaea4cbfb service nova] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3e07ee8c-0efb-4e7f-843f-9b4e70570d3a req-b64e67d1-1283-4ca7-94d2-0abaaea4cbfb service nova] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-3e07ee8c-0efb-4e7f-843f-9b4e70570d3a req-b64e67d1-1283-4ca7-94d2-0abaaea4cbfb service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] No waiting events found dispatching network-vif-plugged-6f50121f-e38b-4e98-a37f-a9f272ded70a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:32 user nova-compute[74692]: WARNING nova.compute.manager [req-3e07ee8c-0efb-4e7f-843f-9b4e70570d3a req-b64e67d1-1283-4ca7-94d2-0abaaea4cbfb service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Received unexpected event network-vif-plugged-6f50121f-e38b-4e98-a37f-a9f272ded70a for instance with vm_state building and task_state spawning.
Nov 18 18:39:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Instance destroyed successfully.
Nov 18 18:39:32 user nova-compute[74692]: DEBUG nova.objects.instance [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lazy-loading 'resources' on Instance uuid 4a20894d-58ea-4ebb-a39f-9746ccb277eb {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-914646254',display_name='tempest-TestStampPattern-server-914646254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-914646254',id=24,image_ref='c8b8c49e-4674-4c7d-a064-9d71ee29f690',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB7akI9Ef5IF2ubc0pOGpfPsCLfKgXlGgPf6VXPlA0zR+68LnHP3vVrar+LjgpmnH9dLlzovoA0gykf7I0UDbFjCuPzygvOsGrahVjnNx7QVyzmocIYPH6AmctAdhsRVw==',key_name='tempest-TestStampPattern-1083759675',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:36:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c72c980ad5b43bfb3e021d8c945a72c',ramdisk_id='',reservation_id='r-7q7l2zvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='873169f2-f1a7-4c16-8b8c-88767fea7fc9',image_min_disk='1',image_min_ram='0',image_owner_id='8c72c980ad5b43bfb3e021d8c945a72c',image_owner_project_name='tempest-TestStampPattern-180669565',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-180669565-project-member',image_user_id='06701e65ca164dcc9156a1b0980c2456',owner_project_name='tempest-TestStampPattern-180669565',owner_user_name='tempest-TestStampPattern-180669565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:36:45Z,user_data=None,user_id='06701e65ca164dcc9156a1b0980c2456',uuid=4a20894d-58ea-4ebb-a39f-9746ccb277eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "address": "fa:16:3e:27:c6:e2", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932b913e-8e", "ovs_interfaceid": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Converting VIF {"id": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "address": "fa:16:3e:27:c6:e2", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932b913e-8e", "ovs_interfaceid": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:c6:e2,bridge_name='br-int',has_traffic_filtering=True,id=932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8,network=Network(d592abe8-2581-4e23-93f9-c3676958cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932b913e-8e') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG os_vif [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:c6:e2,bridge_name='br-int',has_traffic_filtering=True,id=932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8,network=Network(d592abe8-2581-4e23-93f9-c3676958cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932b913e-8e') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap932b913e-8e, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5a080a3-ff84-4734-88a9-22e8d910cfbe) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:32 user nova-compute[74692]: INFO os_vif [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:c6:e2,bridge_name='br-int',has_traffic_filtering=True,id=932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8,network=Network(d592abe8-2581-4e23-93f9-c3676958cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932b913e-8e')
Nov 18 18:39:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Deleting instance files /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb_del
Nov 18 18:39:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Deletion of /opt/stack/data/nova/instances/4a20894d-58ea-4ebb-a39f-9746ccb277eb_del complete
Nov 18 18:39:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:32 user nova-compute[74692]: INFO nova.compute.manager [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 18 18:39:32 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-f01fa502-71ce-4dc6-9903-1ceac91262e8 req-116602e2-c273-48b3-b623-2cde19e18733 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Received event network-changed-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-f01fa502-71ce-4dc6-9903-1ceac91262e8 req-116602e2-c273-48b3-b623-2cde19e18733 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Refreshing instance network info cache due to event network-changed-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f01fa502-71ce-4dc6-9903-1ceac91262e8 req-116602e2-c273-48b3-b623-2cde19e18733 service nova] Acquiring lock "refresh_cache-4a20894d-58ea-4ebb-a39f-9746ccb277eb" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f01fa502-71ce-4dc6-9903-1ceac91262e8 req-116602e2-c273-48b3-b623-2cde19e18733 service nova] Acquired lock "refresh_cache-4a20894d-58ea-4ebb-a39f-9746ccb277eb" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG nova.network.neutron [req-f01fa502-71ce-4dc6-9903-1ceac91262e8 req-116602e2-c273-48b3-b623-2cde19e18733 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Refreshing network info cache for port 932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:39:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.977s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:33 user nova-compute[74692]: INFO nova.network.neutron [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Updating port 1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:39:33 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Took 0.42 seconds to deallocate network for instance.
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.network.neutron [req-f01fa502-71ce-4dc6-9903-1ceac91262e8 req-116602e2-c273-48b3-b623-2cde19e18733 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Updated VIF entry in instance network info cache for port 932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.network.neutron [req-f01fa502-71ce-4dc6-9903-1ceac91262e8 req-116602e2-c273-48b3-b623-2cde19e18733 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Updating instance_info_cache with network_info: [{"id": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "address": "fa:16:3e:27:c6:e2", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932b913e-8e", "ovs_interfaceid": "932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f01fa502-71ce-4dc6-9903-1ceac91262e8 req-116602e2-c273-48b3-b623-2cde19e18733 service nova] Releasing lock "refresh_cache-4a20894d-58ea-4ebb-a39f-9746ccb277eb" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:33 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Deleted allocations for instance 4a20894d-58ea-4ebb-a39f-9746ccb277eb
Nov 18 18:39:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-34b9a1d8-af7b-4211-a2a7-c77538517e51 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.987s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.compute.manager [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:39:33 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Instance spawned successfully.
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.compute.manager [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:39:33 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Instance spawned successfully.
Nov 18 18:39:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.objects.instance [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74692) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 18 18:39:34 user nova-compute[74692]: INFO nova.compute.manager [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-4471aa68-59d0-4020-9b2a-d9180f20d515 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.080s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:34 user nova-compute[74692]: INFO nova.compute.manager [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Took 7.47 seconds to build instance.
Nov 18 18:39:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-afc505f6-3e59-4102-9d71-e0b217fe30c7 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.615s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Received event network-vif-plugged-6f50121f-e38b-4e98-a37f-a9f272ded70a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] Acquiring lock "30beb8e4-0363-41e0-8089-04bef2539f4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] No waiting events found dispatching network-vif-plugged-6f50121f-e38b-4e98-a37f-a9f272ded70a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:34 user nova-compute[74692]: WARNING nova.compute.manager [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Received unexpected event network-vif-plugged-6f50121f-e38b-4e98-a37f-a9f272ded70a for instance with vm_state active and task_state None.
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Received event network-vif-unplugged-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] Acquiring lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] No waiting events found dispatching network-vif-unplugged-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:34 user nova-compute[74692]: WARNING nova.compute.manager [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Received unexpected event network-vif-unplugged-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 for instance with vm_state deleted and task_state None.
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Received event network-vif-plugged-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] Acquiring lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] Lock "4a20894d-58ea-4ebb-a39f-9746ccb277eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] No waiting events found dispatching network-vif-plugged-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:34 user nova-compute[74692]: WARNING nova.compute.manager [req-2bb76f7c-0505-469b-b969-9b878be1b1ed req-cc3307ac-53b8-42f2-a2fa-82a309d56438 service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Received unexpected event network-vif-plugged-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 for instance with vm_state deleted and task_state None.
Nov 18 18:39:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquired lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-482ce292-99ee-4b60-88fa-f82b6483cc0a req-7f93aeed-af0a-452b-99e9-bf8fa0d13a5b service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Received event network-vif-deleted-932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:34 user nova-compute[74692]: INFO nova.compute.manager [req-482ce292-99ee-4b60-88fa-f82b6483cc0a req-7f93aeed-af0a-452b-99e9-bf8fa0d13a5b service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Neutron deleted interface 932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8; detaching it from the instance and deleting it from the info cache
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.network.neutron [req-482ce292-99ee-4b60-88fa-f82b6483cc0a req-7f93aeed-af0a-452b-99e9-bf8fa0d13a5b service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Instance is deleted, no further info cache update {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Nov 18 18:39:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-482ce292-99ee-4b60-88fa-f82b6483cc0a req-7f93aeed-af0a-452b-99e9-bf8fa0d13a5b service nova] [instance: 4a20894d-58ea-4ebb-a39f-9746ccb277eb] Detach interface failed, port_id=932b913e-8ec3-4c42-9dd6-d7ab8e3bffa8, reason: Instance 4a20894d-58ea-4ebb-a39f-9746ccb277eb could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:39:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:35 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Updating instance_info_cache with network_info: [{"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:39:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Releasing lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:39:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:39:35 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Creating image(s)
Nov 18 18:39:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "/opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "/opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:35 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'trusted_certs' on Instance uuid f3140c56-acf5-4cde-bd8c-273563540451 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:35 user nova-compute[74692]: DEBUG nova.objects.base [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Object Instance<f3140c56-acf5-4cde-bd8c-273563540451> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:39:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "381b3bfd6fe8e3107878f9f107b6129414b698de" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "381b3bfd6fe8e3107878f9f107b6129414b698de" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de.part --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-47431aac-89c1-4a34-bc2f-37bc5fa461e9 req-a9c333c6-ac3c-4c32-824d-235d4dd40679 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received event network-changed-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-47431aac-89c1-4a34-bc2f-37bc5fa461e9 req-a9c333c6-ac3c-4c32-824d-235d4dd40679 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Refreshing instance network info cache due to event network-changed-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:39:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-47431aac-89c1-4a34-bc2f-37bc5fa461e9 req-a9c333c6-ac3c-4c32-824d-235d4dd40679 service nova] Acquiring lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:39:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-47431aac-89c1-4a34-bc2f-37bc5fa461e9 req-a9c333c6-ac3c-4c32-824d-235d4dd40679 service nova] Acquired lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:39:36 user nova-compute[74692]: DEBUG nova.network.neutron [req-47431aac-89c1-4a34-bc2f-37bc5fa461e9 req-a9c333c6-ac3c-4c32-824d-235d4dd40679 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Refreshing network info cache for port 1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:39:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de.part --force-share --output=json" returned: 0 in 0.298s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:36 user nova-compute[74692]: DEBUG nova.virt.images [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] 5f236026-0c3a-41da-a305-aba3787aae1d was qcow2, converting to raw {{(pid=74692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 18:39:36 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:39:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de.part /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de.converted {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:37 user nova-compute[74692]: DEBUG nova.network.neutron [req-47431aac-89c1-4a34-bc2f-37bc5fa461e9 req-a9c333c6-ac3c-4c32-824d-235d4dd40679 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Updated VIF entry in instance network info cache for port 1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:39:37 user nova-compute[74692]: DEBUG nova.network.neutron [req-47431aac-89c1-4a34-bc2f-37bc5fa461e9 req-a9c333c6-ac3c-4c32-824d-235d4dd40679 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Updating instance_info_cache with network_info: [{"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:39:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de.part /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de.converted" returned: 0 in 0.510s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de.converted --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-47431aac-89c1-4a34-bc2f-37bc5fa461e9 req-a9c333c6-ac3c-4c32-824d-235d4dd40679 service nova] Releasing lock "refresh_cache-f3140c56-acf5-4cde-bd8c-273563540451" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:39:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "381b3bfd6fe8e3107878f9f107b6129414b698de" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.443s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de --force-share --output=json" returned: 0 in 0.193s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "381b3bfd6fe8e3107878f9f107b6129414b698de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "381b3bfd6fe8e3107878f9f107b6129414b698de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de --force-share --output=json" returned: 0 in 0.185s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de,backing_fmt=raw /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de,backing_fmt=raw /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk 1073741824" returned: 0 in 0.051s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "381b3bfd6fe8e3107878f9f107b6129414b698de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de --force-share --output=json" returned: 0 in 0.191s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:38 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'migration_context' on Instance uuid f3140c56-acf5-4cde-bd8c-273563540451 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:38 user nova-compute[74692]: DEBUG nova.objects.base [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Object Instance<f3140c56-acf5-4cde-bd8c-273563540451> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:39:38 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Rebasing disk image.
Nov 18 18:39:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.204s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 -F raw /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 -F raw /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk" returned: 0 in 2.146s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Ensure instance console log exists: /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Start _get_guest_xml network_info=[{"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='434f3725f6597a92e9e96662360c51b1',container_format='bare',created_at=2023-11-18T18:37:39Z,direct_url=<?>,disk_format='qcow2',id=5f236026-0c3a-41da-a305-aba3787aae1d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-539204829-shelved',owner='1f169f28da1640d9b03b4ba44b4e7b7c',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-18T18:37:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:39:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:39:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='434f3725f6597a92e9e96662360c51b1',container_format='bare',created_at=2023-11-18T18:37:39Z,direct_url=<?>,disk_format='qcow2',id=5f236026-0c3a-41da-a305-aba3787aae1d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-539204829-shelved',owner='1f169f28da1640d9b03b4ba44b4e7b7c',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-18T18:37:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'vcpu_model' on Instance uuid f3140c56-acf5-4cde-bd8c-273563540451 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.objects.base [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Object Instance<f3140c56-acf5-4cde-bd8c-273563540451> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T18:35:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-539204829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-539204829',id=22,image_ref='5f236026-0c3a-41da-a305-aba3787aae1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-151002570',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:35:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1f169f28da1640d9b03b4ba44b4e7b7c',ramdisk_id='',reservation_id='r-f44p51kz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1768400085',owner_user_name='tempest-AttachVolumeShelveTestJSON-1768400085-project-member',shelved_at='2023-11-18T18:37:43.367812',shelved_host='user',shelved_image_id='5f236026-0c3a-41da-a305-aba3787aae1d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a005c7c46c46ad9217578412ec906f',uuid=f3140c56-acf5-4cde-bd8c-273563540451,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converting VIF {"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6b:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c5f8cc6-74') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'pci_devices' on Instance uuid f3140c56-acf5-4cde-bd8c-273563540451 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.objects.base [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Object Instance<f3140c56-acf5-4cde-bd8c-273563540451> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:39:40 user nova-compute[74692]:   <uuid>f3140c56-acf5-4cde-bd8c-273563540451</uuid>
Nov 18 18:39:40 user nova-compute[74692]:   <name>instance-00000016</name>
Nov 18 18:39:40 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:39:40 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:39:40 user nova-compute[74692]:   <metadata>
Nov 18 18:39:40 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:39:40 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:39:40 user nova-compute[74692]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-539204829</nova:name>
Nov 18 18:39:40 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:39:40</nova:creationTime>
Nov 18 18:39:40 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:39:40 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:39:40 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:39:40 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:39:40 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:39:40 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:39:40 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:39:40 user nova-compute[74692]:       <nova:owner>
Nov 18 18:39:40 user nova-compute[74692]:         <nova:user uuid="c0a005c7c46c46ad9217578412ec906f">tempest-AttachVolumeShelveTestJSON-1768400085-project-member</nova:user>
Nov 18 18:39:40 user nova-compute[74692]:         <nova:project uuid="1f169f28da1640d9b03b4ba44b4e7b7c">tempest-AttachVolumeShelveTestJSON-1768400085</nova:project>
Nov 18 18:39:40 user nova-compute[74692]:       </nova:owner>
Nov 18 18:39:40 user nova-compute[74692]:       <nova:root type="image" uuid="5f236026-0c3a-41da-a305-aba3787aae1d"/>
Nov 18 18:39:40 user nova-compute[74692]:       <nova:ports>
Nov 18 18:39:40 user nova-compute[74692]:         <nova:port uuid="1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4">
Nov 18 18:39:40 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 18:39:40 user nova-compute[74692]:         </nova:port>
Nov 18 18:39:40 user nova-compute[74692]:       </nova:ports>
Nov 18 18:39:40 user nova-compute[74692]:     </nova:instance>
Nov 18 18:39:40 user nova-compute[74692]:   </metadata>
Nov 18 18:39:40 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:39:40 user nova-compute[74692]:     <system>
Nov 18 18:39:40 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:39:40 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:39:40 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:39:40 user nova-compute[74692]:       <entry name="serial">f3140c56-acf5-4cde-bd8c-273563540451</entry>
Nov 18 18:39:40 user nova-compute[74692]:       <entry name="uuid">f3140c56-acf5-4cde-bd8c-273563540451</entry>
Nov 18 18:39:40 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:39:40 user nova-compute[74692]:     </system>
Nov 18 18:39:40 user nova-compute[74692]:   </sysinfo>
Nov 18 18:39:40 user nova-compute[74692]:   <os>
Nov 18 18:39:40 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:39:40 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:39:40 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:39:40 user nova-compute[74692]:   </os>
Nov 18 18:39:40 user nova-compute[74692]:   <features>
Nov 18 18:39:40 user nova-compute[74692]:     <acpi/>
Nov 18 18:39:40 user nova-compute[74692]:     <apic/>
Nov 18 18:39:40 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:39:40 user nova-compute[74692]:   </features>
Nov 18 18:39:40 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:39:40 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:39:40 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:39:40 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:39:40 user nova-compute[74692]:   </clock>
Nov 18 18:39:40 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:39:40 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:39:40 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:39:40 user nova-compute[74692]:   </cpu>
Nov 18 18:39:40 user nova-compute[74692]:   <devices>
Nov 18 18:39:40 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:39:40 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:39:40 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk"/>
Nov 18 18:39:40 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:39:40 user nova-compute[74692]:     </disk>
Nov 18 18:39:40 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:39:40 user nova-compute[74692]:       <mac address="fa:16:3e:2a:6b:aa"/>
Nov 18 18:39:40 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:39:40 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:39:40 user nova-compute[74692]:       <target dev="tap1c5f8cc6-74"/>
Nov 18 18:39:40 user nova-compute[74692]:     </interface>
Nov 18 18:39:40 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:39:40 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/console.log" append="off"/>
Nov 18 18:39:40 user nova-compute[74692]:     </serial>
Nov 18 18:39:40 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:39:40 user nova-compute[74692]:     <video>
Nov 18 18:39:40 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:39:40 user nova-compute[74692]:     </video>
Nov 18 18:39:40 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:39:40 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:39:40 user nova-compute[74692]:     </rng>
Nov 18 18:39:40 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:39:40 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:39:40 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:39:40 user nova-compute[74692]:     </memballoon>
Nov 18 18:39:40 user nova-compute[74692]:   </devices>
Nov 18 18:39:40 user nova-compute[74692]: </domain>
Nov 18 18:39:40 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T18:35:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-539204829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-539204829',id=22,image_ref='5f236026-0c3a-41da-a305-aba3787aae1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-151002570',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:35:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1f169f28da1640d9b03b4ba44b4e7b7c',ramdisk_id='',reservation_id='r-f44p51kz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1768400085',owner_user_name='tempest-AttachVolumeShelveTestJSON-1768400085-project-member',shelved_at='2023-11-18T18:37:43.367812',shelved_host='user',shelved_image_id='5f236026-0c3a-41da-a305-aba3787aae1d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a005c7c46c46ad9217578412ec906f',uuid=f3140c56-acf5-4cde-bd8c-273563540451,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converting VIF {"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6b:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c5f8cc6-74') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG os_vif [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6b:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c5f8cc6-74') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58e88981-9f88-545f-b0d4-67b200cd8ea8', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c5f8cc6-74, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c5f8cc6-74, col_values=(('qos', UUID('e97a5722-cdfa-4940-8073-f382bec55a81')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c5f8cc6-74, col_values=(('external_ids', {'iface-id': '1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:6b:aa', 'vm-uuid': 'f3140c56-acf5-4cde-bd8c-273563540451'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:40 user nova-compute[74692]: INFO os_vif [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6b:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c5f8cc6-74')
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:39:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] No VIF found with MAC fa:16:3e:2a:6b:aa, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:39:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-57d7d417-ee94-4065-8003-21de51be85e8 req-73b57864-3905-4365-b8f4-2272ff16f3d4 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received event network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-57d7d417-ee94-4065-8003-21de51be85e8 req-73b57864-3905-4365-b8f4-2272ff16f3d4 service nova] Acquiring lock "f3140c56-acf5-4cde-bd8c-273563540451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-57d7d417-ee94-4065-8003-21de51be85e8 req-73b57864-3905-4365-b8f4-2272ff16f3d4 service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-57d7d417-ee94-4065-8003-21de51be85e8 req-73b57864-3905-4365-b8f4-2272ff16f3d4 service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-57d7d417-ee94-4065-8003-21de51be85e8 req-73b57864-3905-4365-b8f4-2272ff16f3d4 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] No waiting events found dispatching network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:42 user nova-compute[74692]: WARNING nova.compute.manager [req-57d7d417-ee94-4065-8003-21de51be85e8 req-73b57864-3905-4365-b8f4-2272ff16f3d4 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received unexpected event network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 18:39:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-1eca7c64-4973-48e9-9516-5018ae81d708 req-da8aad7d-6251-4ef1-8528-1fba61dd98de service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received event network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1eca7c64-4973-48e9-9516-5018ae81d708 req-da8aad7d-6251-4ef1-8528-1fba61dd98de service nova] Acquiring lock "f3140c56-acf5-4cde-bd8c-273563540451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1eca7c64-4973-48e9-9516-5018ae81d708 req-da8aad7d-6251-4ef1-8528-1fba61dd98de service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1eca7c64-4973-48e9-9516-5018ae81d708 req-da8aad7d-6251-4ef1-8528-1fba61dd98de service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-1eca7c64-4973-48e9-9516-5018ae81d708 req-da8aad7d-6251-4ef1-8528-1fba61dd98de service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] No waiting events found dispatching network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:44 user nova-compute[74692]: WARNING nova.compute.manager [req-1eca7c64-4973-48e9-9516-5018ae81d708 req-da8aad7d-6251-4ef1-8528-1fba61dd98de service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received unexpected event network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 18:39:44 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:39:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:39:44 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Instance spawned successfully.
Nov 18 18:39:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:39:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c862e646-4e79-40ba-83c9-9832fc0bc2af tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "f3140c56-acf5-4cde-bd8c-273563540451" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.644s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:54 user nova-compute[74692]: INFO nova.compute.manager [None req-64c3239b-933d-4d55-aed1-17dc751693f4 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Unrescuing
Nov 18 18:39:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-64c3239b-933d-4d55-aed1-17dc751693f4 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "refresh_cache-d17071fc-5d5b-4e06-8a47-05174014167c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:39:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-64c3239b-933d-4d55-aed1-17dc751693f4 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquired lock "refresh_cache-d17071fc-5d5b-4e06-8a47-05174014167c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:39:54 user nova-compute[74692]: DEBUG nova.network.neutron [None req-64c3239b-933d-4d55-aed1-17dc751693f4 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:39:54 user nova-compute[74692]: DEBUG nova.network.neutron [None req-64c3239b-933d-4d55-aed1-17dc751693f4 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Updating instance_info_cache with network_info: [{"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:39:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-64c3239b-933d-4d55-aed1-17dc751693f4 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Releasing lock "refresh_cache-d17071fc-5d5b-4e06-8a47-05174014167c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:39:54 user nova-compute[74692]: DEBUG nova.objects.instance [None req-64c3239b-933d-4d55-aed1-17dc751693f4 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'flavor' on Instance uuid d17071fc-5d5b-4e06-8a47-05174014167c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:39:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:55 user nova-compute[74692]: DEBUG nova.compute.manager [req-d11be506-78cd-4cba-80fd-d213ba62f066 req-bbc2d995-75eb-4af3-b677-0fb3f6a249c3 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received event network-vif-unplugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d11be506-78cd-4cba-80fd-d213ba62f066 req-bbc2d995-75eb-4af3-b677-0fb3f6a249c3 service nova] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d11be506-78cd-4cba-80fd-d213ba62f066 req-bbc2d995-75eb-4af3-b677-0fb3f6a249c3 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d11be506-78cd-4cba-80fd-d213ba62f066 req-bbc2d995-75eb-4af3-b677-0fb3f6a249c3 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:55 user nova-compute[74692]: DEBUG nova.compute.manager [req-d11be506-78cd-4cba-80fd-d213ba62f066 req-bbc2d995-75eb-4af3-b677-0fb3f6a249c3 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] No waiting events found dispatching network-vif-unplugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:55 user nova-compute[74692]: WARNING nova.compute.manager [req-d11be506-78cd-4cba-80fd-d213ba62f066 req-bbc2d995-75eb-4af3-b677-0fb3f6a249c3 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received unexpected event network-vif-unplugged-14c60d63-2b64-480b-bd2e-8a26567cab7e for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:39:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:55 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Instance destroyed successfully.
Nov 18 18:39:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:57 user nova-compute[74692]: DEBUG nova.compute.manager [req-731e41ee-f53c-447a-8bd3-4f7d430ce5e5 req-ce9c6b19-df6e-4d7a-b7f5-9dc7b741256f service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-731e41ee-f53c-447a-8bd3-4f7d430ce5e5 req-ce9c6b19-df6e-4d7a-b7f5-9dc7b741256f service nova] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-731e41ee-f53c-447a-8bd3-4f7d430ce5e5 req-ce9c6b19-df6e-4d7a-b7f5-9dc7b741256f service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-731e41ee-f53c-447a-8bd3-4f7d430ce5e5 req-ce9c6b19-df6e-4d7a-b7f5-9dc7b741256f service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:57 user nova-compute[74692]: DEBUG nova.compute.manager [req-731e41ee-f53c-447a-8bd3-4f7d430ce5e5 req-ce9c6b19-df6e-4d7a-b7f5-9dc7b741256f service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] No waiting events found dispatching network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:57 user nova-compute[74692]: WARNING nova.compute.manager [req-731e41ee-f53c-447a-8bd3-4f7d430ce5e5 req-ce9c6b19-df6e-4d7a-b7f5-9dc7b741256f service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received unexpected event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:39:57 user nova-compute[74692]: DEBUG nova.compute.manager [req-731e41ee-f53c-447a-8bd3-4f7d430ce5e5 req-ce9c6b19-df6e-4d7a-b7f5-9dc7b741256f service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-731e41ee-f53c-447a-8bd3-4f7d430ce5e5 req-ce9c6b19-df6e-4d7a-b7f5-9dc7b741256f service nova] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-731e41ee-f53c-447a-8bd3-4f7d430ce5e5 req-ce9c6b19-df6e-4d7a-b7f5-9dc7b741256f service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-731e41ee-f53c-447a-8bd3-4f7d430ce5e5 req-ce9c6b19-df6e-4d7a-b7f5-9dc7b741256f service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:57 user nova-compute[74692]: DEBUG nova.compute.manager [req-731e41ee-f53c-447a-8bd3-4f7d430ce5e5 req-ce9c6b19-df6e-4d7a-b7f5-9dc7b741256f service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] No waiting events found dispatching network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:57 user nova-compute[74692]: WARNING nova.compute.manager [req-731e41ee-f53c-447a-8bd3-4f7d430ce5e5 req-ce9c6b19-df6e-4d7a-b7f5-9dc7b741256f service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received unexpected event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:39:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:39:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-64c3239b-933d-4d55-aed1-17dc751693f4 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:39:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-fed4153b-4cd3-466c-93cc-44dcfc05ecb2 req-943940d8-2996-466a-95ff-5176d6e223fb service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:39:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fed4153b-4cd3-466c-93cc-44dcfc05ecb2 req-943940d8-2996-466a-95ff-5176d6e223fb service nova] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:39:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fed4153b-4cd3-466c-93cc-44dcfc05ecb2 req-943940d8-2996-466a-95ff-5176d6e223fb service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:39:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fed4153b-4cd3-466c-93cc-44dcfc05ecb2 req-943940d8-2996-466a-95ff-5176d6e223fb service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:39:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-fed4153b-4cd3-466c-93cc-44dcfc05ecb2 req-943940d8-2996-466a-95ff-5176d6e223fb service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] No waiting events found dispatching network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:39:59 user nova-compute[74692]: WARNING nova.compute.manager [req-fed4153b-4cd3-466c-93cc-44dcfc05ecb2 req-943940d8-2996-466a-95ff-5176d6e223fb service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received unexpected event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e for instance with vm_state active and task_state None.
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG nova.objects.instance [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lazy-loading 'flavor' on Instance uuid 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:40:00 user nova-compute[74692]: INFO nova.compute.manager [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Attaching volume 9639369e-0a62-4f04-8cd8-8c0490e64bc2 to /dev/vdb
Nov 18 18:40:00 user nova-compute[74692]: DEBUG os_brick.utils [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e55229-3826-4073-b040-c8f1c92c9662]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[445ab1e8-addf-41ba-b1bb-bf3a9ae80ac1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4b7f54-8fa2-4d83-a26d-17ef13f01020]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2aa06b-f5ce-4384-a9c4-be09af2c5ea3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:40:00 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:40:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a583de-5c67-45d1-b7da-d93bcf3d3e80]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG os_brick.utils [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:40:00 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Updating existing volume attachment record: 051b85ec-4df7-4489-8cd9-a055979af861 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:40:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVUIedjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:40:06 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:40:06 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:40:06 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33fb93f-4fe9-4e63-aec9-2cc6bca97d13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:40:06 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ab90d9-83ee-46b2-9c44-c3acf198cfea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2] added
Nov 18 18:40:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae30300-c649-4344-b9ec-9007d764ee8d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2c8e4f-0abe-4dd2-87a7-bc3336063c6d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVUIedjc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVUIedjc" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[29284453-f8b9-459d-bc42-9a59c802b9ad]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JVUIedjc'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da19413-1cc7-4c73-8cad-0aac7a6c84c7]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c276f6-e255-4985-b3f9-12a896fa0dfc]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:40:06 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:40:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:40:06 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:40:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ad6941-c448-4594-88b8-ca77ef2df836]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2, portal: 172.16.0.220,3260]
Nov 18 18:40:06 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2, portal: 172.16.0.220,3260] successful.
Nov 18 18:40:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[14471e43-ead0-4713-941f-413a02fe4755]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2cabaf-263f-4030-bd3d-a5c4e903f1d8]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:40:06 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:40:06 user nova-compute[74692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 (non-flash)
Nov 18 18:40:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:40:06 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:40:06 user nova-compute[74692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 (non-flash)
Nov 18 18:40:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[605e494f-680c-4082-b0f0-1c2f0cc954ff]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:40:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVUIedjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:40:07 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:40:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:40:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26362393466366332', 'path': '/dev/sdd'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:40:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362393466366332', 'path': '/dev/sdd'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:40:07 user nova-compute[74692]: DEBUG nova.objects.instance [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lazy-loading 'flavor' on Instance uuid 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:40:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:40:07 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:40:07 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:40:07 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:40:07 user nova-compute[74692]:   <serial>9639369e-0a62-4f04-8cd8-8c0490e64bc2</serial>
Nov 18 18:40:07 user nova-compute[74692]: </disk>
Nov 18 18:40:07 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:40:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:40:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:40:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] No VIF found with MAC fa:16:3e:77:21:64, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:40:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fc743457-cf0c-4e34-9109-6f326da93fbb tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.708s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:40:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:40:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:40:10 user nova-compute[74692]: INFO nova.compute.manager [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Detaching volume 9639369e-0a62-4f04-8cd8-8c0490e64bc2
Nov 18 18:40:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:11 user nova-compute[74692]: INFO nova.virt.block_device [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Attempting to driver detach volume 9639369e-0a62-4f04-8cd8-8c0490e64bc2 from mountpoint /dev/vdb
Nov 18 18:40:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Attempting to detach device vdb from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:40:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:40:11 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:40:11 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:40:11 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:40:11 user nova-compute[74692]:   <serial>9639369e-0a62-4f04-8cd8-8c0490e64bc2</serial>
Nov 18 18:40:11 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:40:11 user nova-compute[74692]: </disk>
Nov 18 18:40:11 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:40:11 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Successfully detached device vdb from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the persistent domain config.
Nov 18 18:40:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:40:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:40:11 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:40:11 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:40:11 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:40:11 user nova-compute[74692]:   <serial>9639369e-0a62-4f04-8cd8-8c0490e64bc2</serial>
Nov 18 18:40:11 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:40:11 user nova-compute[74692]: </disk>
Nov 18 18:40:11 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:40:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:40:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:12 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:40:12 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:40:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:40:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:40:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:40:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:40:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:40:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:40:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:17 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:40:17 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7507MB free_disk=24.858165740966797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 873169f2-f1a7-4c16-8b8c-88767fea7fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance df36071b-3fe8-48fb-9a17-818eb391779e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 30beb8e4-0363-41e0-8089-04bef2539f4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance f3140c56-acf5-4cde-bd8c-273563540451 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing inventories for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating ProviderTree inventory for provider 582be55c-ee9f-496e-b354-5900b8401d2c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 18:40:17 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating inventory in ProviderTree for provider 582be55c-ee9f-496e-b354-5900b8401d2c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 18:40:18 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing aggregate associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, aggregates: None {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 18:40:18 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing trait associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 18:40:18 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:40:18 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:40:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:40:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.625s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:40:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:40:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:40:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:40:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:40:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:40:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:40:22 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:40:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:40:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:40:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:40:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:40:24 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:40:24 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Updating instance_info_cache with network_info: [{"id": "42c3c7e8-f568-4a60-9613-152317e0543a", "address": "fa:16:3e:13:1b:f6", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42c3c7e8-f5", "ovs_interfaceid": "42c3c7e8-f568-4a60-9613-152317e0543a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:40:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:40:24 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:40:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:40:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 18:40:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:40:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:40:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:40:30 user nova-compute[74692]: INFO nova.compute.manager [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Terminating instance
Nov 18 18:40:30 user nova-compute[74692]: DEBUG nova.compute.manager [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-249ac666-f06e-40a2-914e-c2170384c25f req-238958fb-b3ce-4827-808a-00eab251fc6d service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Received event network-changed-48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-249ac666-f06e-40a2-914e-c2170384c25f req-238958fb-b3ce-4827-808a-00eab251fc6d service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Refreshing instance network info cache due to event network-changed-48b99854-18f7-4fb9-b31f-9e669aa9fa6a. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-249ac666-f06e-40a2-914e-c2170384c25f req-238958fb-b3ce-4827-808a-00eab251fc6d service nova] Acquiring lock "refresh_cache-873169f2-f1a7-4c16-8b8c-88767fea7fc9" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-249ac666-f06e-40a2-914e-c2170384c25f req-238958fb-b3ce-4827-808a-00eab251fc6d service nova] Acquired lock "refresh_cache-873169f2-f1a7-4c16-8b8c-88767fea7fc9" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG nova.network.neutron [req-249ac666-f06e-40a2-914e-c2170384c25f req-238958fb-b3ce-4827-808a-00eab251fc6d service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Refreshing network info cache for port 48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-3e34c545-2cc9-44d1-81ef-831aeb8a6f47 req-a02205bc-28cd-4178-bee0-18d00c4eaf81 service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Received event network-vif-unplugged-48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3e34c545-2cc9-44d1-81ef-831aeb8a6f47 req-a02205bc-28cd-4178-bee0-18d00c4eaf81 service nova] Acquiring lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3e34c545-2cc9-44d1-81ef-831aeb8a6f47 req-a02205bc-28cd-4178-bee0-18d00c4eaf81 service nova] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3e34c545-2cc9-44d1-81ef-831aeb8a6f47 req-a02205bc-28cd-4178-bee0-18d00c4eaf81 service nova] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-3e34c545-2cc9-44d1-81ef-831aeb8a6f47 req-a02205bc-28cd-4178-bee0-18d00c4eaf81 service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] No waiting events found dispatching network-vif-unplugged-48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-3e34c545-2cc9-44d1-81ef-831aeb8a6f47 req-a02205bc-28cd-4178-bee0-18d00c4eaf81 service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Received event network-vif-unplugged-48b99854-18f7-4fb9-b31f-9e669aa9fa6a for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG nova.network.neutron [req-249ac666-f06e-40a2-914e-c2170384c25f req-238958fb-b3ce-4827-808a-00eab251fc6d service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Updated VIF entry in instance network info cache for port 48b99854-18f7-4fb9-b31f-9e669aa9fa6a. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG nova.network.neutron [req-249ac666-f06e-40a2-914e-c2170384c25f req-238958fb-b3ce-4827-808a-00eab251fc6d service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Updating instance_info_cache with network_info: [{"id": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "address": "fa:16:3e:ae:20:b0", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b99854-18", "ovs_interfaceid": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-249ac666-f06e-40a2-914e-c2170384c25f req-238958fb-b3ce-4827-808a-00eab251fc6d service nova] Releasing lock "refresh_cache-873169f2-f1a7-4c16-8b8c-88767fea7fc9" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:30 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Instance destroyed successfully.
Nov 18 18:40:30 user nova-compute[74692]: DEBUG nova.objects.instance [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lazy-loading 'resources' on Instance uuid 873169f2-f1a7-4c16-8b8c-88767fea7fc9 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1596301347',display_name='tempest-TestStampPattern-server-1596301347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1596301347',id=20,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB7akI9Ef5IF2ubc0pOGpfPsCLfKgXlGgPf6VXPlA0zR+68LnHP3vVrar+LjgpmnH9dLlzovoA0gykf7I0UDbFjCuPzygvOsGrahVjnNx7QVyzmocIYPH6AmctAdhsRVw==',key_name='tempest-TestStampPattern-1083759675',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c72c980ad5b43bfb3e021d8c945a72c',ramdisk_id='',reservation_id='r-j3a0107l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-180669565',owner_user_name='tempest-TestStampPattern-180669565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:36:35Z,user_data=None,user_id='06701e65ca164dcc9156a1b0980c2456',uuid=873169f2-f1a7-4c16-8b8c-88767fea7fc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "address": "fa:16:3e:ae:20:b0", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b99854-18", "ovs_interfaceid": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Converting VIF {"id": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "address": "fa:16:3e:ae:20:b0", "network": {"id": "d592abe8-2581-4e23-93f9-c3676958cfea", "bridge": "br-int", "label": "tempest-TestStampPattern-374591462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c72c980ad5b43bfb3e021d8c945a72c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b99854-18", "ovs_interfaceid": "48b99854-18f7-4fb9-b31f-9e669aa9fa6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:20:b0,bridge_name='br-int',has_traffic_filtering=True,id=48b99854-18f7-4fb9-b31f-9e669aa9fa6a,network=Network(d592abe8-2581-4e23-93f9-c3676958cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48b99854-18') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:40:30 user nova-compute[74692]: DEBUG os_vif [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:20:b0,bridge_name='br-int',has_traffic_filtering=True,id=48b99854-18f7-4fb9-b31f-9e669aa9fa6a,network=Network(d592abe8-2581-4e23-93f9-c3676958cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48b99854-18') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48b99854-18, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b076cc7b-0168-4b59-b966-781f703c7a78) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:31 user nova-compute[74692]: INFO os_vif [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:20:b0,bridge_name='br-int',has_traffic_filtering=True,id=48b99854-18f7-4fb9-b31f-9e669aa9fa6a,network=Network(d592abe8-2581-4e23-93f9-c3676958cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48b99854-18')
Nov 18 18:40:31 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Deleting instance files /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9_del
Nov 18 18:40:31 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Deletion of /opt/stack/data/nova/instances/873169f2-f1a7-4c16-8b8c-88767fea7fc9_del complete
Nov 18 18:40:31 user nova-compute[74692]: INFO nova.compute.manager [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:40:31 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Took 0.39 seconds to deallocate network for instance.
Nov 18 18:40:31 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 is timed out.
Nov 18 18:40:31 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Successfully detached device vdb from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the live domain config.
Nov 18 18:40:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVUIedjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:40:31 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad26dfdf-26e5-407e-a95a-b0d1d9c1296d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:40:31 user nova-compute[74692]: No targets found.
Nov 18 18:40:31 user nova-compute[74692]: iSNS:
Nov 18 18:40:31 user nova-compute[74692]: No targets found.
Nov 18 18:40:31 user nova-compute[74692]: STATIC:
Nov 18 18:40:31 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2
Nov 18 18:40:31 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:40:31 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:40:31 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a
Nov 18 18:40:31 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:40:31 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:40:31 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:40:31 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:40:31 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:40:31 user nova-compute[74692]: FIRMWARE:
Nov 18 18:40:31 user nova-compute[74692]: No targets found.
Nov 18 18:40:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:40:31 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:40:31 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4681155-f301-4217-825c-8bf9a060a6bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[653f8d2e-0bde-452f-a045-63135a30fd4e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:40:31 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:40:31 user nova-compute[74692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 (non-flash)
Nov 18 18:40:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:40:31 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:40:31 user nova-compute[74692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 (non-flash)
Nov 18 18:40:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a4316ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2'): ({'sdd'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Removing single pathed devices sdd {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0539d5ea-2ed1-4f78-a538-ea04d27a6888]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[91644ccd-be83-4c46-ab5f-e69827300cc3]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Flushing IO for device /dev/sdd {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bb3db0-b754-43ae-a026-206734e5f8c1]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[28813902-b17c-4b8c-b244-5a6bf459bd61]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f731d100-2016-4cec-8e4f-474cbc6bac8c]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d824e99e-3855-41a3-946d-4355769cb9bf]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2, portal: 172.16.0.220,3260]
Nov 18 18:40:31 user nova-compute[74692]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2, portal: 172.16.0.220,3260] successful.
Nov 18 18:40:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9639369e-0a62-4f04-8cd8-8c0490e64bc2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a104b63b-a669-423b-b50e-1ef53ef73e5a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] <== disconnect_volume: return (312ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:40:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:40:31 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Deleted allocations for instance 873169f2-f1a7-4c16-8b8c-88767fea7fc9
Nov 18 18:40:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e4aac4a7-3eec-4cd6-b00a-45a5a1af5036 tempest-TestStampPattern-180669565 tempest-TestStampPattern-180669565-project-member] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.808s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:40:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-cdc1adc4-0324-4d18-b299-26f664e30d81 req-6c1ea344-2f90-4acc-9844-9c6db85609fe service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Received event network-vif-deleted-48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:40:32 user nova-compute[74692]: DEBUG nova.objects.instance [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lazy-loading 'flavor' on Instance uuid 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:40:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-41ef8a9a-89b1-43e6-a4a2-63a50b5159a3 req-cfc821fd-b45a-48fb-b4ea-fe218cb7ef6c service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Received event network-vif-plugged-48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:40:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-41ef8a9a-89b1-43e6-a4a2-63a50b5159a3 req-cfc821fd-b45a-48fb-b4ea-fe218cb7ef6c service nova] Acquiring lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:40:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-41ef8a9a-89b1-43e6-a4a2-63a50b5159a3 req-cfc821fd-b45a-48fb-b4ea-fe218cb7ef6c service nova] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:40:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-41ef8a9a-89b1-43e6-a4a2-63a50b5159a3 req-cfc821fd-b45a-48fb-b4ea-fe218cb7ef6c service nova] Lock "873169f2-f1a7-4c16-8b8c-88767fea7fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:40:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-41ef8a9a-89b1-43e6-a4a2-63a50b5159a3 req-cfc821fd-b45a-48fb-b4ea-fe218cb7ef6c service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] No waiting events found dispatching network-vif-plugged-48b99854-18f7-4fb9-b31f-9e669aa9fa6a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:40:32 user nova-compute[74692]: WARNING nova.compute.manager [req-41ef8a9a-89b1-43e6-a4a2-63a50b5159a3 req-cfc821fd-b45a-48fb-b4ea-fe218cb7ef6c service nova] [instance: 873169f2-f1a7-4c16-8b8c-88767fea7fc9] Received unexpected event network-vif-plugged-48b99854-18f7-4fb9-b31f-9e669aa9fa6a for instance with vm_state deleted and task_state None.
Nov 18 18:40:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-919d38a8-725b-4f0c-a0af-a6af63fd9a73 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.728s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:40:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:40:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:40:56 user nova-compute[74692]: INFO nova.compute.claims [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Claim successful on node user
Nov 18 18:40:56 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG nova.network.neutron [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:40:56 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:40:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG nova.policy [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c418956015544fb8ac0a8acb6af6aacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fead685ad47d4e96bb7c5225029f82ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:40:56 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Creating image(s)
Nov 18 18:40:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "/opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "/opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "/opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:40:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.167s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk 1073741824" returned: 0 in 0.046s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.183s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG nova.network.neutron [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Successfully created port: a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Cannot resize image /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Ensure instance console log exists: /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:40:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.network.neutron [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Successfully updated port: a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquired lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.network.neutron [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.compute.manager [req-2bca8493-d0cc-442a-b64a-1e246052cb03 req-d09413ce-555a-432f-9a99-430fda1ee8ef service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-changed-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.compute.manager [req-2bca8493-d0cc-442a-b64a-1e246052cb03 req-d09413ce-555a-432f-9a99-430fda1ee8ef service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Refreshing instance network info cache due to event network-changed-a3106847-e69a-4753-b6d9-7e0dd00a58ab. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2bca8493-d0cc-442a-b64a-1e246052cb03 req-d09413ce-555a-432f-9a99-430fda1ee8ef service nova] Acquiring lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.network.neutron [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.network.neutron [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Updating instance_info_cache with network_info: [{"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Releasing lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Instance network_info: |[{"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2bca8493-d0cc-442a-b64a-1e246052cb03 req-d09413ce-555a-432f-9a99-430fda1ee8ef service nova] Acquired lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.network.neutron [req-2bca8493-d0cc-442a-b64a-1e246052cb03 req-d09413ce-555a-432f-9a99-430fda1ee8ef service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Refreshing network info cache for port a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Start _get_guest_xml network_info=[{"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:40:58 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:40:58 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1487096690',display_name='tempest-ServerRescueNegativeTestJSON-server-1487096690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1487096690',id=28,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEw+cVbulXbMuVK2CD9909l6Wk27f732QqQYNxb/cZ8LjOheZfWfZ4b3pLTykV+g9E+jAQ6kGP+34RpsAwlFznuDTUI4GQQ0cT4TK0osf9l/aOh+KcLPyI0ky+EcglrOkA==',key_name='tempest-keypair-1382011767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fead685ad47d4e96bb7c5225029f82ce',ramdisk_id='',reservation_id='r-lofdmcfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-88342386',owner_user_name='tempest-ServerRescueNegativeTestJSON-88342386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c418956015544fb8ac0a8acb6af6aacd',uuid=67a67f8d-b4f3-4d34-b4d8-ac16b1145180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converting VIF {"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a3106847-e69a-4753-b6d9-7e0dd00a58ab,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3106847-e6') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.objects.instance [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'pci_devices' on Instance uuid 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:40:58 user nova-compute[74692]:   <uuid>67a67f8d-b4f3-4d34-b4d8-ac16b1145180</uuid>
Nov 18 18:40:58 user nova-compute[74692]:   <name>instance-0000001c</name>
Nov 18 18:40:58 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:40:58 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:40:58 user nova-compute[74692]:   <metadata>
Nov 18 18:40:58 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:40:58 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:40:58 user nova-compute[74692]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1487096690</nova:name>
Nov 18 18:40:58 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:40:58</nova:creationTime>
Nov 18 18:40:58 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:40:58 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:40:58 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:40:58 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:40:58 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:40:58 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:40:58 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:40:58 user nova-compute[74692]:       <nova:owner>
Nov 18 18:40:58 user nova-compute[74692]:         <nova:user uuid="c418956015544fb8ac0a8acb6af6aacd">tempest-ServerRescueNegativeTestJSON-88342386-project-member</nova:user>
Nov 18 18:40:58 user nova-compute[74692]:         <nova:project uuid="fead685ad47d4e96bb7c5225029f82ce">tempest-ServerRescueNegativeTestJSON-88342386</nova:project>
Nov 18 18:40:58 user nova-compute[74692]:       </nova:owner>
Nov 18 18:40:58 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:40:58 user nova-compute[74692]:       <nova:ports>
Nov 18 18:40:58 user nova-compute[74692]:         <nova:port uuid="a3106847-e69a-4753-b6d9-7e0dd00a58ab">
Nov 18 18:40:58 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 18:40:58 user nova-compute[74692]:         </nova:port>
Nov 18 18:40:58 user nova-compute[74692]:       </nova:ports>
Nov 18 18:40:58 user nova-compute[74692]:     </nova:instance>
Nov 18 18:40:58 user nova-compute[74692]:   </metadata>
Nov 18 18:40:58 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:40:58 user nova-compute[74692]:     <system>
Nov 18 18:40:58 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:40:58 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:40:58 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:40:58 user nova-compute[74692]:       <entry name="serial">67a67f8d-b4f3-4d34-b4d8-ac16b1145180</entry>
Nov 18 18:40:58 user nova-compute[74692]:       <entry name="uuid">67a67f8d-b4f3-4d34-b4d8-ac16b1145180</entry>
Nov 18 18:40:58 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:40:58 user nova-compute[74692]:     </system>
Nov 18 18:40:58 user nova-compute[74692]:   </sysinfo>
Nov 18 18:40:58 user nova-compute[74692]:   <os>
Nov 18 18:40:58 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:40:58 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:40:58 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:40:58 user nova-compute[74692]:   </os>
Nov 18 18:40:58 user nova-compute[74692]:   <features>
Nov 18 18:40:58 user nova-compute[74692]:     <acpi/>
Nov 18 18:40:58 user nova-compute[74692]:     <apic/>
Nov 18 18:40:58 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:40:58 user nova-compute[74692]:   </features>
Nov 18 18:40:58 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:40:58 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:40:58 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:40:58 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:40:58 user nova-compute[74692]:   </clock>
Nov 18 18:40:58 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:40:58 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:40:58 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:40:58 user nova-compute[74692]:   </cpu>
Nov 18 18:40:58 user nova-compute[74692]:   <devices>
Nov 18 18:40:58 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:40:58 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:40:58 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk"/>
Nov 18 18:40:58 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:40:58 user nova-compute[74692]:     </disk>
Nov 18 18:40:58 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:40:58 user nova-compute[74692]:       <mac address="fa:16:3e:e1:70:8c"/>
Nov 18 18:40:58 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:40:58 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:40:58 user nova-compute[74692]:       <target dev="tapa3106847-e6"/>
Nov 18 18:40:58 user nova-compute[74692]:     </interface>
Nov 18 18:40:58 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:40:58 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/console.log" append="off"/>
Nov 18 18:40:58 user nova-compute[74692]:     </serial>
Nov 18 18:40:58 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:40:58 user nova-compute[74692]:     <video>
Nov 18 18:40:58 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:40:58 user nova-compute[74692]:     </video>
Nov 18 18:40:58 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:40:58 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:40:58 user nova-compute[74692]:     </rng>
Nov 18 18:40:58 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:40:58 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:40:58 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:40:58 user nova-compute[74692]:     </memballoon>
Nov 18 18:40:58 user nova-compute[74692]:   </devices>
Nov 18 18:40:58 user nova-compute[74692]: </domain>
Nov 18 18:40:58 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1487096690',display_name='tempest-ServerRescueNegativeTestJSON-server-1487096690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1487096690',id=28,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEw+cVbulXbMuVK2CD9909l6Wk27f732QqQYNxb/cZ8LjOheZfWfZ4b3pLTykV+g9E+jAQ6kGP+34RpsAwlFznuDTUI4GQQ0cT4TK0osf9l/aOh+KcLPyI0ky+EcglrOkA==',key_name='tempest-keypair-1382011767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fead685ad47d4e96bb7c5225029f82ce',ramdisk_id='',reservation_id='r-lofdmcfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-88342386',owner_user_name='tempest-ServerRescueNegativeTestJSON-88342386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c418956015544fb8ac0a8acb6af6aacd',uuid=67a67f8d-b4f3-4d34-b4d8-ac16b1145180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converting VIF {"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a3106847-e69a-4753-b6d9-7e0dd00a58ab,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3106847-e6') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG os_vif [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a3106847-e69a-4753-b6d9-7e0dd00a58ab,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3106847-e6') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6e955c5-7289-55ac-b908-55cd58fe8310', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3106847-e6, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3106847-e6, col_values=(('qos', UUID('99387a61-8fe7-41fc-9187-51d072b4a943')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3106847-e6, col_values=(('external_ids', {'iface-id': 'a3106847-e69a-4753-b6d9-7e0dd00a58ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:70:8c', 'vm-uuid': '67a67f8d-b4f3-4d34-b4d8-ac16b1145180'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:58 user nova-compute[74692]: INFO os_vif [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a3106847-e69a-4753-b6d9-7e0dd00a58ab,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3106847-e6')
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No VIF found with MAC fa:16:3e:e1:70:8c, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.network.neutron [req-2bca8493-d0cc-442a-b64a-1e246052cb03 req-d09413ce-555a-432f-9a99-430fda1ee8ef service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Updated VIF entry in instance network info cache for port a3106847-e69a-4753-b6d9-7e0dd00a58ab. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG nova.network.neutron [req-2bca8493-d0cc-442a-b64a-1e246052cb03 req-d09413ce-555a-432f-9a99-430fda1ee8ef service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Updating instance_info_cache with network_info: [{"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:40:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2bca8493-d0cc-442a-b64a-1e246052cb03 req-d09413ce-555a-432f-9a99-430fda1ee8ef service nova] Releasing lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'flavor' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquired lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'info_cache' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.objects.base [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Object Instance<96c70a3c-82db-4adf-8f9b-4e7c1a37b519> lazy-loaded attributes: flavor,info_cache {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Updating instance_info_cache with network_info: [{"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Releasing lock "refresh_cache-96c70a3c-82db-4adf-8f9b-4e7c1a37b519" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:40:59 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Instance destroyed successfully.
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'resources' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.objects.base [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Object Instance<96c70a3c-82db-4adf-8f9b-4e7c1a37b519> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1934677203',display_name='tempest-AttachVolumeTestJSON-server-1934677203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1934677203',id=17,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWoJ1g21ysWeKm0aCaq0iDAu6GFhJ4Kgqa/cYa4mb67PyeCSQSB1+k/re9L+dOqnhT2aQmCtGqB0zHW7DLxwgFWBB78ohK6z8iaUSg7A5I+FxwvxJ5cm1dB7niInB9aXw==',key_name='tempest-keypair-29977122',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:33:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='da05b2ed39a3489db70da40991bc8e48',ramdisk_id='',reservation_id='r-xspl17l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-858172900',owner_user_name='tempest-AttachVolumeTestJSON-858172900-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:39:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9dad2e2f1d541bf803b5d923db5242b',uuid=96c70a3c-82db-4adf-8f9b-4e7c1a37b519,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converting VIF {"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG os_vif [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9753f583-43, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f9a40ad-536f-4ca0-ab0f-f98262b9a541) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:59 user nova-compute[74692]: INFO os_vif [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43')
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Start _get_guest_xml network_info=[{"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'numa_topology' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.objects.base [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Object Instance<96c70a3c-82db-4adf-8f9b-4e7c1a37b519> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:40:59 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:40:59 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'vcpu_model' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.objects.base [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Object Instance<96c70a3c-82db-4adf-8f9b-4e7c1a37b519> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1934677203',display_name='tempest-AttachVolumeTestJSON-server-1934677203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1934677203',id=17,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWoJ1g21ysWeKm0aCaq0iDAu6GFhJ4Kgqa/cYa4mb67PyeCSQSB1+k/re9L+dOqnhT2aQmCtGqB0zHW7DLxwgFWBB78ohK6z8iaUSg7A5I+FxwvxJ5cm1dB7niInB9aXw==',key_name='tempest-keypair-29977122',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:33:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='da05b2ed39a3489db70da40991bc8e48',ramdisk_id='',reservation_id='r-xspl17l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-858172900',owner_user_name='tempest-AttachVolumeTestJSON-858172900-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:39:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9dad2e2f1d541bf803b5d923db5242b',uuid=96c70a3c-82db-4adf-8f9b-4e7c1a37b519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converting VIF {"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'pci_devices' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.objects.base [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Object Instance<96c70a3c-82db-4adf-8f9b-4e7c1a37b519> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:40:59 user nova-compute[74692]:   <uuid>96c70a3c-82db-4adf-8f9b-4e7c1a37b519</uuid>
Nov 18 18:40:59 user nova-compute[74692]:   <name>instance-00000011</name>
Nov 18 18:40:59 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:40:59 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:40:59 user nova-compute[74692]:   <metadata>
Nov 18 18:40:59 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:40:59 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:40:59 user nova-compute[74692]:       <nova:name>tempest-AttachVolumeTestJSON-server-1934677203</nova:name>
Nov 18 18:40:59 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:40:59</nova:creationTime>
Nov 18 18:40:59 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:40:59 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:40:59 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:40:59 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:40:59 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:40:59 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:40:59 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:40:59 user nova-compute[74692]:       <nova:owner>
Nov 18 18:40:59 user nova-compute[74692]:         <nova:user uuid="f9dad2e2f1d541bf803b5d923db5242b">tempest-AttachVolumeTestJSON-858172900-project-member</nova:user>
Nov 18 18:40:59 user nova-compute[74692]:         <nova:project uuid="da05b2ed39a3489db70da40991bc8e48">tempest-AttachVolumeTestJSON-858172900</nova:project>
Nov 18 18:40:59 user nova-compute[74692]:       </nova:owner>
Nov 18 18:40:59 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:40:59 user nova-compute[74692]:       <nova:ports>
Nov 18 18:40:59 user nova-compute[74692]:         <nova:port uuid="9753f583-4360-48e8-a59f-43b16198aa36">
Nov 18 18:40:59 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 18:40:59 user nova-compute[74692]:         </nova:port>
Nov 18 18:40:59 user nova-compute[74692]:       </nova:ports>
Nov 18 18:40:59 user nova-compute[74692]:     </nova:instance>
Nov 18 18:40:59 user nova-compute[74692]:   </metadata>
Nov 18 18:40:59 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:40:59 user nova-compute[74692]:     <system>
Nov 18 18:40:59 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:40:59 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:40:59 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:40:59 user nova-compute[74692]:       <entry name="serial">96c70a3c-82db-4adf-8f9b-4e7c1a37b519</entry>
Nov 18 18:40:59 user nova-compute[74692]:       <entry name="uuid">96c70a3c-82db-4adf-8f9b-4e7c1a37b519</entry>
Nov 18 18:40:59 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:40:59 user nova-compute[74692]:     </system>
Nov 18 18:40:59 user nova-compute[74692]:   </sysinfo>
Nov 18 18:40:59 user nova-compute[74692]:   <os>
Nov 18 18:40:59 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:40:59 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:40:59 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:40:59 user nova-compute[74692]:   </os>
Nov 18 18:40:59 user nova-compute[74692]:   <features>
Nov 18 18:40:59 user nova-compute[74692]:     <acpi/>
Nov 18 18:40:59 user nova-compute[74692]:     <apic/>
Nov 18 18:40:59 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:40:59 user nova-compute[74692]:   </features>
Nov 18 18:40:59 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:40:59 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:40:59 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:40:59 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:40:59 user nova-compute[74692]:   </clock>
Nov 18 18:40:59 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:40:59 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:40:59 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:40:59 user nova-compute[74692]:   </cpu>
Nov 18 18:40:59 user nova-compute[74692]:   <devices>
Nov 18 18:40:59 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:40:59 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:40:59 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk"/>
Nov 18 18:40:59 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:40:59 user nova-compute[74692]:     </disk>
Nov 18 18:40:59 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:40:59 user nova-compute[74692]:       <mac address="fa:16:3e:bb:07:0d"/>
Nov 18 18:40:59 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:40:59 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:40:59 user nova-compute[74692]:       <target dev="tap9753f583-43"/>
Nov 18 18:40:59 user nova-compute[74692]:     </interface>
Nov 18 18:40:59 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:40:59 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/console.log" append="off"/>
Nov 18 18:40:59 user nova-compute[74692]:     </serial>
Nov 18 18:40:59 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:40:59 user nova-compute[74692]:     <video>
Nov 18 18:40:59 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:40:59 user nova-compute[74692]:     </video>
Nov 18 18:40:59 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:40:59 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:40:59 user nova-compute[74692]:     </rng>
Nov 18 18:40:59 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:40:59 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:40:59 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:40:59 user nova-compute[74692]:     </memballoon>
Nov 18 18:40:59 user nova-compute[74692]:   </devices>
Nov 18 18:40:59 user nova-compute[74692]: </domain>
Nov 18 18:40:59 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:40:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-9df2d145-49c0-4b72-b1d9-bdfb48246a41 req-f8de228d-7e9c-45f1-81bd-dd220d7bc7a8 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9df2d145-49c0-4b72-b1d9-bdfb48246a41 req-f8de228d-7e9c-45f1-81bd-dd220d7bc7a8 service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9df2d145-49c0-4b72-b1d9-bdfb48246a41 req-f8de228d-7e9c-45f1-81bd-dd220d7bc7a8 service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9df2d145-49c0-4b72-b1d9-bdfb48246a41 req-f8de228d-7e9c-45f1-81bd-dd220d7bc7a8 service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-9df2d145-49c0-4b72-b1d9-bdfb48246a41 req-f8de228d-7e9c-45f1-81bd-dd220d7bc7a8 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:41:00 user nova-compute[74692]: WARNING nova.compute.manager [req-9df2d145-49c0-4b72-b1d9-bdfb48246a41 req-f8de228d-7e9c-45f1-81bd-dd220d7bc7a8 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received unexpected event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with vm_state building and task_state spawning.
Nov 18 18:41:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'trusted_certs' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG nova.objects.base [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Object Instance<96c70a3c-82db-4adf-8f9b-4e7c1a37b519> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Cannot resize image /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'migration_context' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG nova.objects.base [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Object Instance<96c70a3c-82db-4adf-8f9b-4e7c1a37b519> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1934677203',display_name='tempest-AttachVolumeTestJSON-server-1934677203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1934677203',id=17,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWoJ1g21ysWeKm0aCaq0iDAu6GFhJ4Kgqa/cYa4mb67PyeCSQSB1+k/re9L+dOqnhT2aQmCtGqB0zHW7DLxwgFWBB78ohK6z8iaUSg7A5I+FxwvxJ5cm1dB7niInB9aXw==',key_name='tempest-keypair-29977122',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:33:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='da05b2ed39a3489db70da40991bc8e48',ramdisk_id='',reservation_id='r-xspl17l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-858172900',owner_user_name='tempest-AttachVolumeTestJSON-858172900-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:39:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9dad2e2f1d541bf803b5d923db5242b',uuid=96c70a3c-82db-4adf-8f9b-4e7c1a37b519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converting VIF {"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG os_vif [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d88f4da-8f63-58ae-8bc7-979312d8dcdd', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9753f583-43, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9753f583-43, col_values=(('qos', UUID('65c11de9-261f-4735-9e85-8fe2aedd5a6b')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9753f583-43, col_values=(('external_ids', {'iface-id': '9753f583-4360-48e8-a59f-43b16198aa36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:07:0d', 'vm-uuid': '96c70a3c-82db-4adf-8f9b-4e7c1a37b519'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:41:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:00 user nova-compute[74692]: INFO os_vif [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43')
Nov 18 18:41:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG nova.compute.manager [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:41:02 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Instance spawned successfully.
Nov 18 18:41:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:02 user nova-compute[74692]: INFO nova.compute.manager [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 18 18:41:02 user nova-compute[74692]: DEBUG nova.compute.manager [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-05ecbea5-f76a-4066-aabf-80b7a5729212 req-c4b746de-1ac0-4bd8-90b5-f70bca4be7f2 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-05ecbea5-f76a-4066-aabf-80b7a5729212 req-c4b746de-1ac0-4bd8-90b5-f70bca4be7f2 service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-05ecbea5-f76a-4066-aabf-80b7a5729212 req-c4b746de-1ac0-4bd8-90b5-f70bca4be7f2 service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-05ecbea5-f76a-4066-aabf-80b7a5729212 req-c4b746de-1ac0-4bd8-90b5-f70bca4be7f2 service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-05ecbea5-f76a-4066-aabf-80b7a5729212 req-c4b746de-1ac0-4bd8-90b5-f70bca4be7f2 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:41:02 user nova-compute[74692]: WARNING nova.compute.manager [req-05ecbea5-f76a-4066-aabf-80b7a5729212 req-c4b746de-1ac0-4bd8-90b5-f70bca4be7f2 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received unexpected event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with vm_state building and task_state spawning.
Nov 18 18:41:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-05ecbea5-f76a-4066-aabf-80b7a5729212 req-c4b746de-1ac0-4bd8-90b5-f70bca4be7f2 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-05ecbea5-f76a-4066-aabf-80b7a5729212 req-c4b746de-1ac0-4bd8-90b5-f70bca4be7f2 service nova] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-05ecbea5-f76a-4066-aabf-80b7a5729212 req-c4b746de-1ac0-4bd8-90b5-f70bca4be7f2 service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-05ecbea5-f76a-4066-aabf-80b7a5729212 req-c4b746de-1ac0-4bd8-90b5-f70bca4be7f2 service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-05ecbea5-f76a-4066-aabf-80b7a5729212 req-c4b746de-1ac0-4bd8-90b5-f70bca4be7f2 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] No waiting events found dispatching network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:41:02 user nova-compute[74692]: WARNING nova.compute.manager [req-05ecbea5-f76a-4066-aabf-80b7a5729212 req-c4b746de-1ac0-4bd8-90b5-f70bca4be7f2 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received unexpected event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 for instance with vm_state stopped and task_state powering-on.
Nov 18 18:41:02 user nova-compute[74692]: INFO nova.compute.manager [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Took 6.16 seconds to build instance.
Nov 18 18:41:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bd1ee74d-652e-4d43-8a48-bff3ca0a5b3c tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.288s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:03 user nova-compute[74692]: DEBUG nova.objects.instance [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lazy-loading 'flavor' on Instance uuid 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:04 user nova-compute[74692]: INFO nova.compute.manager [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Attaching volume 5a71e7d4-59cc-452f-a854-631f226e3f43 to /dev/vdb
Nov 18 18:41:04 user nova-compute[74692]: DEBUG os_brick.utils [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2ea697-351f-496c-be75-d4ba343bf9d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d52acd-eace-4a40-a810-f891629ddbe7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[948e1faf-5cd1-49b3-858e-d67aa747fb62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f208a1-0881-400e-9a01-38378553c49a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Instance rebooted successfully.
Nov 18 18:41:04 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3ce70b09-27de-479e-8938-c78ecb071ec0 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:41:04 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db9f062-2678-48fa-9866-30abd74ba2fd]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG os_brick.utils [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Updating existing volume attachment record: c528a90c-1372-4410-85a2-33f93904a097 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7b7d8053-611f-4fb1-8e0b-de8f5f6f0371 req-46912694-ebd1-4fbf-a70d-31fc179155ec service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7b7d8053-611f-4fb1-8e0b-de8f5f6f0371 req-46912694-ebd1-4fbf-a70d-31fc179155ec service nova] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7b7d8053-611f-4fb1-8e0b-de8f5f6f0371 req-46912694-ebd1-4fbf-a70d-31fc179155ec service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7b7d8053-611f-4fb1-8e0b-de8f5f6f0371 req-46912694-ebd1-4fbf-a70d-31fc179155ec service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-7b7d8053-611f-4fb1-8e0b-de8f5f6f0371 req-46912694-ebd1-4fbf-a70d-31fc179155ec service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] No waiting events found dispatching network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:41:04 user nova-compute[74692]: WARNING nova.compute.manager [req-7b7d8053-611f-4fb1-8e0b-de8f5f6f0371 req-46912694-ebd1-4fbf-a70d-31fc179155ec service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received unexpected event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 for instance with vm_state stopped and task_state powering-on.
Nov 18 18:41:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnPFERai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:41:10 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:41:10 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:41:10 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a7470d-30f3-49c1-8a25-16e6384e711f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:41:10 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b06abe-4949-4e92-bd04-a177d371d0bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43] added
Nov 18 18:41:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17b2778-db1a-46e5-a39f-c1bf3140187e]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb42fe4a-a389-46b7-bd38-d73b26985a6c]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YnPFERai {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YnPFERai" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a2f2c0-5b15-4e13-94b2-e8d58264d1a3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YnPFERai'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7530189-1d27-43d3-87b9-a21b674bd2eb]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d178970-a402-421b-97ea-89d428d833dc]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:41:10 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:41:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:41:10 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:41:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c6842a-23b8-4b70-b304-8f919540f386]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43, portal: 172.16.0.220,3260]
Nov 18 18:41:10 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43, portal: 172.16.0.220,3260] successful.
Nov 18 18:41:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[96475393-7c9e-4cca-b004-cdb333a7de8f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[877e9a51-5aa2-4c39-a4b1-7ce7eeef4efd]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:41:10 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:41:10 user nova-compute[74692]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 (non-flash)
Nov 18 18:41:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:41:10 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:41:10 user nova-compute[74692]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 (non-flash)
Nov 18 18:41:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec8e138-a2a1-4b02-95aa-93575e42541b]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnPFERai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:41:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:41:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23733666263623333', 'path': '/dev/sdd'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:41:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733666263623333', 'path': '/dev/sdd'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:41:11 user nova-compute[74692]: DEBUG nova.objects.instance [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lazy-loading 'flavor' on Instance uuid 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:41:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:41:11 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:41:11 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:41:11 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:41:11 user nova-compute[74692]:   <serial>5a71e7d4-59cc-452f-a854-631f226e3f43</serial>
Nov 18 18:41:11 user nova-compute[74692]: </disk>
Nov 18 18:41:11 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:41:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:41:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:41:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] No VIF found with MAC fa:16:3e:77:21:64, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:41:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5baed85b-2a32-4df7-89c9-e05fd2092dbf tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.838s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:12 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:41:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:12 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:41:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:41:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:14 user nova-compute[74692]: INFO nova.compute.manager [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Detaching volume 5a71e7d4-59cc-452f-a854-631f226e3f43
Nov 18 18:41:14 user nova-compute[74692]: INFO nova.virt.block_device [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Attempting to driver detach volume 5a71e7d4-59cc-452f-a854-631f226e3f43 from mountpoint /dev/vdb
Nov 18 18:41:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Attempting to detach device vdb from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:41:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:41:14 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:41:14 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:41:14 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:41:14 user nova-compute[74692]:   <serial>5a71e7d4-59cc-452f-a854-631f226e3f43</serial>
Nov 18 18:41:14 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:41:14 user nova-compute[74692]: </disk>
Nov 18 18:41:14 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:41:14 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Successfully detached device vdb from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the persistent domain config.
Nov 18 18:41:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:41:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:41:14 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:41:14 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:41:14 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:41:14 user nova-compute[74692]:   <serial>5a71e7d4-59cc-452f-a854-631f226e3f43</serial>
Nov 18 18:41:14 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:41:14 user nova-compute[74692]: </disk>
Nov 18 18:41:14 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:41:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:41:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:41:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:41:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:17 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:41:17 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:41:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7635MB free_disk=24.971519470214844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:41:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:17 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:41:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance df36071b-3fe8-48fb-9a17-818eb391779e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 30beb8e4-0363-41e0-8089-04bef2539f4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance f3140c56-acf5-4cde-bd8c-273563540451 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance c85d0595-b6e1-435a-9058-1b5a4bbb3e4f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.462s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:41:18 user nova-compute[74692]: INFO nova.compute.claims [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Claim successful on node user
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:41:18 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:41:18 user nova-compute[74692]: DEBUG nova.policy [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4286ee787ba4de8b4318f8e14259b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2df1316b5841adb2eadb476e70fcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:41:19 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Creating image(s)
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "/opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "/opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "/opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.169s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.169s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/disk 1073741824" returned: 0 in 0.054s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.166s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Cannot resize image /opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Ensure instance console log exists: /opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Successfully created port: 412478e8-b43d-4110-97df-31bff96d9b73 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:41:19 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Successfully updated port: 412478e8-b43d-4110-97df-31bff96d9b73 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "refresh_cache-c85d0595-b6e1-435a-9058-1b5a4bbb3e4f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquired lock "refresh_cache-c85d0595-b6e1-435a-9058-1b5a4bbb3e4f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-5ddb9f3e-bd62-4fdb-ac1a-6c8e360e8615 req-25f19981-093a-493a-a4a6-c23a9543f0c7 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Received event network-changed-412478e8-b43d-4110-97df-31bff96d9b73 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-5ddb9f3e-bd62-4fdb-ac1a-6c8e360e8615 req-25f19981-093a-493a-a4a6-c23a9543f0c7 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Refreshing instance network info cache due to event network-changed-412478e8-b43d-4110-97df-31bff96d9b73. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ddb9f3e-bd62-4fdb-ac1a-6c8e360e8615 req-25f19981-093a-493a-a4a6-c23a9543f0c7 service nova] Acquiring lock "refresh_cache-c85d0595-b6e1-435a-9058-1b5a4bbb3e4f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Updating instance_info_cache with network_info: [{"id": "412478e8-b43d-4110-97df-31bff96d9b73", "address": "fa:16:3e:80:73:9a", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412478e8-b4", "ovs_interfaceid": "412478e8-b43d-4110-97df-31bff96d9b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Releasing lock "refresh_cache-c85d0595-b6e1-435a-9058-1b5a4bbb3e4f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Instance network_info: |[{"id": "412478e8-b43d-4110-97df-31bff96d9b73", "address": "fa:16:3e:80:73:9a", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412478e8-b4", "ovs_interfaceid": "412478e8-b43d-4110-97df-31bff96d9b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ddb9f3e-bd62-4fdb-ac1a-6c8e360e8615 req-25f19981-093a-493a-a4a6-c23a9543f0c7 service nova] Acquired lock "refresh_cache-c85d0595-b6e1-435a-9058-1b5a4bbb3e4f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-5ddb9f3e-bd62-4fdb-ac1a-6c8e360e8615 req-25f19981-093a-493a-a4a6-c23a9543f0c7 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Refreshing network info cache for port 412478e8-b43d-4110-97df-31bff96d9b73 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Start _get_guest_xml network_info=[{"id": "412478e8-b43d-4110-97df-31bff96d9b73", "address": "fa:16:3e:80:73:9a", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412478e8-b4", "ovs_interfaceid": "412478e8-b43d-4110-97df-31bff96d9b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:41:20 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:41:20 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:41:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-159781550',display_name='tempest-ServersNegativeTestJSON-server-159781550',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-159781550',id=29,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e2df1316b5841adb2eadb476e70fcb1',ramdisk_id='',reservation_id='r-dsdovndt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1078755651',owner_user_name='tempest-ServersNegativeTestJSON-1078755651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:41:19Z,user_data=None,user_id='b4286ee787ba4de8b4318f8e14259b52',uuid=c85d0595-b6e1-435a-9058-1b5a4bbb3e4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "412478e8-b43d-4110-97df-31bff96d9b73", "address": "fa:16:3e:80:73:9a", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412478e8-b4", "ovs_interfaceid": "412478e8-b43d-4110-97df-31bff96d9b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Converting VIF {"id": "412478e8-b43d-4110-97df-31bff96d9b73", "address": "fa:16:3e:80:73:9a", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412478e8-b4", "ovs_interfaceid": "412478e8-b43d-4110-97df-31bff96d9b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:73:9a,bridge_name='br-int',has_traffic_filtering=True,id=412478e8-b43d-4110-97df-31bff96d9b73,network=Network(096fe7c9-e167-4c06-a783-984e868249dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412478e8-b4') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.objects.instance [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lazy-loading 'pci_devices' on Instance uuid c85d0595-b6e1-435a-9058-1b5a4bbb3e4f {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:41:20 user nova-compute[74692]:   <uuid>c85d0595-b6e1-435a-9058-1b5a4bbb3e4f</uuid>
Nov 18 18:41:20 user nova-compute[74692]:   <name>instance-0000001d</name>
Nov 18 18:41:20 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:41:20 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:41:20 user nova-compute[74692]:   <metadata>
Nov 18 18:41:20 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:41:20 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:41:20 user nova-compute[74692]:       <nova:name>tempest-ServersNegativeTestJSON-server-159781550</nova:name>
Nov 18 18:41:20 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:41:20</nova:creationTime>
Nov 18 18:41:20 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:41:20 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:41:20 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:41:20 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:41:20 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:41:20 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:41:20 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:41:20 user nova-compute[74692]:       <nova:owner>
Nov 18 18:41:20 user nova-compute[74692]:         <nova:user uuid="b4286ee787ba4de8b4318f8e14259b52">tempest-ServersNegativeTestJSON-1078755651-project-member</nova:user>
Nov 18 18:41:20 user nova-compute[74692]:         <nova:project uuid="3e2df1316b5841adb2eadb476e70fcb1">tempest-ServersNegativeTestJSON-1078755651</nova:project>
Nov 18 18:41:20 user nova-compute[74692]:       </nova:owner>
Nov 18 18:41:20 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:41:20 user nova-compute[74692]:       <nova:ports>
Nov 18 18:41:20 user nova-compute[74692]:         <nova:port uuid="412478e8-b43d-4110-97df-31bff96d9b73">
Nov 18 18:41:20 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 18 18:41:20 user nova-compute[74692]:         </nova:port>
Nov 18 18:41:20 user nova-compute[74692]:       </nova:ports>
Nov 18 18:41:20 user nova-compute[74692]:     </nova:instance>
Nov 18 18:41:20 user nova-compute[74692]:   </metadata>
Nov 18 18:41:20 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:41:20 user nova-compute[74692]:     <system>
Nov 18 18:41:20 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:41:20 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:41:20 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:41:20 user nova-compute[74692]:       <entry name="serial">c85d0595-b6e1-435a-9058-1b5a4bbb3e4f</entry>
Nov 18 18:41:20 user nova-compute[74692]:       <entry name="uuid">c85d0595-b6e1-435a-9058-1b5a4bbb3e4f</entry>
Nov 18 18:41:20 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:41:20 user nova-compute[74692]:     </system>
Nov 18 18:41:20 user nova-compute[74692]:   </sysinfo>
Nov 18 18:41:20 user nova-compute[74692]:   <os>
Nov 18 18:41:20 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:41:20 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:41:20 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:41:20 user nova-compute[74692]:   </os>
Nov 18 18:41:20 user nova-compute[74692]:   <features>
Nov 18 18:41:20 user nova-compute[74692]:     <acpi/>
Nov 18 18:41:20 user nova-compute[74692]:     <apic/>
Nov 18 18:41:20 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:41:20 user nova-compute[74692]:   </features>
Nov 18 18:41:20 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:41:20 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:41:20 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:41:20 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:41:20 user nova-compute[74692]:   </clock>
Nov 18 18:41:20 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:41:20 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:41:20 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:41:20 user nova-compute[74692]:   </cpu>
Nov 18 18:41:20 user nova-compute[74692]:   <devices>
Nov 18 18:41:20 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:41:20 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:41:20 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/disk"/>
Nov 18 18:41:20 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:41:20 user nova-compute[74692]:     </disk>
Nov 18 18:41:20 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:41:20 user nova-compute[74692]:       <mac address="fa:16:3e:80:73:9a"/>
Nov 18 18:41:20 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:41:20 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:41:20 user nova-compute[74692]:       <target dev="tap412478e8-b4"/>
Nov 18 18:41:20 user nova-compute[74692]:     </interface>
Nov 18 18:41:20 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:41:20 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/console.log" append="off"/>
Nov 18 18:41:20 user nova-compute[74692]:     </serial>
Nov 18 18:41:20 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:41:20 user nova-compute[74692]:     <video>
Nov 18 18:41:20 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:41:20 user nova-compute[74692]:     </video>
Nov 18 18:41:20 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:41:20 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:41:20 user nova-compute[74692]:     </rng>
Nov 18 18:41:20 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:41:20 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:41:20 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:41:20 user nova-compute[74692]:     </memballoon>
Nov 18 18:41:20 user nova-compute[74692]:   </devices>
Nov 18 18:41:20 user nova-compute[74692]: </domain>
Nov 18 18:41:20 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:41:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-159781550',display_name='tempest-ServersNegativeTestJSON-server-159781550',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-159781550',id=29,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e2df1316b5841adb2eadb476e70fcb1',ramdisk_id='',reservation_id='r-dsdovndt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1078755651',owner_user_name='tempest-ServersNegativeTestJSON-1078755651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:41:19Z,user_data=None,user_id='b4286ee787ba4de8b4318f8e14259b52',uuid=c85d0595-b6e1-435a-9058-1b5a4bbb3e4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "412478e8-b43d-4110-97df-31bff96d9b73", "address": "fa:16:3e:80:73:9a", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412478e8-b4", "ovs_interfaceid": "412478e8-b43d-4110-97df-31bff96d9b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Converting VIF {"id": "412478e8-b43d-4110-97df-31bff96d9b73", "address": "fa:16:3e:80:73:9a", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412478e8-b4", "ovs_interfaceid": "412478e8-b43d-4110-97df-31bff96d9b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:73:9a,bridge_name='br-int',has_traffic_filtering=True,id=412478e8-b43d-4110-97df-31bff96d9b73,network=Network(096fe7c9-e167-4c06-a783-984e868249dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412478e8-b4') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG os_vif [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:73:9a,bridge_name='br-int',has_traffic_filtering=True,id=412478e8-b43d-4110-97df-31bff96d9b73,network=Network(096fe7c9-e167-4c06-a783-984e868249dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412478e8-b4') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03dca222-3270-523f-b945-087b19193a75', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap412478e8-b4, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap412478e8-b4, col_values=(('qos', UUID('5adb03b3-5058-4f99-ba56-7a9db9f53fb3')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap412478e8-b4, col_values=(('external_ids', {'iface-id': '412478e8-b43d-4110-97df-31bff96d9b73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:73:9a', 'vm-uuid': 'c85d0595-b6e1-435a-9058-1b5a4bbb3e4f'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:41:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:20 user nova-compute[74692]: INFO os_vif [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:73:9a,bridge_name='br-int',has_traffic_filtering=True,id=412478e8-b43d-4110-97df-31bff96d9b73,network=Network(096fe7c9-e167-4c06-a783-984e868249dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412478e8-b4')
Nov 18 18:41:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:41:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] No VIF found with MAC fa:16:3e:80:73:9a, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:41:21 user nova-compute[74692]: DEBUG nova.network.neutron [req-5ddb9f3e-bd62-4fdb-ac1a-6c8e360e8615 req-25f19981-093a-493a-a4a6-c23a9543f0c7 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Updated VIF entry in instance network info cache for port 412478e8-b43d-4110-97df-31bff96d9b73. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:41:21 user nova-compute[74692]: DEBUG nova.network.neutron [req-5ddb9f3e-bd62-4fdb-ac1a-6c8e360e8615 req-25f19981-093a-493a-a4a6-c23a9543f0c7 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Updating instance_info_cache with network_info: [{"id": "412478e8-b43d-4110-97df-31bff96d9b73", "address": "fa:16:3e:80:73:9a", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412478e8-b4", "ovs_interfaceid": "412478e8-b43d-4110-97df-31bff96d9b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:41:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5ddb9f3e-bd62-4fdb-ac1a-6c8e360e8615 req-25f19981-093a-493a-a4a6-c23a9543f0c7 service nova] Releasing lock "refresh_cache-c85d0595-b6e1-435a-9058-1b5a4bbb3e4f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "f3140c56-acf5-4cde-bd8c-273563540451" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "f3140c56-acf5-4cde-bd8c-273563540451" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "f3140c56-acf5-4cde-bd8c-273563540451-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:22 user nova-compute[74692]: INFO nova.compute.manager [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Terminating instance
Nov 18 18:41:22 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG nova.compute.manager [req-246e82f4-589b-4788-ae62-3b38458477c0 req-a60143dd-34c3-4bda-bc4e-85887348a503 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received event network-vif-unplugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-246e82f4-589b-4788-ae62-3b38458477c0 req-a60143dd-34c3-4bda-bc4e-85887348a503 service nova] Acquiring lock "f3140c56-acf5-4cde-bd8c-273563540451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-246e82f4-589b-4788-ae62-3b38458477c0 req-a60143dd-34c3-4bda-bc4e-85887348a503 service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-246e82f4-589b-4788-ae62-3b38458477c0 req-a60143dd-34c3-4bda-bc4e-85887348a503 service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG nova.compute.manager [req-246e82f4-589b-4788-ae62-3b38458477c0 req-a60143dd-34c3-4bda-bc4e-85887348a503 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] No waiting events found dispatching network-vif-unplugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG nova.compute.manager [req-246e82f4-589b-4788-ae62-3b38458477c0 req-a60143dd-34c3-4bda-bc4e-85887348a503 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received event network-vif-unplugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG nova.compute.manager [req-6f025d79-19ca-4a3f-8a0e-2495e6a89519 req-531c4add-4809-4138-88bf-4283fd52a0d3 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Received event network-vif-plugged-412478e8-b43d-4110-97df-31bff96d9b73 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6f025d79-19ca-4a3f-8a0e-2495e6a89519 req-531c4add-4809-4138-88bf-4283fd52a0d3 service nova] Acquiring lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6f025d79-19ca-4a3f-8a0e-2495e6a89519 req-531c4add-4809-4138-88bf-4283fd52a0d3 service nova] Lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6f025d79-19ca-4a3f-8a0e-2495e6a89519 req-531c4add-4809-4138-88bf-4283fd52a0d3 service nova] Lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:22 user nova-compute[74692]: DEBUG nova.compute.manager [req-6f025d79-19ca-4a3f-8a0e-2495e6a89519 req-531c4add-4809-4138-88bf-4283fd52a0d3 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] No waiting events found dispatching network-vif-plugged-412478e8-b43d-4110-97df-31bff96d9b73 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:41:22 user nova-compute[74692]: WARNING nova.compute.manager [req-6f025d79-19ca-4a3f-8a0e-2495e6a89519 req-531c4add-4809-4138-88bf-4283fd52a0d3 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Received unexpected event network-vif-plugged-412478e8-b43d-4110-97df-31bff96d9b73 for instance with vm_state building and task_state spawning.
Nov 18 18:41:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:41:23 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Instance destroyed successfully.
Nov 18 18:41:23 user nova-compute[74692]: DEBUG nova.objects.instance [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lazy-loading 'resources' on Instance uuid f3140c56-acf5-4cde-bd8c-273563540451 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:41:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T18:35:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-539204829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-539204829',id=22,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOthkNNTFNmgshDO1rX52xwX9XJ2lO5YQxpyk5EEQ45Um8FR6Asz93Cp5prjGn6ddTJuKrAt7f9xLeqnxRgRZvpIVIpYI1gtVx59eDLtxaX+ya8P9H3FJZI+qzQmvQeDHw==',key_name='tempest-keypair-151002570',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:39:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f169f28da1640d9b03b4ba44b4e7b7c',ramdisk_id='',reservation_id='r-f44p51kz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1768400085',owner_user_name='tempest-AttachVolumeShelveTestJSON-1768400085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:39:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a005c7c46c46ad9217578412ec906f',uuid=f3140c56-acf5-4cde-bd8c-273563540451,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:41:23 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converting VIF {"id": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "address": "fa:16:3e:2a:6b:aa", "network": {"id": "c235fe21-fecc-46d9-80a2-01cc58d04b42", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-441360801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f169f28da1640d9b03b4ba44b4e7b7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c5f8cc6-74", "ovs_interfaceid": "1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:41:23 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6b:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c5f8cc6-74') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:41:23 user nova-compute[74692]: DEBUG os_vif [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6b:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c5f8cc6-74') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:41:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c5f8cc6-74, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:41:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e97a5722-cdfa-4940-8073-f382bec55a81) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:41:23 user nova-compute[74692]: INFO os_vif [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6b:aa,bridge_name='br-int',has_traffic_filtering=True,id=1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4,network=Network(c235fe21-fecc-46d9-80a2-01cc58d04b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c5f8cc6-74')
Nov 18 18:41:23 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Deleting instance files /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451_del
Nov 18 18:41:23 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Deletion of /opt/stack/data/nova/instances/f3140c56-acf5-4cde-bd8c-273563540451_del complete
Nov 18 18:41:23 user nova-compute[74692]: INFO nova.compute.manager [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 18 18:41:23 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:41:23 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:41:23 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: f3140c56-acf5-4cde-bd8c-273563540451] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:41:24 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Took 0.96 seconds to deallocate network for instance.
Nov 18 18:41:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-817c429d-9689-42d3-b97d-0e9b4a7610bd req-864a0583-bffd-41a6-81d1-41a9cf601f53 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received event network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-817c429d-9689-42d3-b97d-0e9b4a7610bd req-864a0583-bffd-41a6-81d1-41a9cf601f53 service nova] Acquiring lock "f3140c56-acf5-4cde-bd8c-273563540451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-817c429d-9689-42d3-b97d-0e9b4a7610bd req-864a0583-bffd-41a6-81d1-41a9cf601f53 service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-817c429d-9689-42d3-b97d-0e9b4a7610bd req-864a0583-bffd-41a6-81d1-41a9cf601f53 service nova] Lock "f3140c56-acf5-4cde-bd8c-273563540451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-817c429d-9689-42d3-b97d-0e9b4a7610bd req-864a0583-bffd-41a6-81d1-41a9cf601f53 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] No waiting events found dispatching network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:41:24 user nova-compute[74692]: WARNING nova.compute.manager [req-817c429d-9689-42d3-b97d-0e9b4a7610bd req-864a0583-bffd-41a6-81d1-41a9cf601f53 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received unexpected event network-vif-plugged-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 for instance with vm_state deleted and task_state None.
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-817c429d-9689-42d3-b97d-0e9b4a7610bd req-864a0583-bffd-41a6-81d1-41a9cf601f53 service nova] [instance: f3140c56-acf5-4cde-bd8c-273563540451] Received event network-vif-deleted-1c5f8cc6-748f-4063-86ac-9e06d4a8dcf4 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:24 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Deleted allocations for instance f3140c56-acf5-4cde-bd8c-273563540451
Nov 18 18:41:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1256a67a-c945-4d99-92b0-9fd8dfb0a858 tempest-AttachVolumeShelveTestJSON-1768400085 tempest-AttachVolumeShelveTestJSON-1768400085-project-member] Lock "f3140c56-acf5-4cde-bd8c-273563540451" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.815s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-ca808035-0386-4aff-966d-35a51ce7ddf3 req-3eb7e238-98c5-4ffd-8640-d370f7c47e23 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Received event network-vif-plugged-412478e8-b43d-4110-97df-31bff96d9b73 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ca808035-0386-4aff-966d-35a51ce7ddf3 req-3eb7e238-98c5-4ffd-8640-d370f7c47e23 service nova] Acquiring lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ca808035-0386-4aff-966d-35a51ce7ddf3 req-3eb7e238-98c5-4ffd-8640-d370f7c47e23 service nova] Lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ca808035-0386-4aff-966d-35a51ce7ddf3 req-3eb7e238-98c5-4ffd-8640-d370f7c47e23 service nova] Lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-ca808035-0386-4aff-966d-35a51ce7ddf3 req-3eb7e238-98c5-4ffd-8640-d370f7c47e23 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] No waiting events found dispatching network-vif-plugged-412478e8-b43d-4110-97df-31bff96d9b73 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:41:24 user nova-compute[74692]: WARNING nova.compute.manager [req-ca808035-0386-4aff-966d-35a51ce7ddf3 req-3eb7e238-98c5-4ffd-8640-d370f7c47e23 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Received unexpected event network-vif-plugged-412478e8-b43d-4110-97df-31bff96d9b73 for instance with vm_state building and task_state spawning.
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:41:24 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Instance spawned successfully.
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Didn't find any instances for network info cache update. {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 18:41:25 user nova-compute[74692]: INFO nova.compute.manager [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 18 18:41:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:41:25 user nova-compute[74692]: INFO nova.compute.manager [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Took 7.33 seconds to build instance.
Nov 18 18:41:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5bf938fe-dbae-4acf-b52e-a3aa70c559d3 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.424s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:35 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 is timed out.
Nov 18 18:41:35 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Successfully detached device vdb from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the live domain config.
Nov 18 18:41:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnPFERai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:41:35 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc8209d-f1b8-4495-ba9d-5147bc4693c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:41:35 user nova-compute[74692]: No targets found.
Nov 18 18:41:35 user nova-compute[74692]: iSNS:
Nov 18 18:41:35 user nova-compute[74692]: No targets found.
Nov 18 18:41:35 user nova-compute[74692]: STATIC:
Nov 18 18:41:35 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43
Nov 18 18:41:35 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:41:35 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:41:35 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a
Nov 18 18:41:35 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:41:35 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:41:35 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:41:35 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:41:35 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:41:35 user nova-compute[74692]: FIRMWARE:
Nov 18 18:41:35 user nova-compute[74692]: No targets found.
Nov 18 18:41:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:41:35 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:41:35 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8439c79f-90c0-4e84-a4d1-73c6a5a2ab28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72ceaf2-2194-42ff-8ef9-7430b9df5b87]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:41:35 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:41:35 user nova-compute[74692]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 (non-flash)
Nov 18 18:41:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:41:35 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:41:35 user nova-compute[74692]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 (non-flash)
Nov 18 18:41:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a4317760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43'): ({'sdd'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Removing single pathed devices sdd {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[64308b00-054e-42fd-9cc6-bb8c5532aaa0]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e15ed18-aa43-4e86-818b-6cf089ce1a77]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Flushing IO for device /dev/sdd {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3771b127-add3-4b12-ab4c-3ae929ea2c61]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44d4867-18a8-4f5e-b124-307dc705ded2]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6418abd3-8084-4235-acf5-b00cdf1f5650]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5593d607-b4c4-4dcc-b525-702b908c436c]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43, portal: 172.16.0.220,3260]
Nov 18 18:41:35 user nova-compute[74692]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43, portal: 172.16.0.220,3260] successful.
Nov 18 18:41:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a71e7d4-59cc-452f-a854-631f226e3f43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc11343-ccbc-47b0-bddd-0dcfb3ea44d5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] <== disconnect_volume: return (272ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:41:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:41:36 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lazy-loading 'flavor' on Instance uuid 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:41:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3c523364-d4d0-4cee-aa02-b083649ae3e4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.637s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:46 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:41:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:46 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:41:46 user nova-compute[74692]: INFO nova.compute.claims [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Claim successful on node user
Nov 18 18:41:47 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG nova.network.neutron [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:41:47 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:41:47 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG nova.policy [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1233b31e12dc4d5796a60327d93c3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704ef46081d04fc7a0ed88456cbe9fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:41:47 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Creating image(s)
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "/opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "/opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "/opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk 1073741824" returned: 0 in 0.051s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:41:47 user nova-compute[74692]: DEBUG nova.network.neutron [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Successfully created port: 539dfea4-e055-4443-ace6-20e5df4740d7 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Cannot resize image /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Ensure instance console log exists: /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.network.neutron [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Successfully updated port: 539dfea4-e055-4443-ace6-20e5df4740d7 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "refresh_cache-73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquired lock "refresh_cache-73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.network.neutron [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-54ca663c-6176-4123-9472-62e313595e5a req-4dbed20a-1252-4743-9cba-1e4e657b3982 service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Received event network-changed-539dfea4-e055-4443-ace6-20e5df4740d7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-54ca663c-6176-4123-9472-62e313595e5a req-4dbed20a-1252-4743-9cba-1e4e657b3982 service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Refreshing instance network info cache due to event network-changed-539dfea4-e055-4443-ace6-20e5df4740d7. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-54ca663c-6176-4123-9472-62e313595e5a req-4dbed20a-1252-4743-9cba-1e4e657b3982 service nova] Acquiring lock "refresh_cache-73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.network.neutron [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.network.neutron [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Updating instance_info_cache with network_info: [{"id": "539dfea4-e055-4443-ace6-20e5df4740d7", "address": "fa:16:3e:23:86:69", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539dfea4-e0", "ovs_interfaceid": "539dfea4-e055-4443-ace6-20e5df4740d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Releasing lock "refresh_cache-73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Instance network_info: |[{"id": "539dfea4-e055-4443-ace6-20e5df4740d7", "address": "fa:16:3e:23:86:69", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539dfea4-e0", "ovs_interfaceid": "539dfea4-e055-4443-ace6-20e5df4740d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-54ca663c-6176-4123-9472-62e313595e5a req-4dbed20a-1252-4743-9cba-1e4e657b3982 service nova] Acquired lock "refresh_cache-73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.network.neutron [req-54ca663c-6176-4123-9472-62e313595e5a req-4dbed20a-1252-4743-9cba-1e4e657b3982 service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Refreshing network info cache for port 539dfea4-e055-4443-ace6-20e5df4740d7 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Start _get_guest_xml network_info=[{"id": "539dfea4-e055-4443-ace6-20e5df4740d7", "address": "fa:16:3e:23:86:69", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539dfea4-e0", "ovs_interfaceid": "539dfea4-e055-4443-ace6-20e5df4740d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:41:48 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:41:48 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:41:48 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:41:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1724405019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1724405019',id=30,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='704ef46081d04fc7a0ed88456cbe9fe8',ramdisk_id='',reservation_id='r-gz5n8rcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-199647198',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:41:47Z,user_data=None,user_id='1233b31e12dc4d5796a60327d93c3bfb',uuid=73cc50c0-f4e2-4a5f-92f6-84aa50cf5449,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "539dfea4-e055-4443-ace6-20e5df4740d7", "address": "fa:16:3e:23:86:69", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539dfea4-e0", "ovs_interfaceid": "539dfea4-e055-4443-ace6-20e5df4740d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converting VIF {"id": "539dfea4-e055-4443-ace6-20e5df4740d7", "address": "fa:16:3e:23:86:69", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539dfea4-e0", "ovs_interfaceid": "539dfea4-e055-4443-ace6-20e5df4740d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:86:69,bridge_name='br-int',has_traffic_filtering=True,id=539dfea4-e055-4443-ace6-20e5df4740d7,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539dfea4-e0') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG nova.objects.instance [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'pci_devices' on Instance uuid 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:41:49 user nova-compute[74692]:   <uuid>73cc50c0-f4e2-4a5f-92f6-84aa50cf5449</uuid>
Nov 18 18:41:49 user nova-compute[74692]:   <name>instance-0000001e</name>
Nov 18 18:41:49 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:41:49 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:41:49 user nova-compute[74692]:   <metadata>
Nov 18 18:41:49 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:41:49 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:41:49 user nova-compute[74692]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1724405019</nova:name>
Nov 18 18:41:49 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:41:48</nova:creationTime>
Nov 18 18:41:49 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:41:49 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:41:49 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:41:49 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:41:49 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:41:49 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:41:49 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:41:49 user nova-compute[74692]:       <nova:owner>
Nov 18 18:41:49 user nova-compute[74692]:         <nova:user uuid="1233b31e12dc4d5796a60327d93c3bfb">tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member</nova:user>
Nov 18 18:41:49 user nova-compute[74692]:         <nova:project uuid="704ef46081d04fc7a0ed88456cbe9fe8">tempest-ServerBootFromVolumeStableRescueTest-199647198</nova:project>
Nov 18 18:41:49 user nova-compute[74692]:       </nova:owner>
Nov 18 18:41:49 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:41:49 user nova-compute[74692]:       <nova:ports>
Nov 18 18:41:49 user nova-compute[74692]:         <nova:port uuid="539dfea4-e055-4443-ace6-20e5df4740d7">
Nov 18 18:41:49 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 18 18:41:49 user nova-compute[74692]:         </nova:port>
Nov 18 18:41:49 user nova-compute[74692]:       </nova:ports>
Nov 18 18:41:49 user nova-compute[74692]:     </nova:instance>
Nov 18 18:41:49 user nova-compute[74692]:   </metadata>
Nov 18 18:41:49 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:41:49 user nova-compute[74692]:     <system>
Nov 18 18:41:49 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:41:49 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:41:49 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:41:49 user nova-compute[74692]:       <entry name="serial">73cc50c0-f4e2-4a5f-92f6-84aa50cf5449</entry>
Nov 18 18:41:49 user nova-compute[74692]:       <entry name="uuid">73cc50c0-f4e2-4a5f-92f6-84aa50cf5449</entry>
Nov 18 18:41:49 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:41:49 user nova-compute[74692]:     </system>
Nov 18 18:41:49 user nova-compute[74692]:   </sysinfo>
Nov 18 18:41:49 user nova-compute[74692]:   <os>
Nov 18 18:41:49 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:41:49 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:41:49 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:41:49 user nova-compute[74692]:   </os>
Nov 18 18:41:49 user nova-compute[74692]:   <features>
Nov 18 18:41:49 user nova-compute[74692]:     <acpi/>
Nov 18 18:41:49 user nova-compute[74692]:     <apic/>
Nov 18 18:41:49 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:41:49 user nova-compute[74692]:   </features>
Nov 18 18:41:49 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:41:49 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:41:49 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:41:49 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:41:49 user nova-compute[74692]:   </clock>
Nov 18 18:41:49 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:41:49 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:41:49 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:41:49 user nova-compute[74692]:   </cpu>
Nov 18 18:41:49 user nova-compute[74692]:   <devices>
Nov 18 18:41:49 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:41:49 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:41:49 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk"/>
Nov 18 18:41:49 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:41:49 user nova-compute[74692]:     </disk>
Nov 18 18:41:49 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:41:49 user nova-compute[74692]:       <mac address="fa:16:3e:23:86:69"/>
Nov 18 18:41:49 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:41:49 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:41:49 user nova-compute[74692]:       <target dev="tap539dfea4-e0"/>
Nov 18 18:41:49 user nova-compute[74692]:     </interface>
Nov 18 18:41:49 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:41:49 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/console.log" append="off"/>
Nov 18 18:41:49 user nova-compute[74692]:     </serial>
Nov 18 18:41:49 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:41:49 user nova-compute[74692]:     <video>
Nov 18 18:41:49 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:41:49 user nova-compute[74692]:     </video>
Nov 18 18:41:49 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:41:49 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:41:49 user nova-compute[74692]:     </rng>
Nov 18 18:41:49 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:41:49 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:41:49 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:41:49 user nova-compute[74692]:     </memballoon>
Nov 18 18:41:49 user nova-compute[74692]:   </devices>
Nov 18 18:41:49 user nova-compute[74692]: </domain>
Nov 18 18:41:49 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:41:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1724405019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1724405019',id=30,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='704ef46081d04fc7a0ed88456cbe9fe8',ramdisk_id='',reservation_id='r-gz5n8rcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-199647198',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:41:47Z,user_data=None,user_id='1233b31e12dc4d5796a60327d93c3bfb',uuid=73cc50c0-f4e2-4a5f-92f6-84aa50cf5449,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "539dfea4-e055-4443-ace6-20e5df4740d7", "address": "fa:16:3e:23:86:69", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539dfea4-e0", "ovs_interfaceid": "539dfea4-e055-4443-ace6-20e5df4740d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converting VIF {"id": "539dfea4-e055-4443-ace6-20e5df4740d7", "address": "fa:16:3e:23:86:69", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539dfea4-e0", "ovs_interfaceid": "539dfea4-e055-4443-ace6-20e5df4740d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:86:69,bridge_name='br-int',has_traffic_filtering=True,id=539dfea4-e055-4443-ace6-20e5df4740d7,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539dfea4-e0') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG os_vif [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:86:69,bridge_name='br-int',has_traffic_filtering=True,id=539dfea4-e055-4443-ace6-20e5df4740d7,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539dfea4-e0') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86996eee-8ba4-5ea2-b174-15a1d0bc8bca', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap539dfea4-e0, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap539dfea4-e0, col_values=(('qos', UUID('6bbfb2c7-3203-4eb2-9f46-f3eb4ddf2ff0')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap539dfea4-e0, col_values=(('external_ids', {'iface-id': '539dfea4-e055-4443-ace6-20e5df4740d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:86:69', 'vm-uuid': '73cc50c0-f4e2-4a5f-92f6-84aa50cf5449'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:49 user nova-compute[74692]: INFO os_vif [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:86:69,bridge_name='br-int',has_traffic_filtering=True,id=539dfea4-e055-4443-ace6-20e5df4740d7,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539dfea4-e0')
Nov 18 18:41:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] No VIF found with MAC fa:16:3e:23:86:69, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG nova.network.neutron [req-54ca663c-6176-4123-9472-62e313595e5a req-4dbed20a-1252-4743-9cba-1e4e657b3982 service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Updated VIF entry in instance network info cache for port 539dfea4-e055-4443-ace6-20e5df4740d7. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG nova.network.neutron [req-54ca663c-6176-4123-9472-62e313595e5a req-4dbed20a-1252-4743-9cba-1e4e657b3982 service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Updating instance_info_cache with network_info: [{"id": "539dfea4-e055-4443-ace6-20e5df4740d7", "address": "fa:16:3e:23:86:69", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539dfea4-e0", "ovs_interfaceid": "539dfea4-e055-4443-ace6-20e5df4740d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:41:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-54ca663c-6176-4123-9472-62e313595e5a req-4dbed20a-1252-4743-9cba-1e4e657b3982 service nova] Releasing lock "refresh_cache-73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:41:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-a1073742-e059-43fc-9445-cc3e1e96cae7 req-d0694aaa-e2b9-478e-bf74-5567315c8931 service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Received event network-vif-plugged-539dfea4-e055-4443-ace6-20e5df4740d7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:41:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a1073742-e059-43fc-9445-cc3e1e96cae7 req-d0694aaa-e2b9-478e-bf74-5567315c8931 service nova] Acquiring lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a1073742-e059-43fc-9445-cc3e1e96cae7 req-d0694aaa-e2b9-478e-bf74-5567315c8931 service nova] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a1073742-e059-43fc-9445-cc3e1e96cae7 req-d0694aaa-e2b9-478e-bf74-5567315c8931 service nova] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-a1073742-e059-43fc-9445-cc3e1e96cae7 req-d0694aaa-e2b9-478e-bf74-5567315c8931 service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] No waiting events found dispatching network-vif-plugged-539dfea4-e055-4443-ace6-20e5df4740d7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:41:50 user nova-compute[74692]: WARNING nova.compute.manager [req-a1073742-e059-43fc-9445-cc3e1e96cae7 req-d0694aaa-e2b9-478e-bf74-5567315c8931 service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Received unexpected event network-vif-plugged-539dfea4-e055-4443-ace6-20e5df4740d7 for instance with vm_state building and task_state spawning.
Nov 18 18:41:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:52 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:41:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:41:52 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Instance spawned successfully.
Nov 18 18:41:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:41:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:41:52 user nova-compute[74692]: INFO nova.compute.manager [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 18 18:41:52 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:41:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-857978ec-c171-4179-894c-0b773f213dad req-57cd9e65-557a-417a-9675-1b7abc00a1e2 service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Received event network-vif-plugged-539dfea4-e055-4443-ace6-20e5df4740d7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:41:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-857978ec-c171-4179-894c-0b773f213dad req-57cd9e65-557a-417a-9675-1b7abc00a1e2 service nova] Acquiring lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:41:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-857978ec-c171-4179-894c-0b773f213dad req-57cd9e65-557a-417a-9675-1b7abc00a1e2 service nova] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:41:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-857978ec-c171-4179-894c-0b773f213dad req-57cd9e65-557a-417a-9675-1b7abc00a1e2 service nova] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-857978ec-c171-4179-894c-0b773f213dad req-57cd9e65-557a-417a-9675-1b7abc00a1e2 service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] No waiting events found dispatching network-vif-plugged-539dfea4-e055-4443-ace6-20e5df4740d7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:41:52 user nova-compute[74692]: WARNING nova.compute.manager [req-857978ec-c171-4179-894c-0b773f213dad req-57cd9e65-557a-417a-9675-1b7abc00a1e2 service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Received unexpected event network-vif-plugged-539dfea4-e055-4443-ace6-20e5df4740d7 for instance with vm_state building and task_state spawning.
Nov 18 18:41:52 user nova-compute[74692]: INFO nova.compute.manager [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Took 6.11 seconds to build instance.
Nov 18 18:41:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0ed69c25-0b7b-4720-9d0e-c8a2d1eb0f29 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.254s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:41:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:41:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:42:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 18:42:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:42:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:42:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG nova.objects.instance [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lazy-loading 'flavor' on Instance uuid 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:06 user nova-compute[74692]: INFO nova.compute.manager [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Attaching volume 4ee0ebf8-1338-4095-9853-d3bf3936803e to /dev/vdb
Nov 18 18:42:06 user nova-compute[74692]: DEBUG os_brick.utils [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0823ee-02b2-469d-b9ce-8a93bb4fc499]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbf9b2b-f4d8-4856-b736-bb07f2afb2e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4899dc-8349-4d02-9308-63100333a52e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8561189-19b1-4146-b0f5-5ffb86148601]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:42:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:42:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:07 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:42:07 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:42:07 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[769e2010-56e6-4362-a2ce-85afdf87155f]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:42:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:42:07 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:42:07 user nova-compute[74692]: DEBUG os_brick.utils [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:42:07 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Updating existing volume attachment record: 31b3be1d-a21c-48f1-a800-51338eaf977a {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:42:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "df36071b-3fe8-48fb-9a17-818eb391779e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "df36071b-3fe8-48fb-9a17-818eb391779e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:08 user nova-compute[74692]: INFO nova.compute.manager [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Detaching volume 7ab0cca8-8f41-4c5e-a481-854949a71d2a
Nov 18 18:42:08 user nova-compute[74692]: INFO nova.virt.block_device [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Attempting to driver detach volume 7ab0cca8-8f41-4c5e-a481-854949a71d2a from mountpoint /dev/vdb
Nov 18 18:42:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Attempting to detach device vdb from instance df36071b-3fe8-48fb-9a17-818eb391779e from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:42:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:42:08 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:42:08 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:42:08 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:42:08 user nova-compute[74692]:   <serial>7ab0cca8-8f41-4c5e-a481-854949a71d2a</serial>
Nov 18 18:42:08 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 18:42:08 user nova-compute[74692]: </disk>
Nov 18 18:42:08 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:42:08 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Successfully detached device vdb from instance df36071b-3fe8-48fb-9a17-818eb391779e from the persistent domain config.
Nov 18 18:42:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance df36071b-3fe8-48fb-9a17-818eb391779e from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:42:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:42:08 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:42:08 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:42:08 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:42:08 user nova-compute[74692]:   <serial>7ab0cca8-8f41-4c5e-a481-854949a71d2a</serial>
Nov 18 18:42:08 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 18:42:08 user nova-compute[74692]: </disk>
Nov 18 18:42:08 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:42:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance df36071b-3fe8-48fb-9a17-818eb391779e {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahBdJpoc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:42:12 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:42:12 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:42:12 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eab679f-6ba1-4db0-9b8f-e59b00a2142f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:42:12 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8870448-a583-4192-bab5-83d022baa1ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e] added
Nov 18 18:42:12 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc30ef32-5d10-471c-8ebc-ba0bb2d2ddb7]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78b3195-f5e6-483b-ae9b-f7f13bb46dc5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahBdJpoc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahBdJpoc" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b210d5-5ed7-4d30-9043-b934b75d836d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ahBdJpoc'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bed92f8-3399-4195-990d-663c569d6d8c]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f270ae97-cfeb-4190-bbdc-4a02816d8d27]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:42:12 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:42:12 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:42:12 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:42:12 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe81a2a-52b1-477f-874a-f7a1dad9e559]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e, portal: 172.16.0.220,3260]
Nov 18 18:42:12 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e, portal: 172.16.0.220,3260] successful.
Nov 18 18:42:12 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f26fbd1-ebe8-4bff-be6b-a8cb68d8aae0]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b6f0d1-55ff-460e-83ab-09a4504cb978]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:42:12 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:42:12 user nova-compute[74692]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e (non-flash)
Nov 18 18:42:12 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:42:12 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:42:12 user nova-compute[74692]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e (non-flash)
Nov 18 18:42:12 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe72c0e9-4886-4e45-aa58-a6c6b504b387]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:42:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:13 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:42:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahBdJpoc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:42:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:42:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26561316438393035', 'path': '/dev/sdd'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:42:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561316438393035', 'path': '/dev/sdd'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:42:13 user nova-compute[74692]: DEBUG nova.objects.instance [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lazy-loading 'flavor' on Instance uuid 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:42:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:42:13 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:42:13 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:42:13 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:42:13 user nova-compute[74692]:   <serial>4ee0ebf8-1338-4095-9853-d3bf3936803e</serial>
Nov 18 18:42:13 user nova-compute[74692]: </disk>
Nov 18 18:42:13 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:42:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:42:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:42:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] No VIF found with MAC fa:16:3e:77:21:64, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:42:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d4d09229-dde4-430f-8de5-ebc57a16a0d4 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.394s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:14 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:42:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:14 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:42:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:42:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:15 user nova-compute[74692]: INFO nova.compute.manager [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Detaching volume 4ee0ebf8-1338-4095-9853-d3bf3936803e
Nov 18 18:42:16 user nova-compute[74692]: INFO nova.virt.block_device [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Attempting to driver detach volume 4ee0ebf8-1338-4095-9853-d3bf3936803e from mountpoint /dev/vdb
Nov 18 18:42:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Attempting to detach device vdb from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:42:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:42:16 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:42:16 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:42:16 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:42:16 user nova-compute[74692]:   <serial>4ee0ebf8-1338-4095-9853-d3bf3936803e</serial>
Nov 18 18:42:16 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:42:16 user nova-compute[74692]: </disk>
Nov 18 18:42:16 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:42:16 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Successfully detached device vdb from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the persistent domain config.
Nov 18 18:42:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:42:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:42:16 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:42:16 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:42:16 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:42:16 user nova-compute[74692]:   <serial>4ee0ebf8-1338-4095-9853-d3bf3936803e</serial>
Nov 18 18:42:16 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:42:16 user nova-compute[74692]: </disk>
Nov 18 18:42:16 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:42:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:42:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:17 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:42:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:20 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:42:20 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7429MB free_disk=24.911888122558594GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance df36071b-3fe8-48fb-9a17-818eb391779e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 30beb8e4-0363-41e0-8089-04bef2539f4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance c85d0595-b6e1-435a-9058-1b5a4bbb3e4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:42:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:21 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:42:21 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:42:21 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:42:21 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:42:21 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:42:21 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:42:21 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:42:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:42:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:25 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:42:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:42:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 18:42:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:42:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:42:26 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:42:26 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid 7540540c-af3e-4992-8756-3497a3bd4bf6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:42:26 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Updating instance_info_cache with network_info: [{"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:42:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-7540540c-af3e-4992-8756-3497a3bd4bf6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:42:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:29 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance df36071b-3fe8-48fb-9a17-818eb391779e is timed out.
Nov 18 18:42:29 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Successfully detached device vdb from instance df36071b-3fe8-48fb-9a17-818eb391779e from the live domain config.
Nov 18 18:42:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNOYnzqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:42:29 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[527802d9-1e43-4022-9b3d-2c4becf94c11]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:42:29 user nova-compute[74692]: No targets found.
Nov 18 18:42:29 user nova-compute[74692]: iSNS:
Nov 18 18:42:29 user nova-compute[74692]: No targets found.
Nov 18 18:42:29 user nova-compute[74692]: STATIC:
Nov 18 18:42:29 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e
Nov 18 18:42:29 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:42:29 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:42:29 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a
Nov 18 18:42:29 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:42:29 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:42:29 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:42:29 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:42:29 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:42:29 user nova-compute[74692]: FIRMWARE:
Nov 18 18:42:29 user nova-compute[74692]: No targets found.
Nov 18 18:42:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:42:29 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:42:29 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9c4e82-8323-472b-9dd6-7b61f156eb2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a96f1a1-90e2-4993-adb5-10a03fc17fa2]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:42:29 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:42:29 user nova-compute[74692]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e (non-flash)
Nov 18 18:42:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:42:29 user nova-compute[74692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a (non-flash)
Nov 18 18:42:29 user nova-compute[74692]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e (non-flash)
Nov 18 18:42:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a450d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a'): ({'sdc'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Removing single pathed devices sdc {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b57914f-4614-40b4-8125-dcebbd4435a0]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ae5c84-93c3-4dd5-aede-5aebfc8c051f]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Flushing IO for device /dev/sdc {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06ba8ed-1261-41b6-b762-d7e68fcc85d1]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4330e5ef-25d6-4c8f-acfe-adb7ca7aeedb]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6efb2ff-3dd2-4775-8adc-8f6db4418c00]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5050e5b-e51c-4901-8e51-b6ca66ab7f9a]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260]
Nov 18 18:42:29 user nova-compute[74692]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a, portal: 172.16.0.220,3260] successful.
Nov 18 18:42:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab0cca8-8f41-4c5e-a481-854949a71d2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb873236-aabf-4823-94c2-1b46794e889a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] <== disconnect_volume: return (324ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:42:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:42:30 user nova-compute[74692]: DEBUG nova.objects.instance [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lazy-loading 'flavor' on Instance uuid df36071b-3fe8-48fb-9a17-818eb391779e {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:42:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-de3821c0-ff5f-4ff6-9ab7-afa2e22ed581 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "df36071b-3fe8-48fb-9a17-818eb391779e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.684s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:36 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 is timed out.
Nov 18 18:42:36 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Successfully detached device vdb from instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 from the live domain config.
Nov 18 18:42:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahBdJpoc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:42:36 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1797ec0-6e5e-4bae-9969-cb1076b6e911]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:42:36 user nova-compute[74692]: No targets found.
Nov 18 18:42:36 user nova-compute[74692]: iSNS:
Nov 18 18:42:36 user nova-compute[74692]: No targets found.
Nov 18 18:42:36 user nova-compute[74692]: STATIC:
Nov 18 18:42:36 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e
Nov 18 18:42:36 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:42:36 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:42:36 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:42:36 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:42:36 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:42:36 user nova-compute[74692]: FIRMWARE:
Nov 18 18:42:36 user nova-compute[74692]: No targets found.
Nov 18 18:42:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:42:36 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:42:36 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[238077cd-739a-4326-a31e-ed802fe369ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc06749-30e9-4d85-b854-d83869862088]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:42:36 user nova-compute[74692]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e (non-flash)
Nov 18 18:42:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:42:36 user nova-compute[74692]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e (non-flash)
Nov 18 18:42:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a4314310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e'): ({'sdd'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Removing single pathed devices sdd {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe9b8e5-61af-4713-ac0f-e4e2484b1c77]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6710951-8c8b-43fd-865e-119caaf255a0]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Flushing IO for device /dev/sdd {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abe8b2c-baad-46ad-9244-c575592311df]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1dc326-ed5c-4ee2-9291-2d9a20130b8e]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4520468a-bbae-4555-97f2-ca0c8d247952]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f13bed2-988b-49c8-b220-483469e6b25f]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e, portal: 172.16.0.220,3260]
Nov 18 18:42:36 user nova-compute[74692]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e, portal: 172.16.0.220,3260] successful.
Nov 18 18:42:36 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee0ebf8-1338-4095-9853-d3bf3936803e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[334ccf0a-c4d1-475f-a2fa-cfde6440f270]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] <== disconnect_volume: return (288ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:42:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:42:37 user nova-compute[74692]: DEBUG nova.objects.instance [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lazy-loading 'flavor' on Instance uuid 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:42:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-60481a6e-022f-4d13-a317-dc528586bb00 tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.700s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:47 user nova-compute[74692]: DEBUG nova.compute.manager [req-9d4a2e08-4def-468d-a821-589a4ca84f4e req-23c40d5b-9eff-47b4-8079-365b7e7ce4e7 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-changed-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:42:47 user nova-compute[74692]: DEBUG nova.compute.manager [req-9d4a2e08-4def-468d-a821-589a4ca84f4e req-23c40d5b-9eff-47b4-8079-365b7e7ce4e7 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Refreshing instance network info cache due to event network-changed-a3106847-e69a-4753-b6d9-7e0dd00a58ab. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:42:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9d4a2e08-4def-468d-a821-589a4ca84f4e req-23c40d5b-9eff-47b4-8079-365b7e7ce4e7 service nova] Acquiring lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:42:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9d4a2e08-4def-468d-a821-589a4ca84f4e req-23c40d5b-9eff-47b4-8079-365b7e7ce4e7 service nova] Acquired lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:42:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-9d4a2e08-4def-468d-a821-589a4ca84f4e req-23c40d5b-9eff-47b4-8079-365b7e7ce4e7 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Refreshing network info cache for port a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG nova.objects.instance [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'flavor' on Instance uuid 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:48 user nova-compute[74692]: INFO nova.compute.manager [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Attaching volume 182bad63-5b54-4cc9-bd85-321759669d90 to /dev/vdb
Nov 18 18:42:48 user nova-compute[74692]: DEBUG os_brick.utils [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG nova.network.neutron [req-9d4a2e08-4def-468d-a821-589a4ca84f4e req-23c40d5b-9eff-47b4-8079-365b7e7ce4e7 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Updated VIF entry in instance network info cache for port a3106847-e69a-4753-b6d9-7e0dd00a58ab. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG nova.network.neutron [req-9d4a2e08-4def-468d-a821-589a4ca84f4e req-23c40d5b-9eff-47b4-8079-365b7e7ce4e7 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Updating instance_info_cache with network_info: [{"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a7e939-c18d-4beb-9892-2e4bc4a82857]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9d4a2e08-4def-468d-a821-589a4ca84f4e req-23c40d5b-9eff-47b4-8079-365b7e7ce4e7 service nova] Releasing lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d50fb1-2e60-4302-bd05-fbce59c5e97b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6170f7-b2d6-4e3f-9b44-6b7e865f2aed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f96b28e-5d82-45ba-a712-a5a206c9de8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:42:48 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:42:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fadce4-954a-460b-ba32-c56f756627bc]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG os_brick.utils [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:42:48 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Updating existing volume attachment record: ae5eaee4-e22a-4618-a36c-12af7d6d34ea {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:42:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:50 user nova-compute[74692]: INFO nova.compute.manager [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Terminating instance
Nov 18 18:42:50 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-1eb46392-2d55-4fba-9b93-5027ff01a6f6 req-a80c0152-1441-4128-8008-03048ce8060e service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-vif-unplugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1eb46392-2d55-4fba-9b93-5027ff01a6f6 req-a80c0152-1441-4128-8008-03048ce8060e service nova] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1eb46392-2d55-4fba-9b93-5027ff01a6f6 req-a80c0152-1441-4128-8008-03048ce8060e service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1eb46392-2d55-4fba-9b93-5027ff01a6f6 req-a80c0152-1441-4128-8008-03048ce8060e service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-1eb46392-2d55-4fba-9b93-5027ff01a6f6 req-a80c0152-1441-4128-8008-03048ce8060e service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] No waiting events found dispatching network-vif-unplugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:42:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-1eb46392-2d55-4fba-9b93-5027ff01a6f6 req-a80c0152-1441-4128-8008-03048ce8060e service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-vif-unplugged-9753f583-4360-48e8-a59f-43b16198aa36 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:42:51 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Instance destroyed successfully.
Nov 18 18:42:51 user nova-compute[74692]: DEBUG nova.objects.instance [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'resources' on Instance uuid 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:42:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1934677203',display_name='tempest-AttachVolumeTestJSON-server-1934677203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1934677203',id=17,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWoJ1g21ysWeKm0aCaq0iDAu6GFhJ4Kgqa/cYa4mb67PyeCSQSB1+k/re9L+dOqnhT2aQmCtGqB0zHW7DLxwgFWBB78ohK6z8iaUSg7A5I+FxwvxJ5cm1dB7niInB9aXw==',key_name='tempest-keypair-29977122',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:33:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da05b2ed39a3489db70da40991bc8e48',ramdisk_id='',reservation_id='r-xspl17l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-858172900',owner_user_name='tempest-AttachVolumeTestJSON-858172900-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9dad2e2f1d541bf803b5d923db5242b',uuid=96c70a3c-82db-4adf-8f9b-4e7c1a37b519,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:42:51 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converting VIF {"id": "9753f583-4360-48e8-a59f-43b16198aa36", "address": "fa:16:3e:bb:07:0d", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9753f583-43", "ovs_interfaceid": "9753f583-4360-48e8-a59f-43b16198aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:42:51 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:42:51 user nova-compute[74692]: DEBUG os_vif [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:42:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9753f583-43, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:42:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65c11de9-261f-4735-9e85-8fe2aedd5a6b) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:42:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:42:51 user nova-compute[74692]: INFO os_vif [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=9753f583-4360-48e8-a59f-43b16198aa36,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9753f583-43')
Nov 18 18:42:51 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Deleting instance files /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519_del
Nov 18 18:42:51 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Deletion of /opt/stack/data/nova/instances/96c70a3c-82db-4adf-8f9b-4e7c1a37b519_del complete
Nov 18 18:42:51 user nova-compute[74692]: INFO nova.compute.manager [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 18 18:42:51 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:42:51 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:42:51 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:42:52 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:42:52 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Took 0.95 seconds to deallocate network for instance.
Nov 18 18:42:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-4c801088-902a-4e2e-ba37-1a1a03d6f73d req-4f657b26-4cf5-4040-9979-204f32fbb38c service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-vif-deleted-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:42:52 user nova-compute[74692]: INFO nova.compute.manager [req-4c801088-902a-4e2e-ba37-1a1a03d6f73d req-4f657b26-4cf5-4040-9979-204f32fbb38c service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Neutron deleted interface 9753f583-4360-48e8-a59f-43b16198aa36; detaching it from the instance and deleting it from the info cache
Nov 18 18:42:52 user nova-compute[74692]: DEBUG nova.network.neutron [req-4c801088-902a-4e2e-ba37-1a1a03d6f73d req-4f657b26-4cf5-4040-9979-204f32fbb38c service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:42:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-4c801088-902a-4e2e-ba37-1a1a03d6f73d req-4f657b26-4cf5-4040-9979-204f32fbb38c service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Detach interface failed, port_id=9753f583-4360-48e8-a59f-43b16198aa36, reason: Instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:42:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:52 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:42:52 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:42:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:52 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Deleted allocations for instance 96c70a3c-82db-4adf-8f9b-4e7c1a37b519
Nov 18 18:42:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-73d3735f-44fd-4c84-b19a-668cf91aef1f req-8393a282-6c2d-4453-852d-1e8521939fb5 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:42:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-73d3735f-44fd-4c84-b19a-668cf91aef1f req-8393a282-6c2d-4453-852d-1e8521939fb5 service nova] Acquiring lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-73d3735f-44fd-4c84-b19a-668cf91aef1f req-8393a282-6c2d-4453-852d-1e8521939fb5 service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-73d3735f-44fd-4c84-b19a-668cf91aef1f req-8393a282-6c2d-4453-852d-1e8521939fb5 service nova] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-73d3735f-44fd-4c84-b19a-668cf91aef1f req-8393a282-6c2d-4453-852d-1e8521939fb5 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] No waiting events found dispatching network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:42:52 user nova-compute[74692]: WARNING nova.compute.manager [req-73d3735f-44fd-4c84-b19a-668cf91aef1f req-8393a282-6c2d-4453-852d-1e8521939fb5 service nova] [instance: 96c70a3c-82db-4adf-8f9b-4e7c1a37b519] Received unexpected event network-vif-plugged-9753f583-4360-48e8-a59f-43b16198aa36 for instance with vm_state deleted and task_state None.
Nov 18 18:42:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6411ecff-5390-4388-ba5b-f639cbd8e7e7 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "96c70a3c-82db-4adf-8f9b-4e7c1a37b519" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.396s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smvOIzSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:42:53 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:42:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:42:53 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:42:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:42:53 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b37b86-2e64-4324-a5db-136bf486d847]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:42:53 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[913deea1-780c-4f07-9146-7c26f14337e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90] added
Nov 18 18:42:53 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ed803c-294f-4b37-afd3-2575496a0496]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf242890-04a3-42b0-ad36-715bf0ae5ceb]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smvOIzSa {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smvOIzSa" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3eebc94-6de7-4b2e-b751-4faa049269f1]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'smvOIzSa'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a809846c-2cad-4e4c-a90a-289f942fed4e]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea787f5-6228-42a1-874a-286d78f3416c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:42:53 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:42:53 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:42:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2169a2-dd1c-4d39-802f-efd4198651b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90, portal: 172.16.0.220,3260]
Nov 18 18:42:54 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90, portal: 172.16.0.220,3260] successful.
Nov 18 18:42:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c346b67-b327-43f7-b3e8-02dca2ec14a8]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b2cf8e-7d58-4c31-88dd-b4df08030b6e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:42:54 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:42:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:42:54 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:42:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a879e84b-2a2a-4df5-9957-97603366a5a7]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:42:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smvOIzSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:42:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:42:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23164333439336234', 'path': '/dev/sdc'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:42:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164333439336234', 'path': '/dev/sdc'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:42:55 user nova-compute[74692]: DEBUG nova.objects.instance [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'flavor' on Instance uuid 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:42:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:42:55 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:42:55 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:42:55 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:42:55 user nova-compute[74692]:   <serial>182bad63-5b54-4cc9-bd85-321759669d90</serial>
Nov 18 18:42:55 user nova-compute[74692]: </disk>
Nov 18 18:42:55 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:42:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:42:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:42:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No VIF found with MAC fa:16:3e:e1:70:8c, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:42:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f3b4640d-48c7-408e-9bfa-2d3e93925934 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.430s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:56 user nova-compute[74692]: INFO nova.compute.manager [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Rescuing
Nov 18 18:42:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:42:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquired lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:42:56 user nova-compute[74692]: DEBUG nova.network.neutron [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:42:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:56 user nova-compute[74692]: DEBUG nova.network.neutron [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Updating instance_info_cache with network_info: [{"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:42:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Releasing lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:42:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.compute.manager [req-d5457535-2ec1-4684-b5f0-3960df57a9d2 req-e46b6477-4f17-4501-95a2-03619e96cc5d service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-unplugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d5457535-2ec1-4684-b5f0-3960df57a9d2 req-e46b6477-4f17-4501-95a2-03619e96cc5d service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d5457535-2ec1-4684-b5f0-3960df57a9d2 req-e46b6477-4f17-4501-95a2-03619e96cc5d service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d5457535-2ec1-4684-b5f0-3960df57a9d2 req-e46b6477-4f17-4501-95a2-03619e96cc5d service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.compute.manager [req-d5457535-2ec1-4684-b5f0-3960df57a9d2 req-e46b6477-4f17-4501-95a2-03619e96cc5d service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-unplugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:42:57 user nova-compute[74692]: WARNING nova.compute.manager [req-d5457535-2ec1-4684-b5f0-3960df57a9d2 req-e46b6477-4f17-4501-95a2-03619e96cc5d service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received unexpected event network-vif-unplugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with vm_state active and task_state rescuing.
Nov 18 18:42:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:57 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Instance destroyed successfully.
Nov 18 18:42:57 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Attempting rescue
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74692) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Instance directory exists: not creating {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 18:42:57 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Creating image(s)
Nov 18 18:42:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "/opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "/opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "/opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.objects.instance [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'trusted_certs' on Instance uuid 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.195s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.rescue {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.rescue" returned: 0 in 0.051s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.objects.instance [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'migration_context' on Instance uuid 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.objects.base [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Object Instance<67a67f8d-b4f3-4d34-b4d8-ac16b1145180> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Start _get_guest_xml network_info=[{"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "vif_mac": "fa:16:3e:e1:70:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.objects.instance [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'resources' on Instance uuid 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.objects.base [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Object Instance<67a67f8d-b4f3-4d34-b4d8-ac16b1145180> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.objects.instance [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'numa_topology' on Instance uuid 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.objects.base [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Object Instance<67a67f8d-b4f3-4d34-b4d8-ac16b1145180> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:42:57 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:42:57 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.objects.instance [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'vcpu_model' on Instance uuid 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.objects.base [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Object Instance<67a67f8d-b4f3-4d34-b4d8-ac16b1145180> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1487096690',display_name='tempest-ServerRescueNegativeTestJSON-server-1487096690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1487096690',id=28,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEw+cVbulXbMuVK2CD9909l6Wk27f732QqQYNxb/cZ8LjOheZfWfZ4b3pLTykV+g9E+jAQ6kGP+34RpsAwlFznuDTUI4GQQ0cT4TK0osf9l/aOh+KcLPyI0ky+EcglrOkA==',key_name='tempest-keypair-1382011767',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:41:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fead685ad47d4e96bb7c5225029f82ce',ramdisk_id='',reservation_id='r-lofdmcfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-88342386',owner_user_name='tempest-ServerRescueNegativeTestJSON-88342386-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:41:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c418956015544fb8ac0a8acb6af6aacd',uuid=67a67f8d-b4f3-4d34-b4d8-ac16b1145180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "vif_mac": "fa:16:3e:e1:70:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converting VIF {"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "vif_mac": "fa:16:3e:e1:70:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a3106847-e69a-4753-b6d9-7e0dd00a58ab,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3106847-e6') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.objects.instance [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'pci_devices' on Instance uuid 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.objects.base [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Object Instance<67a67f8d-b4f3-4d34-b4d8-ac16b1145180> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:42:57 user nova-compute[74692]:   <uuid>67a67f8d-b4f3-4d34-b4d8-ac16b1145180</uuid>
Nov 18 18:42:57 user nova-compute[74692]:   <name>instance-0000001c</name>
Nov 18 18:42:57 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:42:57 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:42:57 user nova-compute[74692]:   <metadata>
Nov 18 18:42:57 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:42:57 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:42:57 user nova-compute[74692]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1487096690</nova:name>
Nov 18 18:42:57 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:42:57</nova:creationTime>
Nov 18 18:42:57 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:42:57 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:42:57 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:42:57 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:42:57 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:42:57 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:42:57 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:42:57 user nova-compute[74692]:       <nova:owner>
Nov 18 18:42:57 user nova-compute[74692]:         <nova:user uuid="c418956015544fb8ac0a8acb6af6aacd">tempest-ServerRescueNegativeTestJSON-88342386-project-member</nova:user>
Nov 18 18:42:57 user nova-compute[74692]:         <nova:project uuid="fead685ad47d4e96bb7c5225029f82ce">tempest-ServerRescueNegativeTestJSON-88342386</nova:project>
Nov 18 18:42:57 user nova-compute[74692]:       </nova:owner>
Nov 18 18:42:57 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:42:57 user nova-compute[74692]:       <nova:ports>
Nov 18 18:42:57 user nova-compute[74692]:         <nova:port uuid="a3106847-e69a-4753-b6d9-7e0dd00a58ab">
Nov 18 18:42:57 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 18:42:57 user nova-compute[74692]:         </nova:port>
Nov 18 18:42:57 user nova-compute[74692]:       </nova:ports>
Nov 18 18:42:57 user nova-compute[74692]:     </nova:instance>
Nov 18 18:42:57 user nova-compute[74692]:   </metadata>
Nov 18 18:42:57 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:42:57 user nova-compute[74692]:     <system>
Nov 18 18:42:57 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:42:57 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:42:57 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:42:57 user nova-compute[74692]:       <entry name="serial">67a67f8d-b4f3-4d34-b4d8-ac16b1145180</entry>
Nov 18 18:42:57 user nova-compute[74692]:       <entry name="uuid">67a67f8d-b4f3-4d34-b4d8-ac16b1145180</entry>
Nov 18 18:42:57 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:42:57 user nova-compute[74692]:     </system>
Nov 18 18:42:57 user nova-compute[74692]:   </sysinfo>
Nov 18 18:42:57 user nova-compute[74692]:   <os>
Nov 18 18:42:57 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:42:57 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:42:57 user nova-compute[74692]:   </os>
Nov 18 18:42:57 user nova-compute[74692]:   <features>
Nov 18 18:42:57 user nova-compute[74692]:     <acpi/>
Nov 18 18:42:57 user nova-compute[74692]:     <apic/>
Nov 18 18:42:57 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:42:57 user nova-compute[74692]:   </features>
Nov 18 18:42:57 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:42:57 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:42:57 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:42:57 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:42:57 user nova-compute[74692]:   </clock>
Nov 18 18:42:57 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:42:57 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:42:57 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:42:57 user nova-compute[74692]:   </cpu>
Nov 18 18:42:57 user nova-compute[74692]:   <devices>
Nov 18 18:42:57 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:42:57 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:42:57 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.rescue"/>
Nov 18 18:42:57 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:42:57 user nova-compute[74692]:     </disk>
Nov 18 18:42:57 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:42:57 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:42:57 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk"/>
Nov 18 18:42:57 user nova-compute[74692]:       <target dev="vdb" bus="virtio"/>
Nov 18 18:42:57 user nova-compute[74692]:     </disk>
Nov 18 18:42:57 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:42:57 user nova-compute[74692]:       <mac address="fa:16:3e:e1:70:8c"/>
Nov 18 18:42:57 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:42:57 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:42:57 user nova-compute[74692]:       <target dev="tapa3106847-e6"/>
Nov 18 18:42:57 user nova-compute[74692]:     </interface>
Nov 18 18:42:57 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:42:57 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/console.log" append="off"/>
Nov 18 18:42:57 user nova-compute[74692]:     </serial>
Nov 18 18:42:57 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:42:57 user nova-compute[74692]:     <video>
Nov 18 18:42:57 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:42:57 user nova-compute[74692]:     </video>
Nov 18 18:42:57 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:42:57 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:42:57 user nova-compute[74692]:     </rng>
Nov 18 18:42:57 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:42:57 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:42:57 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:42:57 user nova-compute[74692]:     </memballoon>
Nov 18 18:42:57 user nova-compute[74692]:   </devices>
Nov 18 18:42:57 user nova-compute[74692]: </domain>
Nov 18 18:42:57 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:42:57 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Instance destroyed successfully.
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:42:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] No VIF found with MAC fa:16:3e:e1:70:8c, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "df36071b-3fe8-48fb-9a17-818eb391779e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "df36071b-3fe8-48fb-9a17-818eb391779e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:59 user nova-compute[74692]: INFO nova.compute.manager [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Terminating instance
Nov 18 18:42:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-392557b5-3087-4ae5-96f6-d5564b277cce req-216c12fb-635b-49a2-8591-6de93e01ded7 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-392557b5-3087-4ae5-96f6-d5564b277cce req-216c12fb-635b-49a2-8591-6de93e01ded7 service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-392557b5-3087-4ae5-96f6-d5564b277cce req-216c12fb-635b-49a2-8591-6de93e01ded7 service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-392557b5-3087-4ae5-96f6-d5564b277cce req-216c12fb-635b-49a2-8591-6de93e01ded7 service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-392557b5-3087-4ae5-96f6-d5564b277cce req-216c12fb-635b-49a2-8591-6de93e01ded7 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:42:59 user nova-compute[74692]: WARNING nova.compute.manager [req-392557b5-3087-4ae5-96f6-d5564b277cce req-216c12fb-635b-49a2-8591-6de93e01ded7 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received unexpected event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with vm_state active and task_state rescuing.
Nov 18 18:42:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:42:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:00 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Instance destroyed successfully.
Nov 18 18:43:00 user nova-compute[74692]: DEBUG nova.objects.instance [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lazy-loading 'resources' on Instance uuid df36071b-3fe8-48fb-9a17-818eb391779e {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T18:37:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1958383659',display_name='tempest-ServerActionsTestOtherA-server-1949595915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1958383659',id=26,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEepvhZskUYCdoSVABjCMgkFhwHmKrLIlSb5MlTcYjLz28VYCfC+0IzqpuCb73UGLxPXmt6l+8kjRWWYRsZLnLqwdnSFiKEGucHC8txk27WtUcZ44pwuuyqHzczpHxGwIg==',key_name='tempest-keypair-916762113',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:39:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdb006c6267b42fab703cfc24d93052e',ramdisk_id='',reservation_id='r-5javkpip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2047740053',owner_user_name='tempest-ServerActionsTestOtherA-2047740053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d126349e69864417bb5e02666efd534c',uuid=df36071b-3fe8-48fb-9a17-818eb391779e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converting VIF {"id": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "address": "fa:16:3e:a8:85:0a", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a60bdb4-d4", "ovs_interfaceid": "1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:85:0a,bridge_name='br-int',has_traffic_filtering=True,id=1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a60bdb4-d4') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG os_vif [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:85:0a,bridge_name='br-int',has_traffic_filtering=True,id=1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a60bdb4-d4') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a60bdb4-d4, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53c6d156-6450-4714-8c05-e5da24fa6ddc) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:43:00 user nova-compute[74692]: INFO os_vif [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:85:0a,bridge_name='br-int',has_traffic_filtering=True,id=1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a60bdb4-d4')
Nov 18 18:43:00 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Deleting instance files /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e_del
Nov 18 18:43:00 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Deletion of /opt/stack/data/nova/instances/df36071b-3fe8-48fb-9a17-818eb391779e_del complete
Nov 18 18:43:00 user nova-compute[74692]: INFO nova.compute.manager [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 18 18:43:00 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:43:00 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Took 0.67 seconds to deallocate network for instance.
Nov 18 18:43:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-d6a2d2b6-627a-4990-b5fe-ef4410d8c892 req-7189cea7-c761-4cf8-98bb-ae898c1378b7 service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received event network-vif-deleted-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received event network-vif-unplugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] Acquiring lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] No waiting events found dispatching network-vif-unplugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:43:01 user nova-compute[74692]: WARNING nova.compute.manager [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received unexpected event network-vif-unplugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 for instance with vm_state deleted and task_state None.
Nov 18 18:43:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received event network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] Acquiring lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] Lock "df36071b-3fe8-48fb-9a17-818eb391779e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] No waiting events found dispatching network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:43:01 user nova-compute[74692]: WARNING nova.compute.manager [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] [instance: df36071b-3fe8-48fb-9a17-818eb391779e] Received unexpected event network-vif-plugged-1a60bdb4-d48a-4b64-b0eb-c3323c0ef1a6 for instance with vm_state deleted and task_state None.
Nov 18 18:43:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:43:01 user nova-compute[74692]: WARNING nova.compute.manager [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received unexpected event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with vm_state active and task_state rescuing.
Nov 18 18:43:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:43:01 user nova-compute[74692]: WARNING nova.compute.manager [req-74d22ffd-7724-46dd-8703-b45e4ab97491 req-7ce4de46-ff77-4031-bc28-ccb39fe2469b service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received unexpected event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with vm_state active and task_state rescuing.
Nov 18 18:43:01 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:01 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Deleted allocations for instance df36071b-3fe8-48fb-9a17-818eb391779e
Nov 18 18:43:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f2221ce5-b5ee-412d-8261-3239bd26e64c tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "df36071b-3fe8-48fb-9a17-818eb391779e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.425s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-343683fe-e781-4224-99e5-2a1ab68a1edd tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:43:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:07 user nova-compute[74692]: INFO nova.compute.manager [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Terminating instance
Nov 18 18:43:07 user nova-compute[74692]: DEBUG nova.compute.manager [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:43:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:07 user nova-compute[74692]: DEBUG nova.compute.manager [req-2fa3c8b6-bc50-40cd-bc45-242823d72adb req-325270cb-1dbf-41df-889e-8e4ec800bc4c service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Received event network-vif-unplugged-412478e8-b43d-4110-97df-31bff96d9b73 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2fa3c8b6-bc50-40cd-bc45-242823d72adb req-325270cb-1dbf-41df-889e-8e4ec800bc4c service nova] Acquiring lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2fa3c8b6-bc50-40cd-bc45-242823d72adb req-325270cb-1dbf-41df-889e-8e4ec800bc4c service nova] Lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2fa3c8b6-bc50-40cd-bc45-242823d72adb req-325270cb-1dbf-41df-889e-8e4ec800bc4c service nova] Lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:07 user nova-compute[74692]: DEBUG nova.compute.manager [req-2fa3c8b6-bc50-40cd-bc45-242823d72adb req-325270cb-1dbf-41df-889e-8e4ec800bc4c service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] No waiting events found dispatching network-vif-unplugged-412478e8-b43d-4110-97df-31bff96d9b73 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:43:07 user nova-compute[74692]: DEBUG nova.compute.manager [req-2fa3c8b6-bc50-40cd-bc45-242823d72adb req-325270cb-1dbf-41df-889e-8e4ec800bc4c service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Received event network-vif-unplugged-412478e8-b43d-4110-97df-31bff96d9b73 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:08 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Instance destroyed successfully.
Nov 18 18:43:08 user nova-compute[74692]: DEBUG nova.objects.instance [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lazy-loading 'resources' on Instance uuid c85d0595-b6e1-435a-9058-1b5a4bbb3e4f {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:41:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-159781550',display_name='tempest-ServersNegativeTestJSON-server-159781550',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-159781550',id=29,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:41:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e2df1316b5841adb2eadb476e70fcb1',ramdisk_id='',reservation_id='r-dsdovndt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1078755651',owner_user_name='tempest-ServersNegativeTestJSON-1078755651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:41:25Z,user_data=None,user_id='b4286ee787ba4de8b4318f8e14259b52',uuid=c85d0595-b6e1-435a-9058-1b5a4bbb3e4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "412478e8-b43d-4110-97df-31bff96d9b73", "address": "fa:16:3e:80:73:9a", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412478e8-b4", "ovs_interfaceid": "412478e8-b43d-4110-97df-31bff96d9b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Converting VIF {"id": "412478e8-b43d-4110-97df-31bff96d9b73", "address": "fa:16:3e:80:73:9a", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412478e8-b4", "ovs_interfaceid": "412478e8-b43d-4110-97df-31bff96d9b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:73:9a,bridge_name='br-int',has_traffic_filtering=True,id=412478e8-b43d-4110-97df-31bff96d9b73,network=Network(096fe7c9-e167-4c06-a783-984e868249dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412478e8-b4') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG os_vif [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:73:9a,bridge_name='br-int',has_traffic_filtering=True,id=412478e8-b43d-4110-97df-31bff96d9b73,network=Network(096fe7c9-e167-4c06-a783-984e868249dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412478e8-b4') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap412478e8-b4, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5adb03b3-5058-4f99-ba56-7a9db9f53fb3) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:08 user nova-compute[74692]: INFO os_vif [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:73:9a,bridge_name='br-int',has_traffic_filtering=True,id=412478e8-b43d-4110-97df-31bff96d9b73,network=Network(096fe7c9-e167-4c06-a783-984e868249dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412478e8-b4')
Nov 18 18:43:08 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Deleting instance files /opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f_del
Nov 18 18:43:08 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Deletion of /opt/stack/data/nova/instances/c85d0595-b6e1-435a-9058-1b5a4bbb3e4f_del complete
Nov 18 18:43:08 user nova-compute[74692]: INFO nova.compute.manager [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 18 18:43:08 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:43:08 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:43:09 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:43:09 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Took 0.44 seconds to deallocate network for instance.
Nov 18 18:43:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-4388a1ec-88e7-47b6-93e5-6e6f1c81a1a8 req-2ee4c0e1-1582-48c1-ac9f-9c99f37dad38 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Received event network-vif-deleted-412478e8-b43d-4110-97df-31bff96d9b73 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:09 user nova-compute[74692]: INFO nova.compute.manager [req-4388a1ec-88e7-47b6-93e5-6e6f1c81a1a8 req-2ee4c0e1-1582-48c1-ac9f-9c99f37dad38 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Neutron deleted interface 412478e8-b43d-4110-97df-31bff96d9b73; detaching it from the instance and deleting it from the info cache
Nov 18 18:43:09 user nova-compute[74692]: DEBUG nova.network.neutron [req-4388a1ec-88e7-47b6-93e5-6e6f1c81a1a8 req-2ee4c0e1-1582-48c1-ac9f-9c99f37dad38 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:43:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-4388a1ec-88e7-47b6-93e5-6e6f1c81a1a8 req-2ee4c0e1-1582-48c1-ac9f-9c99f37dad38 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Detach interface failed, port_id=412478e8-b43d-4110-97df-31bff96d9b73, reason: Instance c85d0595-b6e1-435a-9058-1b5a4bbb3e4f could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:43:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:09 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:43:09 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:43:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:09 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Deleted allocations for instance c85d0595-b6e1-435a-9058-1b5a4bbb3e4f
Nov 18 18:43:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-657eecab-5f29-4f49-9f23-9303d478f0b2 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.018s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-bed7f91b-9e5e-4dcc-b38e-fd3497cd565b req-95c8d9d2-5d6b-434f-8017-75282174c3c7 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Received event network-vif-plugged-412478e8-b43d-4110-97df-31bff96d9b73 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-bed7f91b-9e5e-4dcc-b38e-fd3497cd565b req-95c8d9d2-5d6b-434f-8017-75282174c3c7 service nova] Acquiring lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-bed7f91b-9e5e-4dcc-b38e-fd3497cd565b req-95c8d9d2-5d6b-434f-8017-75282174c3c7 service nova] Lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-bed7f91b-9e5e-4dcc-b38e-fd3497cd565b req-95c8d9d2-5d6b-434f-8017-75282174c3c7 service nova] Lock "c85d0595-b6e1-435a-9058-1b5a4bbb3e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-bed7f91b-9e5e-4dcc-b38e-fd3497cd565b req-95c8d9d2-5d6b-434f-8017-75282174c3c7 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] No waiting events found dispatching network-vif-plugged-412478e8-b43d-4110-97df-31bff96d9b73 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:43:10 user nova-compute[74692]: WARNING nova.compute.manager [req-bed7f91b-9e5e-4dcc-b38e-fd3497cd565b req-95c8d9d2-5d6b-434f-8017-75282174c3c7 service nova] [instance: c85d0595-b6e1-435a-9058-1b5a4bbb3e4f] Received unexpected event network-vif-plugged-412478e8-b43d-4110-97df-31bff96d9b73 for instance with vm_state deleted and task_state None.
Nov 18 18:43:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:16 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:43:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:16 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:43:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:43:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:43:21 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:43:21 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:43:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7900MB free_disk=24.98339080810547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 30beb8e4-0363-41e0-8089-04bef2539f4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:43:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:43:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:43:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:43:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:43:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:43:22 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:43:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:43:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:43:25 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:43:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:43:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-d949d403-0a45-48bc-b64a-f63b114d1944" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:43:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-d949d403-0a45-48bc-b64a-f63b114d1944" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:43:26 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:43:26 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Updating instance_info_cache with network_info: [{"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:43:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-d949d403-0a45-48bc-b64a-f63b114d1944" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:43:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:43:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:26 user nova-compute[74692]: INFO nova.compute.manager [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Terminating instance
Nov 18 18:43:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:43:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-56b17fc6-a679-49ff-b6d4-11c73b4a0139 req-d63e8354-4342-4250-8705-632e4bf6d430 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Received event network-vif-unplugged-8f2146d5-7fed-448c-a056-be7d4d79eabd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-56b17fc6-a679-49ff-b6d4-11c73b4a0139 req-d63e8354-4342-4250-8705-632e4bf6d430 service nova] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-56b17fc6-a679-49ff-b6d4-11c73b4a0139 req-d63e8354-4342-4250-8705-632e4bf6d430 service nova] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-56b17fc6-a679-49ff-b6d4-11c73b4a0139 req-d63e8354-4342-4250-8705-632e4bf6d430 service nova] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-56b17fc6-a679-49ff-b6d4-11c73b4a0139 req-d63e8354-4342-4250-8705-632e4bf6d430 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] No waiting events found dispatching network-vif-unplugged-8f2146d5-7fed-448c-a056-be7d4d79eabd {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-56b17fc6-a679-49ff-b6d4-11c73b4a0139 req-d63e8354-4342-4250-8705-632e4bf6d430 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Received event network-vif-unplugged-8f2146d5-7fed-448c-a056-be7d4d79eabd for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:43:27 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Instance destroyed successfully.
Nov 18 18:43:27 user nova-compute[74692]: DEBUG nova.objects.instance [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lazy-loading 'resources' on Instance uuid 576a5f25-56f7-49d4-9fdc-1429f588f9e3 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1510851468',display_name='tempest-SnapshotDataIntegrityTests-server-1510851468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1510851468',id=25,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDi0O7xQG1rj/A+Q8omoIqLs2ppwaYYia4OQ6Tkrg6rnpqzhULLedUwtoB6naepamiKyou2Y8BKUPHX3E+mIVZqXSra8mLMdy7yKYdTwe/ep0Ik7rsRgvM+Q34m6CGhiyA==',key_name='tempest-keypair-374358210',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:37:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f5e045b95b64117a1f7319ada089654',ramdisk_id='',reservation_id='r-9v8l0tav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1481466',owner_user_name='tempest-SnapshotDataIntegrityTests-1481466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74039dc13ac4a03ba772f5b87296e20',uuid=576a5f25-56f7-49d4-9fdc-1429f588f9e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "address": "fa:16:3e:77:21:64", "network": {"id": "eae777ed-faa6-4132-b374-480aab64d54c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1942002881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5e045b95b64117a1f7319ada089654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2146d5-7f", "ovs_interfaceid": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Converting VIF {"id": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "address": "fa:16:3e:77:21:64", "network": {"id": "eae777ed-faa6-4132-b374-480aab64d54c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1942002881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5e045b95b64117a1f7319ada089654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2146d5-7f", "ovs_interfaceid": "8f2146d5-7fed-448c-a056-be7d4d79eabd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:21:64,bridge_name='br-int',has_traffic_filtering=True,id=8f2146d5-7fed-448c-a056-be7d4d79eabd,network=Network(eae777ed-faa6-4132-b374-480aab64d54c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2146d5-7f') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG os_vif [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:21:64,bridge_name='br-int',has_traffic_filtering=True,id=8f2146d5-7fed-448c-a056-be7d4d79eabd,network=Network(eae777ed-faa6-4132-b374-480aab64d54c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2146d5-7f') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f2146d5-7f, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9803db4a-0cb2-40c4-8a11-38d0fdcdbaed) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:27 user nova-compute[74692]: INFO os_vif [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:21:64,bridge_name='br-int',has_traffic_filtering=True,id=8f2146d5-7fed-448c-a056-be7d4d79eabd,network=Network(eae777ed-faa6-4132-b374-480aab64d54c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2146d5-7f')
Nov 18 18:43:27 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Deleting instance files /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3_del
Nov 18 18:43:27 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Deletion of /opt/stack/data/nova/instances/576a5f25-56f7-49d4-9fdc-1429f588f9e3_del complete
Nov 18 18:43:27 user nova-compute[74692]: INFO nova.compute.manager [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 18 18:43:27 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:43:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:28 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:43:28 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Took 0.77 seconds to deallocate network for instance.
Nov 18 18:43:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:28 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:43:28 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:43:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:28 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Deleted allocations for instance 576a5f25-56f7-49d4-9fdc-1429f588f9e3
Nov 18 18:43:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d57ae39f-dcdd-41c7-ba14-5ec97355e92e tempest-SnapshotDataIntegrityTests-1481466 tempest-SnapshotDataIntegrityTests-1481466-project-member] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.132s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-078078e9-ec11-4625-9046-069ccb54ecc7 req-b660e320-6d36-48ab-8042-9de15812c2c6 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Received event network-vif-plugged-8f2146d5-7fed-448c-a056-be7d4d79eabd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-078078e9-ec11-4625-9046-069ccb54ecc7 req-b660e320-6d36-48ab-8042-9de15812c2c6 service nova] Acquiring lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-078078e9-ec11-4625-9046-069ccb54ecc7 req-b660e320-6d36-48ab-8042-9de15812c2c6 service nova] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-078078e9-ec11-4625-9046-069ccb54ecc7 req-b660e320-6d36-48ab-8042-9de15812c2c6 service nova] Lock "576a5f25-56f7-49d4-9fdc-1429f588f9e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-078078e9-ec11-4625-9046-069ccb54ecc7 req-b660e320-6d36-48ab-8042-9de15812c2c6 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] No waiting events found dispatching network-vif-plugged-8f2146d5-7fed-448c-a056-be7d4d79eabd {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:43:29 user nova-compute[74692]: WARNING nova.compute.manager [req-078078e9-ec11-4625-9046-069ccb54ecc7 req-b660e320-6d36-48ab-8042-9de15812c2c6 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Received unexpected event network-vif-plugged-8f2146d5-7fed-448c-a056-be7d4d79eabd for instance with vm_state deleted and task_state None.
Nov 18 18:43:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-078078e9-ec11-4625-9046-069ccb54ecc7 req-b660e320-6d36-48ab-8042-9de15812c2c6 service nova] [instance: 576a5f25-56f7-49d4-9fdc-1429f588f9e3] Received event network-vif-deleted-8f2146d5-7fed-448c-a056-be7d4d79eabd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:37 user nova-compute[74692]: DEBUG nova.compute.manager [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:43:37 user nova-compute[74692]: INFO nova.compute.manager [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] instance snapshotting
Nov 18 18:43:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:37 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Beginning live snapshot process
Nov 18 18:43:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json -f qcow2 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json -f qcow2 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.203s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppjjc56wf/b2f30a75d9604319b84e9dc64d7aaf36.delta 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppjjc56wf/b2f30a75d9604319b84e9dc64d7aaf36.delta 1073741824" returned: 0 in 0.090s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:38 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 18 18:43:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:43:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 18:43:39 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 18 18:43:39 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:43:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppjjc56wf/b2f30a75d9604319b84e9dc64d7aaf36.delta /opt/stack/data/nova/instances/snapshots/tmppjjc56wf/b2f30a75d9604319b84e9dc64d7aaf36 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppjjc56wf/b2f30a75d9604319b84e9dc64d7aaf36.delta /opt/stack/data/nova/instances/snapshots/tmppjjc56wf/b2f30a75d9604319b84e9dc64d7aaf36" returned: 0 in 0.457s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:40 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Snapshot extracted, beginning image upload
Nov 18 18:43:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:43 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Snapshot image upload complete
Nov 18 18:43:43 user nova-compute[74692]: INFO nova.compute.manager [None req-4bd6e50c-8ed3-4b71-b131-3ce917bcaf64 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Took 5.67 seconds to snapshot the instance on the hypervisor.
Nov 18 18:43:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:44 user nova-compute[74692]: DEBUG nova.compute.manager [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:43:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:44 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:43:44 user nova-compute[74692]: INFO nova.compute.claims [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Claim successful on node user
Nov 18 18:43:45 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:43:45 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:43:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:43:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:43:45 user nova-compute[74692]: DEBUG nova.network.neutron [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:43:45 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:43:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:43:45 user nova-compute[74692]: DEBUG nova.policy [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9dad2e2f1d541bf803b5d923db5242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da05b2ed39a3489db70da40991bc8e48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:43:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:43:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:43:45 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Creating image(s)
Nov 18 18:43:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "/opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "/opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "/opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk 1073741824" returned: 0 in 0.057s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Successfully created port: 1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Cannot resize image /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Ensure instance console log exists: /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Successfully updated port: 1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "refresh_cache-a31844da-6f7e-4711-bccc-e31d2114d66d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquired lock "refresh_cache-a31844da-6f7e-4711-bccc-e31d2114d66d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-57988c93-911c-44b9-a12d-269cfb1c5929 req-47e4f8d6-ab7b-4262-9e52-fbba2ab2b4d1 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received event network-changed-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-57988c93-911c-44b9-a12d-269cfb1c5929 req-47e4f8d6-ab7b-4262-9e52-fbba2ab2b4d1 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Refreshing instance network info cache due to event network-changed-1a2ac737-2d49-427d-83d6-5b1c096a21ec. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-57988c93-911c-44b9-a12d-269cfb1c5929 req-47e4f8d6-ab7b-4262-9e52-fbba2ab2b4d1 service nova] Acquiring lock "refresh_cache-a31844da-6f7e-4711-bccc-e31d2114d66d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:43:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.network.neutron [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Updating instance_info_cache with network_info: [{"id": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "address": "fa:16:3e:95:47:96", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2ac737-2d", "ovs_interfaceid": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Releasing lock "refresh_cache-a31844da-6f7e-4711-bccc-e31d2114d66d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.compute.manager [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Instance network_info: |[{"id": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "address": "fa:16:3e:95:47:96", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2ac737-2d", "ovs_interfaceid": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-57988c93-911c-44b9-a12d-269cfb1c5929 req-47e4f8d6-ab7b-4262-9e52-fbba2ab2b4d1 service nova] Acquired lock "refresh_cache-a31844da-6f7e-4711-bccc-e31d2114d66d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-57988c93-911c-44b9-a12d-269cfb1c5929 req-47e4f8d6-ab7b-4262-9e52-fbba2ab2b4d1 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Refreshing network info cache for port 1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Start _get_guest_xml network_info=[{"id": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "address": "fa:16:3e:95:47:96", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2ac737-2d", "ovs_interfaceid": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:43:47 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:43:47 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1040447622',display_name='tempest-AttachVolumeTestJSON-server-1040447622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1040447622',id=31,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/ySpPqXGmEcLYBj4PRCOsMBqwCveQxREc2GsXAKXlev7RHuKUgNfSz0yI4d6lzu8RWxsOvXI1oKm+JvWTqf0kYYDUb34UGvD9FKsnhknCJo+LJ6U+UVuGgdYqogoCC9g==',key_name='tempest-keypair-1408897553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da05b2ed39a3489db70da40991bc8e48',ramdisk_id='',reservation_id='r-1xxk084z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-858172900',owner_user_name='tempest-AttachVolumeTestJSON-858172900-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9dad2e2f1d541bf803b5d923db5242b',uuid=a31844da-6f7e-4711-bccc-e31d2114d66d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "address": "fa:16:3e:95:47:96", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2ac737-2d", "ovs_interfaceid": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converting VIF {"id": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "address": "fa:16:3e:95:47:96", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2ac737-2d", "ovs_interfaceid": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:47:96,bridge_name='br-int',has_traffic_filtering=True,id=1a2ac737-2d49-427d-83d6-5b1c096a21ec,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2ac737-2d') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.objects.instance [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'pci_devices' on Instance uuid a31844da-6f7e-4711-bccc-e31d2114d66d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:43:47 user nova-compute[74692]:   <uuid>a31844da-6f7e-4711-bccc-e31d2114d66d</uuid>
Nov 18 18:43:47 user nova-compute[74692]:   <name>instance-0000001f</name>
Nov 18 18:43:47 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:43:47 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:43:47 user nova-compute[74692]:   <metadata>
Nov 18 18:43:47 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:43:47 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:43:47 user nova-compute[74692]:       <nova:name>tempest-AttachVolumeTestJSON-server-1040447622</nova:name>
Nov 18 18:43:47 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:43:47</nova:creationTime>
Nov 18 18:43:47 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:43:47 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:43:47 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:43:47 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:43:47 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:43:47 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:43:47 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:43:47 user nova-compute[74692]:       <nova:owner>
Nov 18 18:43:47 user nova-compute[74692]:         <nova:user uuid="f9dad2e2f1d541bf803b5d923db5242b">tempest-AttachVolumeTestJSON-858172900-project-member</nova:user>
Nov 18 18:43:47 user nova-compute[74692]:         <nova:project uuid="da05b2ed39a3489db70da40991bc8e48">tempest-AttachVolumeTestJSON-858172900</nova:project>
Nov 18 18:43:47 user nova-compute[74692]:       </nova:owner>
Nov 18 18:43:47 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:43:47 user nova-compute[74692]:       <nova:ports>
Nov 18 18:43:47 user nova-compute[74692]:         <nova:port uuid="1a2ac737-2d49-427d-83d6-5b1c096a21ec">
Nov 18 18:43:47 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 18:43:47 user nova-compute[74692]:         </nova:port>
Nov 18 18:43:47 user nova-compute[74692]:       </nova:ports>
Nov 18 18:43:47 user nova-compute[74692]:     </nova:instance>
Nov 18 18:43:47 user nova-compute[74692]:   </metadata>
Nov 18 18:43:47 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:43:47 user nova-compute[74692]:     <system>
Nov 18 18:43:47 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:43:47 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:43:47 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:43:47 user nova-compute[74692]:       <entry name="serial">a31844da-6f7e-4711-bccc-e31d2114d66d</entry>
Nov 18 18:43:47 user nova-compute[74692]:       <entry name="uuid">a31844da-6f7e-4711-bccc-e31d2114d66d</entry>
Nov 18 18:43:47 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:43:47 user nova-compute[74692]:     </system>
Nov 18 18:43:47 user nova-compute[74692]:   </sysinfo>
Nov 18 18:43:47 user nova-compute[74692]:   <os>
Nov 18 18:43:47 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:43:47 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:43:47 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:43:47 user nova-compute[74692]:   </os>
Nov 18 18:43:47 user nova-compute[74692]:   <features>
Nov 18 18:43:47 user nova-compute[74692]:     <acpi/>
Nov 18 18:43:47 user nova-compute[74692]:     <apic/>
Nov 18 18:43:47 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:43:47 user nova-compute[74692]:   </features>
Nov 18 18:43:47 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:43:47 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:43:47 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:43:47 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:43:47 user nova-compute[74692]:   </clock>
Nov 18 18:43:47 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:43:47 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:43:47 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:43:47 user nova-compute[74692]:   </cpu>
Nov 18 18:43:47 user nova-compute[74692]:   <devices>
Nov 18 18:43:47 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:43:47 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:43:47 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk"/>
Nov 18 18:43:47 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:43:47 user nova-compute[74692]:     </disk>
Nov 18 18:43:47 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:43:47 user nova-compute[74692]:       <mac address="fa:16:3e:95:47:96"/>
Nov 18 18:43:47 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:43:47 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:43:47 user nova-compute[74692]:       <target dev="tap1a2ac737-2d"/>
Nov 18 18:43:47 user nova-compute[74692]:     </interface>
Nov 18 18:43:47 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:43:47 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/console.log" append="off"/>
Nov 18 18:43:47 user nova-compute[74692]:     </serial>
Nov 18 18:43:47 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:43:47 user nova-compute[74692]:     <video>
Nov 18 18:43:47 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:43:47 user nova-compute[74692]:     </video>
Nov 18 18:43:47 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:43:47 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:43:47 user nova-compute[74692]:     </rng>
Nov 18 18:43:47 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:43:47 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:43:47 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:43:47 user nova-compute[74692]:     </memballoon>
Nov 18 18:43:47 user nova-compute[74692]:   </devices>
Nov 18 18:43:47 user nova-compute[74692]: </domain>
Nov 18 18:43:47 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1040447622',display_name='tempest-AttachVolumeTestJSON-server-1040447622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1040447622',id=31,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/ySpPqXGmEcLYBj4PRCOsMBqwCveQxREc2GsXAKXlev7RHuKUgNfSz0yI4d6lzu8RWxsOvXI1oKm+JvWTqf0kYYDUb34UGvD9FKsnhknCJo+LJ6U+UVuGgdYqogoCC9g==',key_name='tempest-keypair-1408897553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da05b2ed39a3489db70da40991bc8e48',ramdisk_id='',reservation_id='r-1xxk084z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-858172900',owner_user_name='tempest-AttachVolumeTestJSON-858172900-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9dad2e2f1d541bf803b5d923db5242b',uuid=a31844da-6f7e-4711-bccc-e31d2114d66d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "address": "fa:16:3e:95:47:96", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2ac737-2d", "ovs_interfaceid": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converting VIF {"id": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "address": "fa:16:3e:95:47:96", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2ac737-2d", "ovs_interfaceid": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:47:96,bridge_name='br-int',has_traffic_filtering=True,id=1a2ac737-2d49-427d-83d6-5b1c096a21ec,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2ac737-2d') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG os_vif [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:47:96,bridge_name='br-int',has_traffic_filtering=True,id=1a2ac737-2d49-427d-83d6-5b1c096a21ec,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2ac737-2d') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13fea607-c4c7-5166-a36b-b678385a7419', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a2ac737-2d, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a2ac737-2d, col_values=(('qos', UUID('50b926d7-b670-4d18-81ca-15403c54b1f5')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a2ac737-2d, col_values=(('external_ids', {'iface-id': '1a2ac737-2d49-427d-83d6-5b1c096a21ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:47:96', 'vm-uuid': 'a31844da-6f7e-4711-bccc-e31d2114d66d'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:47 user nova-compute[74692]: INFO os_vif [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:47:96,bridge_name='br-int',has_traffic_filtering=True,id=1a2ac737-2d49-427d-83d6-5b1c096a21ec,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2ac737-2d')
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] No VIF found with MAC fa:16:3e:95:47:96, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-57988c93-911c-44b9-a12d-269cfb1c5929 req-47e4f8d6-ab7b-4262-9e52-fbba2ab2b4d1 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Updated VIF entry in instance network info cache for port 1a2ac737-2d49-427d-83d6-5b1c096a21ec. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-57988c93-911c-44b9-a12d-269cfb1c5929 req-47e4f8d6-ab7b-4262-9e52-fbba2ab2b4d1 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Updating instance_info_cache with network_info: [{"id": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "address": "fa:16:3e:95:47:96", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2ac737-2d", "ovs_interfaceid": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:43:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-57988c93-911c-44b9-a12d-269cfb1c5929 req-47e4f8d6-ab7b-4262-9e52-fbba2ab2b4d1 service nova] Releasing lock "refresh_cache-a31844da-6f7e-4711-bccc-e31d2114d66d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:43:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-39735696-c5d8-4a72-a991-71be297d25dc req-3a70a4b4-7508-4e83-98cf-8796e13cfe1e service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received event network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-39735696-c5d8-4a72-a991-71be297d25dc req-3a70a4b4-7508-4e83-98cf-8796e13cfe1e service nova] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-39735696-c5d8-4a72-a991-71be297d25dc req-3a70a4b4-7508-4e83-98cf-8796e13cfe1e service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-39735696-c5d8-4a72-a991-71be297d25dc req-3a70a4b4-7508-4e83-98cf-8796e13cfe1e service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-39735696-c5d8-4a72-a991-71be297d25dc req-3a70a4b4-7508-4e83-98cf-8796e13cfe1e service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] No waiting events found dispatching network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:43:48 user nova-compute[74692]: WARNING nova.compute.manager [req-39735696-c5d8-4a72-a991-71be297d25dc req-3a70a4b4-7508-4e83-98cf-8796e13cfe1e service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received unexpected event network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec for instance with vm_state building and task_state spawning.
Nov 18 18:43:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Acquiring lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:43:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:49 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:43:49 user nova-compute[74692]: INFO nova.compute.claims [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Claim successful on node user
Nov 18 18:43:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:49 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:43:49 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:43:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:43:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:43:49 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:43:49 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:43:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:43:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Creating image(s)
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Acquiring lock "/opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "/opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "/opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.190s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.188s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk 1073741824" returned: 0 in 0.052s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.policy [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a51eb0f7eeb4412a633bd08156a4c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cab7e23fd8427892cde275a623f367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Cannot resize image /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Ensure instance console log exists: /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.compute.manager [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:43:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Instance spawned successfully.
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:43:50 user nova-compute[74692]: INFO nova.compute.manager [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 18 18:43:50 user nova-compute[74692]: DEBUG nova.compute.manager [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:43:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-ab43cd11-f9b8-41d0-985e-53b0e1031188 req-912527dd-9a94-49a7-8296-2f75585876ec service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received event network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ab43cd11-f9b8-41d0-985e-53b0e1031188 req-912527dd-9a94-49a7-8296-2f75585876ec service nova] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ab43cd11-f9b8-41d0-985e-53b0e1031188 req-912527dd-9a94-49a7-8296-2f75585876ec service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ab43cd11-f9b8-41d0-985e-53b0e1031188 req-912527dd-9a94-49a7-8296-2f75585876ec service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-ab43cd11-f9b8-41d0-985e-53b0e1031188 req-912527dd-9a94-49a7-8296-2f75585876ec service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] No waiting events found dispatching network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:43:51 user nova-compute[74692]: WARNING nova.compute.manager [req-ab43cd11-f9b8-41d0-985e-53b0e1031188 req-912527dd-9a94-49a7-8296-2f75585876ec service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received unexpected event network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec for instance with vm_state building and task_state spawning.
Nov 18 18:43:51 user nova-compute[74692]: INFO nova.compute.manager [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Took 6.09 seconds to build instance.
Nov 18 18:43:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-86d3fd17-ce93-4ddb-847a-5f34515f5e1a tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.189s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:51 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Successfully created port: b10e42bc-ee1e-414b-894a-ad275821444f {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Successfully updated port: b10e42bc-ee1e-414b-894a-ad275821444f {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Acquiring lock "refresh_cache-b88e6df6-16de-4a8d-951a-76dcca2c7e84" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Acquired lock "refresh_cache-b88e6df6-16de-4a8d-951a-76dcca2c7e84" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.network.neutron [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Updating instance_info_cache with network_info: [{"id": "b10e42bc-ee1e-414b-894a-ad275821444f", "address": "fa:16:3e:3d:7f:08", "network": {"id": "706636f3-6117-4bb2-ad7b-e5c73e8d0e8f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4acc30afb1f4558a41fd76dac906b70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10e42bc-ee", "ovs_interfaceid": "b10e42bc-ee1e-414b-894a-ad275821444f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Releasing lock "refresh_cache-b88e6df6-16de-4a8d-951a-76dcca2c7e84" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Instance network_info: |[{"id": "b10e42bc-ee1e-414b-894a-ad275821444f", "address": "fa:16:3e:3d:7f:08", "network": {"id": "706636f3-6117-4bb2-ad7b-e5c73e8d0e8f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4acc30afb1f4558a41fd76dac906b70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10e42bc-ee", "ovs_interfaceid": "b10e42bc-ee1e-414b-894a-ad275821444f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Start _get_guest_xml network_info=[{"id": "b10e42bc-ee1e-414b-894a-ad275821444f", "address": "fa:16:3e:3d:7f:08", "network": {"id": "706636f3-6117-4bb2-ad7b-e5c73e8d0e8f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4acc30afb1f4558a41fd76dac906b70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10e42bc-ee", "ovs_interfaceid": "b10e42bc-ee1e-414b-894a-ad275821444f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:43:52 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:43:52 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-337309612',display_name='tempest-VolumesNegativeTest-instance-337309612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-337309612',id=32,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2cab7e23fd8427892cde275a623f367',ramdisk_id='',reservation_id='r-4kpr6ghu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-484470383',owner_user_name='tempest-VolumesNegativeTest-484470383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:43:50Z,user_data=None,user_id='2a51eb0f7eeb4412a633bd08156a4c80',uuid=b88e6df6-16de-4a8d-951a-76dcca2c7e84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b10e42bc-ee1e-414b-894a-ad275821444f", "address": "fa:16:3e:3d:7f:08", "network": {"id": "706636f3-6117-4bb2-ad7b-e5c73e8d0e8f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4acc30afb1f4558a41fd76dac906b70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10e42bc-ee", "ovs_interfaceid": "b10e42bc-ee1e-414b-894a-ad275821444f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Converting VIF {"id": "b10e42bc-ee1e-414b-894a-ad275821444f", "address": "fa:16:3e:3d:7f:08", "network": {"id": "706636f3-6117-4bb2-ad7b-e5c73e8d0e8f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4acc30afb1f4558a41fd76dac906b70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10e42bc-ee", "ovs_interfaceid": "b10e42bc-ee1e-414b-894a-ad275821444f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:7f:08,bridge_name='br-int',has_traffic_filtering=True,id=b10e42bc-ee1e-414b-894a-ad275821444f,network=Network(706636f3-6117-4bb2-ad7b-e5c73e8d0e8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10e42bc-ee') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.objects.instance [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lazy-loading 'pci_devices' on Instance uuid b88e6df6-16de-4a8d-951a-76dcca2c7e84 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:43:52 user nova-compute[74692]:   <uuid>b88e6df6-16de-4a8d-951a-76dcca2c7e84</uuid>
Nov 18 18:43:52 user nova-compute[74692]:   <name>instance-00000020</name>
Nov 18 18:43:52 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:43:52 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:43:52 user nova-compute[74692]:   <metadata>
Nov 18 18:43:52 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:43:52 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:43:52 user nova-compute[74692]:       <nova:name>tempest-VolumesNegativeTest-instance-337309612</nova:name>
Nov 18 18:43:52 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:43:52</nova:creationTime>
Nov 18 18:43:52 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:43:52 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:43:52 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:43:52 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:43:52 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:43:52 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:43:52 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:43:52 user nova-compute[74692]:       <nova:owner>
Nov 18 18:43:52 user nova-compute[74692]:         <nova:user uuid="2a51eb0f7eeb4412a633bd08156a4c80">tempest-VolumesNegativeTest-484470383-project-member</nova:user>
Nov 18 18:43:52 user nova-compute[74692]:         <nova:project uuid="a2cab7e23fd8427892cde275a623f367">tempest-VolumesNegativeTest-484470383</nova:project>
Nov 18 18:43:52 user nova-compute[74692]:       </nova:owner>
Nov 18 18:43:52 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:43:52 user nova-compute[74692]:       <nova:ports>
Nov 18 18:43:52 user nova-compute[74692]:         <nova:port uuid="b10e42bc-ee1e-414b-894a-ad275821444f">
Nov 18 18:43:52 user nova-compute[74692]:           <nova:ip type="fixed" address="192.168.233.186" ipVersion="4"/>
Nov 18 18:43:52 user nova-compute[74692]:         </nova:port>
Nov 18 18:43:52 user nova-compute[74692]:       </nova:ports>
Nov 18 18:43:52 user nova-compute[74692]:     </nova:instance>
Nov 18 18:43:52 user nova-compute[74692]:   </metadata>
Nov 18 18:43:52 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:43:52 user nova-compute[74692]:     <system>
Nov 18 18:43:52 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:43:52 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:43:52 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:43:52 user nova-compute[74692]:       <entry name="serial">b88e6df6-16de-4a8d-951a-76dcca2c7e84</entry>
Nov 18 18:43:52 user nova-compute[74692]:       <entry name="uuid">b88e6df6-16de-4a8d-951a-76dcca2c7e84</entry>
Nov 18 18:43:52 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:43:52 user nova-compute[74692]:     </system>
Nov 18 18:43:52 user nova-compute[74692]:   </sysinfo>
Nov 18 18:43:52 user nova-compute[74692]:   <os>
Nov 18 18:43:52 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:43:52 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:43:52 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:43:52 user nova-compute[74692]:   </os>
Nov 18 18:43:52 user nova-compute[74692]:   <features>
Nov 18 18:43:52 user nova-compute[74692]:     <acpi/>
Nov 18 18:43:52 user nova-compute[74692]:     <apic/>
Nov 18 18:43:52 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:43:52 user nova-compute[74692]:   </features>
Nov 18 18:43:52 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:43:52 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:43:52 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:43:52 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:43:52 user nova-compute[74692]:   </clock>
Nov 18 18:43:52 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:43:52 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:43:52 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:43:52 user nova-compute[74692]:   </cpu>
Nov 18 18:43:52 user nova-compute[74692]:   <devices>
Nov 18 18:43:52 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:43:52 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:43:52 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk"/>
Nov 18 18:43:52 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:43:52 user nova-compute[74692]:     </disk>
Nov 18 18:43:52 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:43:52 user nova-compute[74692]:       <mac address="fa:16:3e:3d:7f:08"/>
Nov 18 18:43:52 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:43:52 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:43:52 user nova-compute[74692]:       <target dev="tapb10e42bc-ee"/>
Nov 18 18:43:52 user nova-compute[74692]:     </interface>
Nov 18 18:43:52 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:43:52 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/console.log" append="off"/>
Nov 18 18:43:52 user nova-compute[74692]:     </serial>
Nov 18 18:43:52 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:43:52 user nova-compute[74692]:     <video>
Nov 18 18:43:52 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:43:52 user nova-compute[74692]:     </video>
Nov 18 18:43:52 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:43:52 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:43:52 user nova-compute[74692]:     </rng>
Nov 18 18:43:52 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:43:52 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:43:52 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:43:52 user nova-compute[74692]:     </memballoon>
Nov 18 18:43:52 user nova-compute[74692]:   </devices>
Nov 18 18:43:52 user nova-compute[74692]: </domain>
Nov 18 18:43:52 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-337309612',display_name='tempest-VolumesNegativeTest-instance-337309612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-337309612',id=32,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2cab7e23fd8427892cde275a623f367',ramdisk_id='',reservation_id='r-4kpr6ghu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-484470383',owner_user_name='tempest-VolumesNegativeTest-484470383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:43:50Z,user_data=None,user_id='2a51eb0f7eeb4412a633bd08156a4c80',uuid=b88e6df6-16de-4a8d-951a-76dcca2c7e84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b10e42bc-ee1e-414b-894a-ad275821444f", "address": "fa:16:3e:3d:7f:08", "network": {"id": "706636f3-6117-4bb2-ad7b-e5c73e8d0e8f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4acc30afb1f4558a41fd76dac906b70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10e42bc-ee", "ovs_interfaceid": "b10e42bc-ee1e-414b-894a-ad275821444f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Converting VIF {"id": "b10e42bc-ee1e-414b-894a-ad275821444f", "address": "fa:16:3e:3d:7f:08", "network": {"id": "706636f3-6117-4bb2-ad7b-e5c73e8d0e8f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4acc30afb1f4558a41fd76dac906b70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10e42bc-ee", "ovs_interfaceid": "b10e42bc-ee1e-414b-894a-ad275821444f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:7f:08,bridge_name='br-int',has_traffic_filtering=True,id=b10e42bc-ee1e-414b-894a-ad275821444f,network=Network(706636f3-6117-4bb2-ad7b-e5c73e8d0e8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10e42bc-ee') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG os_vif [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:7f:08,bridge_name='br-int',has_traffic_filtering=True,id=b10e42bc-ee1e-414b-894a-ad275821444f,network=Network(706636f3-6117-4bb2-ad7b-e5c73e8d0e8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10e42bc-ee') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f37c550-1a88-5a71-af45-4d5c31db5630', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb10e42bc-ee, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb10e42bc-ee, col_values=(('qos', UUID('c6f91e7c-6a03-4d40-a6f7-56381127a9fe')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb10e42bc-ee, col_values=(('external_ids', {'iface-id': 'b10e42bc-ee1e-414b-894a-ad275821444f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:7f:08', 'vm-uuid': 'b88e6df6-16de-4a8d-951a-76dcca2c7e84'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:52 user nova-compute[74692]: INFO os_vif [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:7f:08,bridge_name='br-int',has_traffic_filtering=True,id=b10e42bc-ee1e-414b-894a-ad275821444f,network=Network(706636f3-6117-4bb2-ad7b-e5c73e8d0e8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10e42bc-ee')
Nov 18 18:43:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:43:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] No VIF found with MAC fa:16:3e:3d:7f:08, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:43:53 user nova-compute[74692]: DEBUG nova.compute.manager [req-00efe032-4946-489a-98de-de4d96908aa2 req-ff5c30be-97ed-4903-b528-487f1d6fc2ee service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Received event network-changed-b10e42bc-ee1e-414b-894a-ad275821444f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:53 user nova-compute[74692]: DEBUG nova.compute.manager [req-00efe032-4946-489a-98de-de4d96908aa2 req-ff5c30be-97ed-4903-b528-487f1d6fc2ee service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Refreshing instance network info cache due to event network-changed-b10e42bc-ee1e-414b-894a-ad275821444f. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:43:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-00efe032-4946-489a-98de-de4d96908aa2 req-ff5c30be-97ed-4903-b528-487f1d6fc2ee service nova] Acquiring lock "refresh_cache-b88e6df6-16de-4a8d-951a-76dcca2c7e84" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:43:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-00efe032-4946-489a-98de-de4d96908aa2 req-ff5c30be-97ed-4903-b528-487f1d6fc2ee service nova] Acquired lock "refresh_cache-b88e6df6-16de-4a8d-951a-76dcca2c7e84" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:43:53 user nova-compute[74692]: DEBUG nova.network.neutron [req-00efe032-4946-489a-98de-de4d96908aa2 req-ff5c30be-97ed-4903-b528-487f1d6fc2ee service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Refreshing network info cache for port b10e42bc-ee1e-414b-894a-ad275821444f {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:43:53 user nova-compute[74692]: DEBUG nova.network.neutron [req-00efe032-4946-489a-98de-de4d96908aa2 req-ff5c30be-97ed-4903-b528-487f1d6fc2ee service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Updated VIF entry in instance network info cache for port b10e42bc-ee1e-414b-894a-ad275821444f. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:43:53 user nova-compute[74692]: DEBUG nova.network.neutron [req-00efe032-4946-489a-98de-de4d96908aa2 req-ff5c30be-97ed-4903-b528-487f1d6fc2ee service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Updating instance_info_cache with network_info: [{"id": "b10e42bc-ee1e-414b-894a-ad275821444f", "address": "fa:16:3e:3d:7f:08", "network": {"id": "706636f3-6117-4bb2-ad7b-e5c73e8d0e8f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4acc30afb1f4558a41fd76dac906b70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10e42bc-ee", "ovs_interfaceid": "b10e42bc-ee1e-414b-894a-ad275821444f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:43:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-00efe032-4946-489a-98de-de4d96908aa2 req-ff5c30be-97ed-4903-b528-487f1d6fc2ee service nova] Releasing lock "refresh_cache-b88e6df6-16de-4a8d-951a-76dcca2c7e84" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:43:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:55 user nova-compute[74692]: DEBUG nova.compute.manager [req-470cbd51-45df-4256-9812-45070bd4be47 req-4e80fa79-1b4f-4514-94d9-8f2fe227dc8d service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Received event network-vif-plugged-b10e42bc-ee1e-414b-894a-ad275821444f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-470cbd51-45df-4256-9812-45070bd4be47 req-4e80fa79-1b4f-4514-94d9-8f2fe227dc8d service nova] Acquiring lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-470cbd51-45df-4256-9812-45070bd4be47 req-4e80fa79-1b4f-4514-94d9-8f2fe227dc8d service nova] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-470cbd51-45df-4256-9812-45070bd4be47 req-4e80fa79-1b4f-4514-94d9-8f2fe227dc8d service nova] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:55 user nova-compute[74692]: DEBUG nova.compute.manager [req-470cbd51-45df-4256-9812-45070bd4be47 req-4e80fa79-1b4f-4514-94d9-8f2fe227dc8d service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] No waiting events found dispatching network-vif-plugged-b10e42bc-ee1e-414b-894a-ad275821444f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:43:55 user nova-compute[74692]: WARNING nova.compute.manager [req-470cbd51-45df-4256-9812-45070bd4be47 req-4e80fa79-1b4f-4514-94d9-8f2fe227dc8d service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Received unexpected event network-vif-plugged-b10e42bc-ee1e-414b-894a-ad275821444f for instance with vm_state building and task_state spawning.
Nov 18 18:43:55 user nova-compute[74692]: DEBUG nova.compute.manager [req-470cbd51-45df-4256-9812-45070bd4be47 req-4e80fa79-1b4f-4514-94d9-8f2fe227dc8d service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Received event network-vif-plugged-b10e42bc-ee1e-414b-894a-ad275821444f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:43:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-470cbd51-45df-4256-9812-45070bd4be47 req-4e80fa79-1b4f-4514-94d9-8f2fe227dc8d service nova] Acquiring lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:43:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-470cbd51-45df-4256-9812-45070bd4be47 req-4e80fa79-1b4f-4514-94d9-8f2fe227dc8d service nova] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:43:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-470cbd51-45df-4256-9812-45070bd4be47 req-4e80fa79-1b4f-4514-94d9-8f2fe227dc8d service nova] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:55 user nova-compute[74692]: DEBUG nova.compute.manager [req-470cbd51-45df-4256-9812-45070bd4be47 req-4e80fa79-1b4f-4514-94d9-8f2fe227dc8d service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] No waiting events found dispatching network-vif-plugged-b10e42bc-ee1e-414b-894a-ad275821444f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:43:55 user nova-compute[74692]: WARNING nova.compute.manager [req-470cbd51-45df-4256-9812-45070bd4be47 req-4e80fa79-1b4f-4514-94d9-8f2fe227dc8d service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Received unexpected event network-vif-plugged-b10e42bc-ee1e-414b-894a-ad275821444f for instance with vm_state building and task_state spawning.
Nov 18 18:43:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:43:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:43:56 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Instance spawned successfully.
Nov 18 18:43:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:43:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:43:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:43:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:43:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:43:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:43:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:43:56 user nova-compute[74692]: INFO nova.compute.manager [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 18 18:43:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:43:56 user nova-compute[74692]: INFO nova.compute.manager [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Took 7.29 seconds to build instance.
Nov 18 18:43:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1a89d460-271f-43bc-beaf-9b0b188be561 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.413s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:43:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:43:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:44:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 18:44:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:44:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:44:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:14 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:44:16 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:44:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:16 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:44:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:17 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:18 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:44:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:44:21 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:44:21 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:44:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7762MB free_disk=24.903182983398438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:44:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:44:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:44:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:44:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:44:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:44:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 30beb8e4-0363-41e0-8089-04bef2539f4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:44:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:44:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:44:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance a31844da-6f7e-4711-bccc-e31d2114d66d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:44:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance b88e6df6-16de-4a8d-951a-76dcca2c7e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:44:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:44:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:44:21 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:44:22 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:44:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:44:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.690s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:44:22 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 18:44:22 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] There are 0 instances to clean {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 18:44:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:44:22 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 18:44:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:44:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:44:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:44:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:44:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:44:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:44:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:44:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:44:24 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:44:25 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:44:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:44:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-dd434b0c-593a-47ad-9109-0f8b5f545b6c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:44:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-dd434b0c-593a-47ad-9109-0f8b5f545b6c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:44:26 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:44:26 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Updating instance_info_cache with network_info: [{"id": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "address": "fa:16:3e:93:8d:60", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc879593e-46", "ovs_interfaceid": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:44:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-dd434b0c-593a-47ad-9109-0f8b5f545b6c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:44:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:44:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:44:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 18:44:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:44:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:44:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 7540540c-af3e-4992-8756-3497a3bd4bf6 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid d949d403-0a45-48bc-b64a-f63b114d1944 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid dd434b0c-593a-47ad-9109-0f8b5f545b6c {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 3fd9a073-962e-44de-9252-2d5e339093bc {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid d17071fc-5d5b-4e06-8a47-05174014167c {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 30beb8e4-0363-41e0-8089-04bef2539f4d {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid a31844da-6f7e-4711-bccc-e31d2114d66d {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid b88e6df6-16de-4a8d-951a-76dcca2c7e84 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "d949d403-0a45-48bc-b64a-f63b114d1944" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "d949d403-0a45-48bc-b64a-f63b114d1944" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "3fd9a073-962e-44de-9252-2d5e339093bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "3fd9a073-962e-44de-9252-2d5e339093bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "d17071fc-5d5b-4e06-8a47-05174014167c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "30beb8e4-0363-41e0-8089-04bef2539f4d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "d949d403-0a45-48bc-b64a-f63b114d1944" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "3fd9a073-962e-44de-9252-2d5e339093bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "d17071fc-5d5b-4e06-8a47-05174014167c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "102ba990-07fc-47ba-9abb-781423525369" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "102ba990-07fc-47ba-9abb-781423525369" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:44:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:45 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:44:45 user nova-compute[74692]: INFO nova.compute.claims [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Claim successful on node user
Nov 18 18:44:46 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:44:46 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:44:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:46 user nova-compute[74692]: DEBUG nova.compute.manager [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:44:46 user nova-compute[74692]: DEBUG nova.compute.manager [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:44:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:44:46 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:44:46 user nova-compute[74692]: DEBUG nova.compute.manager [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:44:46 user nova-compute[74692]: INFO nova.virt.block_device [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Booting with volume-backed-image 503b14b1-1e1e-41a7-a748-0e4d907ae048 at /dev/vda
Nov 18 18:44:46 user nova-compute[74692]: DEBUG nova.policy [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1233b31e12dc4d5796a60327d93c3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704ef46081d04fc7a0ed88456cbe9fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG nova.network.neutron [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Successfully created port: 8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:44:47 user nova-compute[74692]: INFO nova.compute.manager [None req-d518f4e9-176e-4fe5-95e8-51dbbb50b117 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Unrescuing
Nov 18 18:44:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d518f4e9-176e-4fe5-95e8-51dbbb50b117 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d518f4e9-176e-4fe5-95e8-51dbbb50b117 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquired lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG nova.network.neutron [None req-d518f4e9-176e-4fe5-95e8-51dbbb50b117 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG nova.network.neutron [None req-d518f4e9-176e-4fe5-95e8-51dbbb50b117 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Updating instance_info_cache with network_info: [{"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d518f4e9-176e-4fe5-95e8-51dbbb50b117 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Releasing lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG nova.objects.instance [None req-d518f4e9-176e-4fe5-95e8-51dbbb50b117 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'flavor' on Instance uuid 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG nova.network.neutron [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Successfully updated port: 8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "refresh_cache-102ba990-07fc-47ba-9abb-781423525369" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquired lock "refresh_cache-102ba990-07fc-47ba-9abb-781423525369" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG nova.network.neutron [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG nova.compute.manager [req-efd77c87-2f9e-415c-806a-f4bbd999ccde req-b2cc617f-c833-40e4-9cc2-7bd177045caf service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received event network-changed-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG nova.compute.manager [req-efd77c87-2f9e-415c-806a-f4bbd999ccde req-b2cc617f-c833-40e4-9cc2-7bd177045caf service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Refreshing instance network info cache due to event network-changed-8ef69d29-6445-4468-80c2-c9930ecb41e7. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-efd77c87-2f9e-415c-806a-f4bbd999ccde req-b2cc617f-c833-40e4-9cc2-7bd177045caf service nova] Acquiring lock "refresh_cache-102ba990-07fc-47ba-9abb-781423525369" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG nova.network.neutron [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:44:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-fae6a932-b8cb-44f5-ba59-1830b952364d req-0d306d97-5480-432c-b0fc-f8b556bd7bf6 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-unplugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:44:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fae6a932-b8cb-44f5-ba59-1830b952364d req-0d306d97-5480-432c-b0fc-f8b556bd7bf6 service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fae6a932-b8cb-44f5-ba59-1830b952364d req-0d306d97-5480-432c-b0fc-f8b556bd7bf6 service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fae6a932-b8cb-44f5-ba59-1830b952364d req-0d306d97-5480-432c-b0fc-f8b556bd7bf6 service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-fae6a932-b8cb-44f5-ba59-1830b952364d req-0d306d97-5480-432c-b0fc-f8b556bd7bf6 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-unplugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:44:48 user nova-compute[74692]: WARNING nova.compute.manager [req-fae6a932-b8cb-44f5-ba59-1830b952364d req-0d306d97-5480-432c-b0fc-f8b556bd7bf6 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received unexpected event network-vif-unplugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:44:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:48 user nova-compute[74692]: DEBUG nova.network.neutron [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Updating instance_info_cache with network_info: [{"id": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "address": "fa:16:3e:fe:c8:c4", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef69d29-64", "ovs_interfaceid": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:44:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Releasing lock "refresh_cache-102ba990-07fc-47ba-9abb-781423525369" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:44:48 user nova-compute[74692]: DEBUG nova.compute.manager [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Instance network_info: |[{"id": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "address": "fa:16:3e:fe:c8:c4", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef69d29-64", "ovs_interfaceid": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:44:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-efd77c87-2f9e-415c-806a-f4bbd999ccde req-b2cc617f-c833-40e4-9cc2-7bd177045caf service nova] Acquired lock "refresh_cache-102ba990-07fc-47ba-9abb-781423525369" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:44:48 user nova-compute[74692]: DEBUG nova.network.neutron [req-efd77c87-2f9e-415c-806a-f4bbd999ccde req-b2cc617f-c833-40e4-9cc2-7bd177045caf service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Refreshing network info cache for port 8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:44:48 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Instance destroyed successfully.
Nov 18 18:44:48 user nova-compute[74692]: DEBUG nova.network.neutron [req-efd77c87-2f9e-415c-806a-f4bbd999ccde req-b2cc617f-c833-40e4-9cc2-7bd177045caf service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Updated VIF entry in instance network info cache for port 8ef69d29-6445-4468-80c2-c9930ecb41e7. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:44:48 user nova-compute[74692]: DEBUG nova.network.neutron [req-efd77c87-2f9e-415c-806a-f4bbd999ccde req-b2cc617f-c833-40e4-9cc2-7bd177045caf service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Updating instance_info_cache with network_info: [{"id": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "address": "fa:16:3e:fe:c8:c4", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef69d29-64", "ovs_interfaceid": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:44:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-efd77c87-2f9e-415c-806a-f4bbd999ccde req-b2cc617f-c833-40e4-9cc2-7bd177045caf service nova] Releasing lock "refresh_cache-102ba990-07fc-47ba-9abb-781423525369" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:44:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:44:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:44:50 user nova-compute[74692]: WARNING nova.compute.manager [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received unexpected event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:44:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:44:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:44:50 user nova-compute[74692]: WARNING nova.compute.manager [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received unexpected event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:44:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:44:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:44:50 user nova-compute[74692]: WARNING nova.compute.manager [req-b5816340-44c6-4a0c-8501-54cf0e7043eb req-b8404b25-26b0-4192-8651-40a228e0c334 service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received unexpected event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:44:51 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d518f4e9-176e-4fe5-95e8-51dbbb50b117 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG os_brick.utils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f734ebb6-ced6-45aa-8b66-c88901e44add]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c4b87b-a3e8-4dcd-b7e4-d30aff8dd228]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5153ea-9832-4228-847c-5c2a119cd557]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bf0ef2-f914-4f3e-ad24-01bf1c55a85c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:44:52 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:44:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff30ffe5-e660-4308-afa8-6995452a28d8]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG os_brick.utils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Updating existing volume attachment record: 7e4c1508-7238-4376-99d8-cb04bf749988 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:44:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:56 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:44:56 user nova-compute[74692]: INFO nova.compute.claims [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Claim successful on node user
Nov 18 18:44:57 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:44:57 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:44:57 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG nova.policy [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd126349e69864417bb5e02666efd534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb006c6267b42fab703cfc24d93052e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:44:57 user nova-compute[74692]: INFO nova.virt.block_device [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Booting with volume 0ca057ef-6541-4082-aa0e-662f53f9a305 at /dev/vda
Nov 18 18:44:57 user nova-compute[74692]: DEBUG os_brick.utils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[326d36a1-73d0-4f1f-95d3-4fd82fe2c4fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec658510-08ef-4825-a0a3-1ceeb83f0eaf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2dd03c-2dfb-44dd-b5f0-f01592a4fcd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9087b5cd-e291-4e8a-972d-5f1dcafeba9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:44:57 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:44:57 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50128f4-8d9e-44f9-b6e4-58121fc04c72]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG os_brick.utils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:44:57 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Updating existing volume attachment record: 370ebd17-5f70-43d4-b13d-7a11e07d6c96 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Successfully created port: 279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:44:58 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Creating image(s)
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Ensure instance console log exists: /opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Start _get_guest_xml network_info=[{"id": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "address": "fa:16:3e:fe:c8:c4", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef69d29-64", "ovs_interfaceid": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwTNRpma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '102ba990-07fc-47ba-9abb-781423525369', 'attached_at': '', 'detached_at': '', 'volume_id': '0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0', 'serial': '0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0'}, 'attachment_id': '7e4c1508-7238-4376-99d8-cb04bf749988', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:44:58 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:44:58 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwTNRpma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:44:58 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:44:58 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:44:58 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0c244d-9c60-48be-af3f-1d0c9be15555]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:44:58 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[279db4a8-e115-49b5-9a5f-5295c2b33727]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0] added
Nov 18 18:44:58 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66f325c-4941-4c8c-bb6d-62341352b554]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5033578-9613-427a-acc8-511673a44dc9]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KwTNRpma {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KwTNRpma" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e94cf4-834f-4dd3-ac2e-fca64766731b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KwTNRpma'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[788310c3-b3e2-4182-93bb-79048616e062]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b68d5d-ef90-49aa-93a9-9fc2dd857595]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:44:58 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:44:58 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:44:58 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:44:58 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[293a5008-c2a8-4878-95ba-17de0d979bf3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0, portal: 172.16.0.220,3260]
Nov 18 18:44:58 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0, portal: 172.16.0.220,3260] successful.
Nov 18 18:44:58 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4925fe-7121-4767-aa3f-8fbf75bd7c19]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d200659-147e-4a22-9fa4-64f9f449fe4f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:44:58 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:44:58 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:44:58 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:44:58 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:44:58 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:44:58 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[de766018-82a7-429a-9f8a-c014524e517c]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwTNRpma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Successfully updated port: 279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquired lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.compute.manager [req-b8aed2ab-e245-4a02-abaa-5285918263c9 req-d9c354a6-83b7-45fa-93d2-32d5bbb108ef service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received event network-changed-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG nova.compute.manager [req-b8aed2ab-e245-4a02-abaa-5285918263c9 req-d9c354a6-83b7-45fa-93d2-32d5bbb108ef service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Refreshing instance network info cache due to event network-changed-279d81c2-cb3c-4e20-9daf-e418dbb20a2a. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:44:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b8aed2ab-e245-4a02-abaa-5285918263c9 req-d9c354a6-83b7-45fa-93d2-32d5bbb108ef service nova] Acquiring lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Updating instance_info_cache with network_info: [{"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Releasing lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Instance network_info: |[{"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b8aed2ab-e245-4a02-abaa-5285918263c9 req-d9c354a6-83b7-45fa-93d2-32d5bbb108ef service nova] Acquired lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.network.neutron [req-b8aed2ab-e245-4a02-abaa-5285918263c9 req-d9c354a6-83b7-45fa-93d2-32d5bbb108ef service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Refreshing network info cache for port 279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23063393338343364', 'path': '/dev/sdd'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063393338343364', 'path': '/dev/sdd'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1437746351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1437746351',id=33,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='704ef46081d04fc7a0ed88456cbe9fe8',ramdisk_id='',reservation_id='r-pkh5jk7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-199647198',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:44:46Z,user_data=None,user_id='1233b31e12dc4d5796a60327d93c3bfb',uuid=102ba990-07fc-47ba-9abb-781423525369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "address": "fa:16:3e:fe:c8:c4", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef69d29-64", "ovs_interfaceid": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converting VIF {"id": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "address": "fa:16:3e:fe:c8:c4", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef69d29-64", "ovs_interfaceid": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:c8:c4,bridge_name='br-int',has_traffic_filtering=True,id=8ef69d29-6445-4468-80c2-c9930ecb41e7,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef69d29-64') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.objects.instance [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'pci_devices' on Instance uuid 102ba990-07fc-47ba-9abb-781423525369 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:44:59 user nova-compute[74692]:   <uuid>102ba990-07fc-47ba-9abb-781423525369</uuid>
Nov 18 18:44:59 user nova-compute[74692]:   <name>instance-00000021</name>
Nov 18 18:44:59 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:44:59 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:44:59 user nova-compute[74692]:   <metadata>
Nov 18 18:44:59 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:44:59 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:44:59 user nova-compute[74692]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1437746351</nova:name>
Nov 18 18:44:59 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:44:58</nova:creationTime>
Nov 18 18:44:59 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:44:59 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:44:59 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:44:59 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:44:59 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:44:59 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:44:59 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:44:59 user nova-compute[74692]:       <nova:owner>
Nov 18 18:44:59 user nova-compute[74692]:         <nova:user uuid="1233b31e12dc4d5796a60327d93c3bfb">tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member</nova:user>
Nov 18 18:44:59 user nova-compute[74692]:         <nova:project uuid="704ef46081d04fc7a0ed88456cbe9fe8">tempest-ServerBootFromVolumeStableRescueTest-199647198</nova:project>
Nov 18 18:44:59 user nova-compute[74692]:       </nova:owner>
Nov 18 18:44:59 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:44:59 user nova-compute[74692]:       <nova:ports>
Nov 18 18:44:59 user nova-compute[74692]:         <nova:port uuid="8ef69d29-6445-4468-80c2-c9930ecb41e7">
Nov 18 18:44:59 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 18:44:59 user nova-compute[74692]:         </nova:port>
Nov 18 18:44:59 user nova-compute[74692]:       </nova:ports>
Nov 18 18:44:59 user nova-compute[74692]:     </nova:instance>
Nov 18 18:44:59 user nova-compute[74692]:   </metadata>
Nov 18 18:44:59 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:44:59 user nova-compute[74692]:     <system>
Nov 18 18:44:59 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:44:59 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:44:59 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:44:59 user nova-compute[74692]:       <entry name="serial">102ba990-07fc-47ba-9abb-781423525369</entry>
Nov 18 18:44:59 user nova-compute[74692]:       <entry name="uuid">102ba990-07fc-47ba-9abb-781423525369</entry>
Nov 18 18:44:59 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:44:59 user nova-compute[74692]:     </system>
Nov 18 18:44:59 user nova-compute[74692]:   </sysinfo>
Nov 18 18:44:59 user nova-compute[74692]:   <os>
Nov 18 18:44:59 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:44:59 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:44:59 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:44:59 user nova-compute[74692]:   </os>
Nov 18 18:44:59 user nova-compute[74692]:   <features>
Nov 18 18:44:59 user nova-compute[74692]:     <acpi/>
Nov 18 18:44:59 user nova-compute[74692]:     <apic/>
Nov 18 18:44:59 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:44:59 user nova-compute[74692]:   </features>
Nov 18 18:44:59 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:44:59 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:44:59 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:44:59 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:44:59 user nova-compute[74692]:   </clock>
Nov 18 18:44:59 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:44:59 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:44:59 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:44:59 user nova-compute[74692]:   </cpu>
Nov 18 18:44:59 user nova-compute[74692]:   <devices>
Nov 18 18:44:59 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:44:59 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:44:59 user nova-compute[74692]:       <source dev="/dev/sdd"/>
Nov 18 18:44:59 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:44:59 user nova-compute[74692]:       <serial>0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0</serial>
Nov 18 18:44:59 user nova-compute[74692]:     </disk>
Nov 18 18:44:59 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:44:59 user nova-compute[74692]:       <mac address="fa:16:3e:fe:c8:c4"/>
Nov 18 18:44:59 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:44:59 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:44:59 user nova-compute[74692]:       <target dev="tap8ef69d29-64"/>
Nov 18 18:44:59 user nova-compute[74692]:     </interface>
Nov 18 18:44:59 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:44:59 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/console.log" append="off"/>
Nov 18 18:44:59 user nova-compute[74692]:     </serial>
Nov 18 18:44:59 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:44:59 user nova-compute[74692]:     <video>
Nov 18 18:44:59 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:44:59 user nova-compute[74692]:     </video>
Nov 18 18:44:59 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:44:59 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:44:59 user nova-compute[74692]:     </rng>
Nov 18 18:44:59 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:44:59 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:44:59 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:44:59 user nova-compute[74692]:     </memballoon>
Nov 18 18:44:59 user nova-compute[74692]:   </devices>
Nov 18 18:44:59 user nova-compute[74692]: </domain>
Nov 18 18:44:59 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1437746351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1437746351',id=33,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='704ef46081d04fc7a0ed88456cbe9fe8',ramdisk_id='',reservation_id='r-pkh5jk7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-199647198',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:44:46Z,user_data=None,user_id='1233b31e12dc4d5796a60327d93c3bfb',uuid=102ba990-07fc-47ba-9abb-781423525369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "address": "fa:16:3e:fe:c8:c4", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef69d29-64", "ovs_interfaceid": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converting VIF {"id": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "address": "fa:16:3e:fe:c8:c4", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef69d29-64", "ovs_interfaceid": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:c8:c4,bridge_name='br-int',has_traffic_filtering=True,id=8ef69d29-6445-4468-80c2-c9930ecb41e7,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef69d29-64') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG os_vif [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:c8:c4,bridge_name='br-int',has_traffic_filtering=True,id=8ef69d29-6445-4468-80c2-c9930ecb41e7,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef69d29-64') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cf70a39-48a5-5339-8487-5e02fc39365c', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ef69d29-64, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ef69d29-64, col_values=(('qos', UUID('ec116099-2ecc-4a94-96a4-3571d3c1dbeb')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ef69d29-64, col_values=(('external_ids', {'iface-id': '8ef69d29-6445-4468-80c2-c9930ecb41e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:c8:c4', 'vm-uuid': '102ba990-07fc-47ba-9abb-781423525369'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:44:59 user nova-compute[74692]: INFO os_vif [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:c8:c4,bridge_name='br-int',has_traffic_filtering=True,id=8ef69d29-6445-4468-80c2-c9930ecb41e7,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef69d29-64')
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] No VIF found with MAC fa:16:3e:fe:c8:c4, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.network.neutron [req-b8aed2ab-e245-4a02-abaa-5285918263c9 req-d9c354a6-83b7-45fa-93d2-32d5bbb108ef service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Updated VIF entry in instance network info cache for port 279d81c2-cb3c-4e20-9daf-e418dbb20a2a. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG nova.network.neutron [req-b8aed2ab-e245-4a02-abaa-5285918263c9 req-d9c354a6-83b7-45fa-93d2-32d5bbb108ef service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Updating instance_info_cache with network_info: [{"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:44:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b8aed2ab-e245-4a02-abaa-5285918263c9 req-d9c354a6-83b7-45fa-93d2-32d5bbb108ef service nova] Releasing lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:45:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-248c7786-1181-42c9-8e5d-8b9b9b55cf16 req-8ff23b29-4344-4fca-b5ab-8f6b0ddec92c service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:45:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-248c7786-1181-42c9-8e5d-8b9b9b55cf16 req-8ff23b29-4344-4fca-b5ab-8f6b0ddec92c service nova] Acquiring lock "102ba990-07fc-47ba-9abb-781423525369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-248c7786-1181-42c9-8e5d-8b9b9b55cf16 req-8ff23b29-4344-4fca-b5ab-8f6b0ddec92c service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-248c7786-1181-42c9-8e5d-8b9b9b55cf16 req-8ff23b29-4344-4fca-b5ab-8f6b0ddec92c service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-248c7786-1181-42c9-8e5d-8b9b9b55cf16 req-8ff23b29-4344-4fca-b5ab-8f6b0ddec92c service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] No waiting events found dispatching network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:45:01 user nova-compute[74692]: WARNING nova.compute.manager [req-248c7786-1181-42c9-8e5d-8b9b9b55cf16 req-8ff23b29-4344-4fca-b5ab-8f6b0ddec92c service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received unexpected event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 for instance with vm_state building and task_state spawning.
Nov 18 18:45:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:45:03 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 102ba990-07fc-47ba-9abb-781423525369] Instance spawned successfully.
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:45:03 user nova-compute[74692]: INFO nova.compute.manager [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-14dd827a-972a-4b15-8850-c5b09cac39d8 req-2429efe3-c910-4e97-ba75-b8a1b2844405 service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-14dd827a-972a-4b15-8850-c5b09cac39d8 req-2429efe3-c910-4e97-ba75-b8a1b2844405 service nova] Acquiring lock "102ba990-07fc-47ba-9abb-781423525369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-14dd827a-972a-4b15-8850-c5b09cac39d8 req-2429efe3-c910-4e97-ba75-b8a1b2844405 service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-14dd827a-972a-4b15-8850-c5b09cac39d8 req-2429efe3-c910-4e97-ba75-b8a1b2844405 service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-14dd827a-972a-4b15-8850-c5b09cac39d8 req-2429efe3-c910-4e97-ba75-b8a1b2844405 service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] No waiting events found dispatching network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:45:03 user nova-compute[74692]: WARNING nova.compute.manager [req-14dd827a-972a-4b15-8850-c5b09cac39d8 req-2429efe3-c910-4e97-ba75-b8a1b2844405 service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received unexpected event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 for instance with vm_state building and task_state spawning.
Nov 18 18:45:03 user nova-compute[74692]: INFO nova.compute.manager [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Took 17.64 seconds to build instance.
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-043b7541-a014-4858-b399-050d6f07e143 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "102ba990-07fc-47ba-9abb-781423525369" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.738s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:45:03 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Creating image(s)
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Ensure instance console log exists: /opt/stack/data/nova/instances/7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Start _get_guest_xml network_info=[{"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIgfzFya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d', 'attached_at': '', 'detached_at': '', 'volume_id': '0ca057ef-6541-4082-aa0e-662f53f9a305', 'serial': '0ca057ef-6541-4082-aa0e-662f53f9a305'}, 'attachment_id': '370ebd17-5f70-43d4-b13d-7a11e07d6c96', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:45:03 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:45:03 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIgfzFya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:45:03 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:45:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:45:03 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:45:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:45:03 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ede3b7-be6c-443d-a121-59b5fdf6e022]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:45:03 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[687f6fbb-ce6f-4f6f-87b0-ec3bd3643e66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305] added
Nov 18 18:45:03 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff822a2-2c50-41c7-baa6-f1975e8279b4]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eaec3f-9fb3-4f51-8f11-f1781494bd3b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIgfzFya {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIgfzFya" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4449a6b-c4e9-4fc7-9f24-222f95be9c4b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rIgfzFya'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[582dd64a-7b66-4837-9cb4-0b9bf492222b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f69527d-f19a-4bc0-b94f-5671b6cde4c1]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:45:03 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:45:03 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:45:03 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:45:03 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:45:03 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:45:03 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:45:03 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a883c7-78c5-48d2-b5e8-77a7d7d8221b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260]
Nov 18 18:45:04 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260] successful.
Nov 18 18:45:04 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7195061c-a463-4c61-85b0-099010df49be]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[515f7fde-9675-445e-941d-39c255dfbf88]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:45:04 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:45:04 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:45:04 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:45:04 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:45:04 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:45:04 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:45:04 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:45:04 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b90ae5-cb4e-471f-9b1d-ce0edb53cc88]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIgfzFya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:45:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26663633466306166', 'path': '/dev/sde'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663633466306166', 'path': '/dev/sde'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-706612544',display_name='tempest-ServerActionsTestOtherA-server-706612544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-706612544',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaznf7JGrfMrJRV86vaxqKuCfM3AcEaoWdApdT43PQu2+VRfP7TdWdgnZDzhSHo94Y2Q6y7Dc8YLTCn+JC1yHxyJqY3YZNW3EenEWfmQ3/zXDAHD9n+p1yEmT0Bxd5Ldw==',key_name='tempest-keypair-1438330061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb006c6267b42fab703cfc24d93052e',ramdisk_id='',reservation_id='r-0k8ny0uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2047740053',owner_user_name='tempest-ServerActionsTestOtherA-2047740053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d126349e69864417bb5e02666efd534c',uuid=7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converting VIF {"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=279d81c2-cb3c-4e20-9daf-e418dbb20a2a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap279d81c2-cb') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG nova.objects.instance [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:45:05 user nova-compute[74692]:   <uuid>7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d</uuid>
Nov 18 18:45:05 user nova-compute[74692]:   <name>instance-00000022</name>
Nov 18 18:45:05 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:45:05 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:45:05 user nova-compute[74692]:   <metadata>
Nov 18 18:45:05 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:45:05 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:45:05 user nova-compute[74692]:       <nova:name>tempest-ServerActionsTestOtherA-server-706612544</nova:name>
Nov 18 18:45:05 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:45:03</nova:creationTime>
Nov 18 18:45:05 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:45:05 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:45:05 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:45:05 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:45:05 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:45:05 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:45:05 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:45:05 user nova-compute[74692]:       <nova:owner>
Nov 18 18:45:05 user nova-compute[74692]:         <nova:user uuid="d126349e69864417bb5e02666efd534c">tempest-ServerActionsTestOtherA-2047740053-project-member</nova:user>
Nov 18 18:45:05 user nova-compute[74692]:         <nova:project uuid="fdb006c6267b42fab703cfc24d93052e">tempest-ServerActionsTestOtherA-2047740053</nova:project>
Nov 18 18:45:05 user nova-compute[74692]:       </nova:owner>
Nov 18 18:45:05 user nova-compute[74692]:       <nova:ports>
Nov 18 18:45:05 user nova-compute[74692]:         <nova:port uuid="279d81c2-cb3c-4e20-9daf-e418dbb20a2a">
Nov 18 18:45:05 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 18:45:05 user nova-compute[74692]:         </nova:port>
Nov 18 18:45:05 user nova-compute[74692]:       </nova:ports>
Nov 18 18:45:05 user nova-compute[74692]:     </nova:instance>
Nov 18 18:45:05 user nova-compute[74692]:   </metadata>
Nov 18 18:45:05 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:45:05 user nova-compute[74692]:     <system>
Nov 18 18:45:05 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:45:05 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:45:05 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:45:05 user nova-compute[74692]:       <entry name="serial">7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d</entry>
Nov 18 18:45:05 user nova-compute[74692]:       <entry name="uuid">7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d</entry>
Nov 18 18:45:05 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:45:05 user nova-compute[74692]:     </system>
Nov 18 18:45:05 user nova-compute[74692]:   </sysinfo>
Nov 18 18:45:05 user nova-compute[74692]:   <os>
Nov 18 18:45:05 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:45:05 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:45:05 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:45:05 user nova-compute[74692]:   </os>
Nov 18 18:45:05 user nova-compute[74692]:   <features>
Nov 18 18:45:05 user nova-compute[74692]:     <acpi/>
Nov 18 18:45:05 user nova-compute[74692]:     <apic/>
Nov 18 18:45:05 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:45:05 user nova-compute[74692]:   </features>
Nov 18 18:45:05 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:45:05 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:45:05 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:45:05 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:45:05 user nova-compute[74692]:   </clock>
Nov 18 18:45:05 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:45:05 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:45:05 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:45:05 user nova-compute[74692]:   </cpu>
Nov 18 18:45:05 user nova-compute[74692]:   <devices>
Nov 18 18:45:05 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:45:05 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:45:05 user nova-compute[74692]:       <source dev="/dev/sde"/>
Nov 18 18:45:05 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:45:05 user nova-compute[74692]:       <serial>0ca057ef-6541-4082-aa0e-662f53f9a305</serial>
Nov 18 18:45:05 user nova-compute[74692]:     </disk>
Nov 18 18:45:05 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:45:05 user nova-compute[74692]:       <mac address="fa:16:3e:7c:a6:af"/>
Nov 18 18:45:05 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:45:05 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:45:05 user nova-compute[74692]:       <target dev="tap279d81c2-cb"/>
Nov 18 18:45:05 user nova-compute[74692]:     </interface>
Nov 18 18:45:05 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:45:05 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d/console.log" append="off"/>
Nov 18 18:45:05 user nova-compute[74692]:     </serial>
Nov 18 18:45:05 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:45:05 user nova-compute[74692]:     <video>
Nov 18 18:45:05 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:45:05 user nova-compute[74692]:     </video>
Nov 18 18:45:05 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:45:05 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:45:05 user nova-compute[74692]:     </rng>
Nov 18 18:45:05 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:45:05 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:45:05 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:45:05 user nova-compute[74692]:     </memballoon>
Nov 18 18:45:05 user nova-compute[74692]:   </devices>
Nov 18 18:45:05 user nova-compute[74692]: </domain>
Nov 18 18:45:05 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-706612544',display_name='tempest-ServerActionsTestOtherA-server-706612544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-706612544',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaznf7JGrfMrJRV86vaxqKuCfM3AcEaoWdApdT43PQu2+VRfP7TdWdgnZDzhSHo94Y2Q6y7Dc8YLTCn+JC1yHxyJqY3YZNW3EenEWfmQ3/zXDAHD9n+p1yEmT0Bxd5Ldw==',key_name='tempest-keypair-1438330061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb006c6267b42fab703cfc24d93052e',ramdisk_id='',reservation_id='r-0k8ny0uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2047740053',owner_user_name='tempest-ServerActionsTestOtherA-2047740053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d126349e69864417bb5e02666efd534c',uuid=7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converting VIF {"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=279d81c2-cb3c-4e20-9daf-e418dbb20a2a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap279d81c2-cb') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG os_vif [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=279d81c2-cb3c-4e20-9daf-e418dbb20a2a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap279d81c2-cb') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25555126-35c9-55d0-aa6e-d45905870950', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap279d81c2-cb, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap279d81c2-cb, col_values=(('qos', UUID('cc3d5981-2460-405b-8fa7-752a73e9b9ad')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap279d81c2-cb, col_values=(('external_ids', {'iface-id': '279d81c2-cb3c-4e20-9daf-e418dbb20a2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:a6:af', 'vm-uuid': '7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:05 user nova-compute[74692]: INFO os_vif [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=279d81c2-cb3c-4e20-9daf-e418dbb20a2a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap279d81c2-cb')
Nov 18 18:45:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:45:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] No VIF found with MAC fa:16:3e:7c:a6:af, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:45:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-e69a4495-3f8f-4f1a-9604-79956c24a223 req-e9800ac5-612f-4ecb-bdea-c9a90a45c389 service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received event network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:45:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e69a4495-3f8f-4f1a-9604-79956c24a223 req-e9800ac5-612f-4ecb-bdea-c9a90a45c389 service nova] Acquiring lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e69a4495-3f8f-4f1a-9604-79956c24a223 req-e9800ac5-612f-4ecb-bdea-c9a90a45c389 service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e69a4495-3f8f-4f1a-9604-79956c24a223 req-e9800ac5-612f-4ecb-bdea-c9a90a45c389 service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-e69a4495-3f8f-4f1a-9604-79956c24a223 req-e9800ac5-612f-4ecb-bdea-c9a90a45c389 service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] No waiting events found dispatching network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:45:06 user nova-compute[74692]: WARNING nova.compute.manager [req-e69a4495-3f8f-4f1a-9604-79956c24a223 req-e9800ac5-612f-4ecb-bdea-c9a90a45c389 service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received unexpected event network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a for instance with vm_state building and task_state spawning.
Nov 18 18:45:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:08 user nova-compute[74692]: DEBUG nova.compute.manager [req-dce735ce-7988-46be-b077-e1a6bb59c863 req-013c2a9c-f114-4b60-9567-c9577058e32e service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received event network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:45:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-dce735ce-7988-46be-b077-e1a6bb59c863 req-013c2a9c-f114-4b60-9567-c9577058e32e service nova] Acquiring lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-dce735ce-7988-46be-b077-e1a6bb59c863 req-013c2a9c-f114-4b60-9567-c9577058e32e service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-dce735ce-7988-46be-b077-e1a6bb59c863 req-013c2a9c-f114-4b60-9567-c9577058e32e service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:08 user nova-compute[74692]: DEBUG nova.compute.manager [req-dce735ce-7988-46be-b077-e1a6bb59c863 req-013c2a9c-f114-4b60-9567-c9577058e32e service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] No waiting events found dispatching network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:45:08 user nova-compute[74692]: WARNING nova.compute.manager [req-dce735ce-7988-46be-b077-e1a6bb59c863 req-013c2a9c-f114-4b60-9567-c9577058e32e service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received unexpected event network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a for instance with vm_state building and task_state spawning.
Nov 18 18:45:08 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:45:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:45:08 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Instance spawned successfully.
Nov 18 18:45:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:45:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:45:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:45:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:45:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:45:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:45:08 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:45:08 user nova-compute[74692]: INFO nova.compute.manager [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 18 18:45:08 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:45:08 user nova-compute[74692]: INFO nova.compute.manager [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Took 12.06 seconds to build instance.
Nov 18 18:45:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5e6d60bd-cf22-4c5d-b756-3c8cf14fbb80 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.163s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:17 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:45:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:17 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:45:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:18 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:45:18 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:45:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:45:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:45:22 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:45:22 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7632MB free_disk=24.889240264892578GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 30beb8e4-0363-41e0-8089-04bef2539f4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance a31844da-6f7e-4711-bccc-e31d2114d66d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance b88e6df6-16de-4a8d-951a-76dcca2c7e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 102ba990-07fc-47ba-9abb-781423525369 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing inventories for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating ProviderTree inventory for provider 582be55c-ee9f-496e-b354-5900b8401d2c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating inventory in ProviderTree for provider 582be55c-ee9f-496e-b354-5900b8401d2c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing aggregate associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, aggregates: None {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing trait associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:45:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:45:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:45:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:45:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:45:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:45:24 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:45:24 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:45:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:26 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:45:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:27 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:45:27 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:45:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:45:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:45:28 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:45:28 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Updating instance_info_cache with network_info: [{"id": "42c3c7e8-f568-4a60-9613-152317e0543a", "address": "fa:16:3e:13:1b:f6", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42c3c7e8-f5", "ovs_interfaceid": "42c3c7e8-f568-4a60-9613-152317e0543a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:45:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:45:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:45:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-42483452-d2be-4a51-aa46-8733fd1c235a req-bea9c0aa-493b-461b-9bdb-d1bc26ad4f72 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received event network-changed-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:45:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-42483452-d2be-4a51-aa46-8733fd1c235a req-bea9c0aa-493b-461b-9bdb-d1bc26ad4f72 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Refreshing instance network info cache due to event network-changed-1a2ac737-2d49-427d-83d6-5b1c096a21ec. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:45:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-42483452-d2be-4a51-aa46-8733fd1c235a req-bea9c0aa-493b-461b-9bdb-d1bc26ad4f72 service nova] Acquiring lock "refresh_cache-a31844da-6f7e-4711-bccc-e31d2114d66d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:45:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-42483452-d2be-4a51-aa46-8733fd1c235a req-bea9c0aa-493b-461b-9bdb-d1bc26ad4f72 service nova] Acquired lock "refresh_cache-a31844da-6f7e-4711-bccc-e31d2114d66d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:45:36 user nova-compute[74692]: DEBUG nova.network.neutron [req-42483452-d2be-4a51-aa46-8733fd1c235a req-bea9c0aa-493b-461b-9bdb-d1bc26ad4f72 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Refreshing network info cache for port 1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:45:37 user nova-compute[74692]: DEBUG nova.network.neutron [req-42483452-d2be-4a51-aa46-8733fd1c235a req-bea9c0aa-493b-461b-9bdb-d1bc26ad4f72 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Updated VIF entry in instance network info cache for port 1a2ac737-2d49-427d-83d6-5b1c096a21ec. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:45:37 user nova-compute[74692]: DEBUG nova.network.neutron [req-42483452-d2be-4a51-aa46-8733fd1c235a req-bea9c0aa-493b-461b-9bdb-d1bc26ad4f72 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Updating instance_info_cache with network_info: [{"id": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "address": "fa:16:3e:95:47:96", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2ac737-2d", "ovs_interfaceid": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:45:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-42483452-d2be-4a51-aa46-8733fd1c235a req-bea9c0aa-493b-461b-9bdb-d1bc26ad4f72 service nova] Releasing lock "refresh_cache-a31844da-6f7e-4711-bccc-e31d2114d66d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:45:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Acquiring lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Acquiring lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:39 user nova-compute[74692]: INFO nova.compute.manager [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Terminating instance
Nov 18 18:45:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG nova.objects.instance [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'flavor' on Instance uuid a31844da-6f7e-4711-bccc-e31d2114d66d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-d1a08403-4256-4aea-919a-3f7bd8ce22df req-141cf7ba-6103-42f9-8e4f-7e239f760a6d service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Received event network-vif-unplugged-b10e42bc-ee1e-414b-894a-ad275821444f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d1a08403-4256-4aea-919a-3f7bd8ce22df req-141cf7ba-6103-42f9-8e4f-7e239f760a6d service nova] Acquiring lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d1a08403-4256-4aea-919a-3f7bd8ce22df req-141cf7ba-6103-42f9-8e4f-7e239f760a6d service nova] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d1a08403-4256-4aea-919a-3f7bd8ce22df req-141cf7ba-6103-42f9-8e4f-7e239f760a6d service nova] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-d1a08403-4256-4aea-919a-3f7bd8ce22df req-141cf7ba-6103-42f9-8e4f-7e239f760a6d service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] No waiting events found dispatching network-vif-unplugged-b10e42bc-ee1e-414b-894a-ad275821444f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-d1a08403-4256-4aea-919a-3f7bd8ce22df req-141cf7ba-6103-42f9-8e4f-7e239f760a6d service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Received event network-vif-unplugged-b10e42bc-ee1e-414b-894a-ad275821444f for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:39 user nova-compute[74692]: INFO nova.compute.manager [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Attaching volume d1f603f1-4ab4-4a32-b0f5-164e48be72cc to /dev/vdb
Nov 18 18:45:39 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Instance destroyed successfully.
Nov 18 18:45:39 user nova-compute[74692]: DEBUG nova.objects.instance [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lazy-loading 'resources' on Instance uuid b88e6df6-16de-4a8d-951a-76dcca2c7e84 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG os_brick.utils [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-337309612',display_name='tempest-VolumesNegativeTest-instance-337309612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-337309612',id=32,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:43:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2cab7e23fd8427892cde275a623f367',ramdisk_id='',reservation_id='r-4kpr6ghu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-484470383',owner_user_name='tempest-VolumesNegativeTest-484470383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:43:56Z,user_data=None,user_id='2a51eb0f7eeb4412a633bd08156a4c80',uuid=b88e6df6-16de-4a8d-951a-76dcca2c7e84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b10e42bc-ee1e-414b-894a-ad275821444f", "address": "fa:16:3e:3d:7f:08", "network": {"id": "706636f3-6117-4bb2-ad7b-e5c73e8d0e8f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4acc30afb1f4558a41fd76dac906b70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10e42bc-ee", "ovs_interfaceid": "b10e42bc-ee1e-414b-894a-ad275821444f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Converting VIF {"id": "b10e42bc-ee1e-414b-894a-ad275821444f", "address": "fa:16:3e:3d:7f:08", "network": {"id": "706636f3-6117-4bb2-ad7b-e5c73e8d0e8f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4acc30afb1f4558a41fd76dac906b70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10e42bc-ee", "ovs_interfaceid": "b10e42bc-ee1e-414b-894a-ad275821444f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:7f:08,bridge_name='br-int',has_traffic_filtering=True,id=b10e42bc-ee1e-414b-894a-ad275821444f,network=Network(706636f3-6117-4bb2-ad7b-e5c73e8d0e8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10e42bc-ee') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG os_vif [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:7f:08,bridge_name='br-int',has_traffic_filtering=True,id=b10e42bc-ee1e-414b-894a-ad275821444f,network=Network(706636f3-6117-4bb2-ad7b-e5c73e8d0e8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10e42bc-ee') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb10e42bc-ee, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a747f9d-adb3-4637-ac93-72eb348c2150]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6f91e7c-6a03-4d40-a6f7-56381127a9fe) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:39 user nova-compute[74692]: INFO os_vif [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:7f:08,bridge_name='br-int',has_traffic_filtering=True,id=b10e42bc-ee1e-414b-894a-ad275821444f,network=Network(706636f3-6117-4bb2-ad7b-e5c73e8d0e8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10e42bc-ee')
Nov 18 18:45:39 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Deleting instance files /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84_del
Nov 18 18:45:39 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Deletion of /opt/stack/data/nova/instances/b88e6df6-16de-4a8d-951a-76dcca2c7e84_del complete
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7b94dd-d849-448b-bd99-16475ecb1d7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ac902b-db51-4028-b321-12657753ad50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c21de3-0309-4f61-b76b-13580d53534e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:45:39 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8574f43-f4a7-4e76-8fff-fe15f7b2c544]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG os_brick.utils [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Updating existing volume attachment record: c50c38de-6f9c-4190-8333-dcd17528b710 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:45:39 user nova-compute[74692]: INFO nova.compute.manager [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 18 18:45:39 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:45:39 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:45:40 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:45:40 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Took 0.47 seconds to deallocate network for instance.
Nov 18 18:45:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:40 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:45:40 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:45:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:40 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Deleted allocations for instance b88e6df6-16de-4a8d-951a-76dcca2c7e84
Nov 18 18:45:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d50f6272-8ac8-457a-b809-17c94b3d8cc2 tempest-VolumesNegativeTest-484470383 tempest-VolumesNegativeTest-484470383-project-member] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.890s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-2dabe45d-f631-4f99-858f-bb9c120fa7e9 req-fc0c5fa5-dc34-4969-944c-cec5fbd040ea service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Received event network-vif-plugged-b10e42bc-ee1e-414b-894a-ad275821444f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:45:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2dabe45d-f631-4f99-858f-bb9c120fa7e9 req-fc0c5fa5-dc34-4969-944c-cec5fbd040ea service nova] Acquiring lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2dabe45d-f631-4f99-858f-bb9c120fa7e9 req-fc0c5fa5-dc34-4969-944c-cec5fbd040ea service nova] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2dabe45d-f631-4f99-858f-bb9c120fa7e9 req-fc0c5fa5-dc34-4969-944c-cec5fbd040ea service nova] Lock "b88e6df6-16de-4a8d-951a-76dcca2c7e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-2dabe45d-f631-4f99-858f-bb9c120fa7e9 req-fc0c5fa5-dc34-4969-944c-cec5fbd040ea service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] No waiting events found dispatching network-vif-plugged-b10e42bc-ee1e-414b-894a-ad275821444f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:45:41 user nova-compute[74692]: WARNING nova.compute.manager [req-2dabe45d-f631-4f99-858f-bb9c120fa7e9 req-fc0c5fa5-dc34-4969-944c-cec5fbd040ea service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Received unexpected event network-vif-plugged-b10e42bc-ee1e-414b-894a-ad275821444f for instance with vm_state deleted and task_state None.
Nov 18 18:45:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-2dabe45d-f631-4f99-858f-bb9c120fa7e9 req-fc0c5fa5-dc34-4969-944c-cec5fbd040ea service nova] [instance: b88e6df6-16de-4a8d-951a-76dcca2c7e84] Received event network-vif-deleted-b10e42bc-ee1e-414b-894a-ad275821444f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:45:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'erVxUcMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:45:45 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:45:45 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:45:45 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9c072f-9323-45b3-98f5-b9fbaa4dc4a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:45:45 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc6c4ac-4872-4fa6-b151-f0abdcf0a4ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc] added
Nov 18 18:45:45 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1347157d-4bf9-48cd-aa78-91559fe6b5e6]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b024cce8-7c25-4861-b7dd-a5bdd328ea18]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v erVxUcMT {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v erVxUcMT" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[026f86e0-2bf9-4c70-a0f1-ffde19f2d51d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'erVxUcMT'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d48729f-da27-4522-b106-6be9ae089418]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6726acf2-4488-4e0b-8827-58cc6d73765f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[92308d5b-f7f3-4b90-bfbf-7928aec7af41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc, portal: 172.16.0.220,3260]
Nov 18 18:45:45 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc, portal: 172.16.0.220,3260] successful.
Nov 18 18:45:45 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[92563f96-53dd-425b-97f9-a77ff36c48ff]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[005ef530-c32c-414d-80aa-a2dc651b994f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc (non-flash)
Nov 18 18:45:45 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:45:45 user nova-compute[74692]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc (non-flash)
Nov 18 18:45:45 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5899702-e4b3-4fe8-9f7b-c3509d7228f4]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:45:45 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'erVxUcMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:45:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:45:46 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23237333962353933', 'path': '/dev/sdf'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:45:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237333962353933', 'path': '/dev/sdf'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:45:46 user nova-compute[74692]: DEBUG nova.objects.instance [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'flavor' on Instance uuid a31844da-6f7e-4711-bccc-e31d2114d66d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:45:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:45:46 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:45:46 user nova-compute[74692]:   <source dev="/dev/sdf"/>
Nov 18 18:45:46 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:45:46 user nova-compute[74692]:   <serial>d1f603f1-4ab4-4a32-b0f5-164e48be72cc</serial>
Nov 18 18:45:46 user nova-compute[74692]: </disk>
Nov 18 18:45:46 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:45:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:45:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:45:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] No VIF found with MAC fa:16:3e:95:47:96, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:45:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6c534bcf-37ab-4b4d-a19b-41cec45ac4bb tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.612s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:50 user nova-compute[74692]: DEBUG nova.objects.instance [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'flavor' on Instance uuid a31844da-6f7e-4711-bccc-e31d2114d66d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:45:51 user nova-compute[74692]: INFO nova.compute.manager [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Attaching volume b9b3f7ed-f3cd-49e8-a41c-520479851dce to /dev/vdc
Nov 18 18:45:51 user nova-compute[74692]: DEBUG os_brick.utils [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3099a9-be2d-456b-90bc-11deed01c0c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf35b57a-7090-4a3f-bd7c-0693af60a28e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e731c804-7c3f-4237-8785-043197bbb51d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fccae6d-dc9d-4ecd-995f-52af4fce5e88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:45:51 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:45:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[895e8ffc-624d-4a76-8576-ea4652babae2]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG os_brick.utils [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:45:51 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Updating existing volume attachment record: 72a39373-11de-443d-8471-ce8591e66fd5 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:45:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IEGtdOHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:45:56 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:45:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:45:56 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:45:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:45:56 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[456b03cc-fddc-469f-8975-c792e2c34e28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:45:56 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dda381e-99de-4436-ac25-1902f793085b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce] added
Nov 18 18:45:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab0d1df-d7a9-4b85-824f-14609d5ada07]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[956fb16c-5a7d-4a97-8d82-fb53db4bb1cc]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IEGtdOHr {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IEGtdOHr" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d9864b-7b12-49ef-ac6f-b2df9184187f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IEGtdOHr'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c32045-11fb-4382-8521-039207164f24]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3637f40b-da85-48a1-92ea-a3ca4df604dd]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:45:56 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:45:56 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:45:56 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:45:56 user nova-compute[74692]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc (non-flash)
Nov 18 18:45:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:45:56 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:45:56 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:45:56 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:45:56 user nova-compute[74692]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc (non-flash)
Nov 18 18:45:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:45:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[78961b98-0004-4dfa-9b5a-4f37f919a6e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce, portal: 172.16.0.220,3260]
Nov 18 18:45:57 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce, portal: 172.16.0.220,3260] successful.
Nov 18 18:45:57 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[578c493a-c247-4499-9c4d-8392bf670cfb]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[313a401f-8875-463b-803b-5d16a941c1a8]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:45:57 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:45:57 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:45:57 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:45:57 user nova-compute[74692]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc (non-flash)
Nov 18 18:45:57 user nova-compute[74692]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce (non-flash)
Nov 18 18:45:57 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:45:57 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:45:57 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:45:57 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:45:57 user nova-compute[74692]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc (non-flash)
Nov 18 18:45:57 user nova-compute[74692]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce (non-flash)
Nov 18 18:45:57 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] HCTL ('38', '-', '-', 0) found on session 42 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ac66c5-8863-467f-af5c-95f86e466560]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:45:57 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: None {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:45:58 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:45:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IEGtdOHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:45:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:45:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23133613238313537', 'path': '/dev/sdg'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:45:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133613238313537', 'path': '/dev/sdg'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:45:58 user nova-compute[74692]: DEBUG nova.objects.instance [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'flavor' on Instance uuid a31844da-6f7e-4711-bccc-e31d2114d66d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:45:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:45:58 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:45:58 user nova-compute[74692]:   <source dev="/dev/sdg"/>
Nov 18 18:45:58 user nova-compute[74692]:   <target dev="vdc" bus="virtio"/>
Nov 18 18:45:58 user nova-compute[74692]:   <serial>b9b3f7ed-f3cd-49e8-a41c-520479851dce</serial>
Nov 18 18:45:58 user nova-compute[74692]: </disk>
Nov 18 18:45:58 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:45:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:45:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:45:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:45:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] No VIF found with MAC fa:16:3e:95:47:96, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:45:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-585e71a3-20ca-4a9f-b71d-c383905d3b27 tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.644s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:45:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:45:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:45:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 18:45:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:45:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:45:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:00 user nova-compute[74692]: INFO nova.compute.manager [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Detaching volume d1f603f1-4ab4-4a32-b0f5-164e48be72cc
Nov 18 18:46:00 user nova-compute[74692]: INFO nova.virt.block_device [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Attempting to driver detach volume d1f603f1-4ab4-4a32-b0f5-164e48be72cc from mountpoint /dev/vdb
Nov 18 18:46:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Attempting to detach device vdb from instance a31844da-6f7e-4711-bccc-e31d2114d66d from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:46:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:46:00 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:46:00 user nova-compute[74692]:   <source dev="/dev/sdf"/>
Nov 18 18:46:00 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:46:00 user nova-compute[74692]:   <serial>d1f603f1-4ab4-4a32-b0f5-164e48be72cc</serial>
Nov 18 18:46:00 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:46:00 user nova-compute[74692]: </disk>
Nov 18 18:46:00 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:46:00 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Successfully detached device vdb from instance a31844da-6f7e-4711-bccc-e31d2114d66d from the persistent domain config.
Nov 18 18:46:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a31844da-6f7e-4711-bccc-e31d2114d66d from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:46:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:46:00 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:46:00 user nova-compute[74692]:   <source dev="/dev/sdf"/>
Nov 18 18:46:00 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:46:00 user nova-compute[74692]:   <serial>d1f603f1-4ab4-4a32-b0f5-164e48be72cc</serial>
Nov 18 18:46:00 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:46:00 user nova-compute[74692]: </disk>
Nov 18 18:46:00 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:46:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a31844da-6f7e-4711-bccc-e31d2114d66d {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:46:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:17 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:46:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:19 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:46:19 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:46:19 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:46:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:19 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:20 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a31844da-6f7e-4711-bccc-e31d2114d66d is timed out.
Nov 18 18:46:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Successfully detached device vdb from instance a31844da-6f7e-4711-bccc-e31d2114d66d from the live domain config.
Nov 18 18:46:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'erVxUcMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:46:20 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:46:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9995073a-2fa4-4806-842a-64b84cdd775f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:46:20 user nova-compute[74692]: No targets found.
Nov 18 18:46:20 user nova-compute[74692]: iSNS:
Nov 18 18:46:20 user nova-compute[74692]: No targets found.
Nov 18 18:46:20 user nova-compute[74692]: STATIC:
Nov 18 18:46:20 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0
Nov 18 18:46:20 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:46:20 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:46:20 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce
Nov 18 18:46:20 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:46:20 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:46:20 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90
Nov 18 18:46:20 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:46:20 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:46:20 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305
Nov 18 18:46:20 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:46:20 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:46:20 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc
Nov 18 18:46:20 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:46:20 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:46:20 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:46:20 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:46:20 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:46:20 user nova-compute[74692]: FIRMWARE:
Nov 18 18:46:20 user nova-compute[74692]: No targets found.
Nov 18 18:46:20 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:46:20 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:46:20 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[319be8c8-5622-4691-a810-f052aef7ecc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc31803-4e42-428a-adf0-527a8562681e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:46:20 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:46:20 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:46:20 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:46:20 user nova-compute[74692]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc (non-flash)
Nov 18 18:46:20 user nova-compute[74692]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce (non-flash)
Nov 18 18:46:20 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:46:20 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:46:20 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:46:20 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:46:20 user nova-compute[74692]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc (non-flash)
Nov 18 18:46:20 user nova-compute[74692]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce (non-flash)
Nov 18 18:46:20 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a45af520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc'): ({'sdf'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Removing single pathed devices sdf {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[896d5844-0af5-400d-a511-9f2a94829a9f]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b573199-8a8b-4e6e-a7a2-5007ae83a3b2]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Flushing IO for device /dev/sdf {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[120735dc-b432-48f9-812d-9dba2b1888f3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:46:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.112s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[602cecbb-e12b-432d-88c6-ef58181c7754]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] SCSI volumes sdf have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7293303a-5815-4422-a5c6-eff887e1ff08]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a3e5cf-249a-453e-8c57-c883976e3d10]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc, portal: 172.16.0.220,3260]
Nov 18 18:46:21 user nova-compute[74692]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc, portal: 172.16.0.220,3260] successful.
Nov 18 18:46:21 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f603f1-4ab4-4a32-b0f5-164e48be72cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebae88a7-7953-4e88-909e-52b8d671cd20]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] <== disconnect_volume: return (409ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:21 user nova-compute[74692]: DEBUG nova.objects.instance [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'flavor' on Instance uuid a31844da-6f7e-4711-bccc-e31d2114d66d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d188a750-ffeb-4f62-bdc6-b315d5f038ab tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.854s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:22 user nova-compute[74692]: INFO nova.compute.manager [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Detaching volume b9b3f7ed-f3cd-49e8-a41c-520479851dce
Nov 18 18:46:22 user nova-compute[74692]: INFO nova.virt.block_device [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Attempting to driver detach volume b9b3f7ed-f3cd-49e8-a41c-520479851dce from mountpoint /dev/vdc
Nov 18 18:46:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Attempting to detach device vdc from instance a31844da-6f7e-4711-bccc-e31d2114d66d from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:46:22 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:46:22 user nova-compute[74692]:   <source dev="/dev/sdg"/>
Nov 18 18:46:22 user nova-compute[74692]:   <target dev="vdc" bus="virtio"/>
Nov 18 18:46:22 user nova-compute[74692]:   <serial>b9b3f7ed-f3cd-49e8-a41c-520479851dce</serial>
Nov 18 18:46:22 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 18:46:22 user nova-compute[74692]: </disk>
Nov 18 18:46:22 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:46:22 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Successfully detached device vdc from instance a31844da-6f7e-4711-bccc-e31d2114d66d from the persistent domain config.
Nov 18 18:46:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a31844da-6f7e-4711-bccc-e31d2114d66d from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:46:22 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:46:22 user nova-compute[74692]:   <source dev="/dev/sdg"/>
Nov 18 18:46:22 user nova-compute[74692]:   <target dev="vdc" bus="virtio"/>
Nov 18 18:46:22 user nova-compute[74692]:   <serial>b9b3f7ed-f3cd-49e8-a41c-520479851dce</serial>
Nov 18 18:46:22 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 18:46:22 user nova-compute[74692]: </disk>
Nov 18 18:46:22 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a31844da-6f7e-4711-bccc-e31d2114d66d {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:46:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:46:23 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:46:23 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:46:23 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7689MB free_disk=24.915359497070312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:46:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 30beb8e4-0363-41e0-8089-04bef2539f4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance a31844da-6f7e-4711-bccc-e31d2114d66d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 102ba990-07fc-47ba-9abb-781423525369 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:26 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:46:26 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:46:26 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:46:26 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:46:26 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:46:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:46:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:46:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-d17071fc-5d5b-4e06-8a47-05174014167c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:46:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-d17071fc-5d5b-4e06-8a47-05174014167c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:46:29 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:46:29 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Updating instance_info_cache with network_info: [{"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:46:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-d17071fc-5d5b-4e06-8a47-05174014167c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:46:29 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:46:29 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:46:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:46:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:36 user nova-compute[74692]: INFO nova.compute.manager [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Rescuing
Nov 18 18:46:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "refresh_cache-102ba990-07fc-47ba-9abb-781423525369" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:46:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquired lock "refresh_cache-102ba990-07fc-47ba-9abb-781423525369" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:46:36 user nova-compute[74692]: DEBUG nova.network.neutron [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:46:36 user nova-compute[74692]: DEBUG nova.network.neutron [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Updating instance_info_cache with network_info: [{"id": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "address": "fa:16:3e:fe:c8:c4", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef69d29-64", "ovs_interfaceid": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:46:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Releasing lock "refresh_cache-102ba990-07fc-47ba-9abb-781423525369" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:46:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:37 user nova-compute[74692]: DEBUG nova.compute.manager [req-494cb733-77cb-4693-b641-f59ad54762d0 req-64861058-930b-4ccb-b990-53bbf3fef882 service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received event network-vif-unplugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-494cb733-77cb-4693-b641-f59ad54762d0 req-64861058-930b-4ccb-b990-53bbf3fef882 service nova] Acquiring lock "102ba990-07fc-47ba-9abb-781423525369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-494cb733-77cb-4693-b641-f59ad54762d0 req-64861058-930b-4ccb-b990-53bbf3fef882 service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-494cb733-77cb-4693-b641-f59ad54762d0 req-64861058-930b-4ccb-b990-53bbf3fef882 service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:37 user nova-compute[74692]: DEBUG nova.compute.manager [req-494cb733-77cb-4693-b641-f59ad54762d0 req-64861058-930b-4ccb-b990-53bbf3fef882 service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] No waiting events found dispatching network-vif-unplugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:46:37 user nova-compute[74692]: WARNING nova.compute.manager [req-494cb733-77cb-4693-b641-f59ad54762d0 req-64861058-930b-4ccb-b990-53bbf3fef882 service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received unexpected event network-vif-unplugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 for instance with vm_state active and task_state rescuing.
Nov 18 18:46:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:37 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 102ba990-07fc-47ba-9abb-781423525369] Instance destroyed successfully.
Nov 18 18:46:37 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Attempting a stable device rescue
Nov 18 18:46:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74692) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 18:46:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Instance directory exists: not creating {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 18:46:37 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Creating image(s)
Nov 18 18:46:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "/opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "/opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "/opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:37 user nova-compute[74692]: DEBUG nova.objects.instance [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'trusted_certs' on Instance uuid 102ba990-07fc-47ba-9abb-781423525369 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:46:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "437c4b0d16665a5a8f9a51ac9fb5008fa5da712d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "437c4b0d16665a5a8f9a51ac9fb5008fa5da712d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437c4b0d16665a5a8f9a51ac9fb5008fa5da712d.part --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437c4b0d16665a5a8f9a51ac9fb5008fa5da712d.part --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.images [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] 4b72aa21-4aa3-4807-8481-10714a33e08b was qcow2, converting to raw {{(pid=74692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/437c4b0d16665a5a8f9a51ac9fb5008fa5da712d.part /opt/stack/data/nova/instances/_base/437c4b0d16665a5a8f9a51ac9fb5008fa5da712d.converted {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/437c4b0d16665a5a8f9a51ac9fb5008fa5da712d.part /opt/stack/data/nova/instances/_base/437c4b0d16665a5a8f9a51ac9fb5008fa5da712d.converted" returned: 0 in 0.226s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437c4b0d16665a5a8f9a51ac9fb5008fa5da712d.converted --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-5fc51bc6-4fb5-42bc-92e7-94700fa814fa req-e3919071-adb6-452f-b732-ff64c3d590d2 service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5fc51bc6-4fb5-42bc-92e7-94700fa814fa req-e3919071-adb6-452f-b732-ff64c3d590d2 service nova] Acquiring lock "102ba990-07fc-47ba-9abb-781423525369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5fc51bc6-4fb5-42bc-92e7-94700fa814fa req-e3919071-adb6-452f-b732-ff64c3d590d2 service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5fc51bc6-4fb5-42bc-92e7-94700fa814fa req-e3919071-adb6-452f-b732-ff64c3d590d2 service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-5fc51bc6-4fb5-42bc-92e7-94700fa814fa req-e3919071-adb6-452f-b732-ff64c3d590d2 service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] No waiting events found dispatching network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:46:39 user nova-compute[74692]: WARNING nova.compute.manager [req-5fc51bc6-4fb5-42bc-92e7-94700fa814fa req-e3919071-adb6-452f-b732-ff64c3d590d2 service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received unexpected event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 for instance with vm_state active and task_state rescuing.
Nov 18 18:46:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-f5bcc775-e854-4f79-b94e-d64e65dc73d2 req-8b4087fe-0338-4882-8f79-45606794650f service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-changed-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-f5bcc775-e854-4f79-b94e-d64e65dc73d2 req-8b4087fe-0338-4882-8f79-45606794650f service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Refreshing instance network info cache due to event network-changed-a3106847-e69a-4753-b6d9-7e0dd00a58ab. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f5bcc775-e854-4f79-b94e-d64e65dc73d2 req-8b4087fe-0338-4882-8f79-45606794650f service nova] Acquiring lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f5bcc775-e854-4f79-b94e-d64e65dc73d2 req-8b4087fe-0338-4882-8f79-45606794650f service nova] Acquired lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.network.neutron [req-f5bcc775-e854-4f79-b94e-d64e65dc73d2 req-8b4087fe-0338-4882-8f79-45606794650f service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Refreshing network info cache for port a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437c4b0d16665a5a8f9a51ac9fb5008fa5da712d.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "437c4b0d16665a5a8f9a51ac9fb5008fa5da712d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.613s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "437c4b0d16665a5a8f9a51ac9fb5008fa5da712d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "437c4b0d16665a5a8f9a51ac9fb5008fa5da712d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437c4b0d16665a5a8f9a51ac9fb5008fa5da712d --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437c4b0d16665a5a8f9a51ac9fb5008fa5da712d --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/437c4b0d16665a5a8f9a51ac9fb5008fa5da712d,backing_fmt=raw /opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/disk.rescue {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/437c4b0d16665a5a8f9a51ac9fb5008fa5da712d,backing_fmt=raw /opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/disk.rescue" returned: 0 in 0.069s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "437c4b0d16665a5a8f9a51ac9fb5008fa5da712d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.objects.instance [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'migration_context' on Instance uuid 102ba990-07fc-47ba-9abb-781423525369 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.objects.base [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Object Instance<102ba990-07fc-47ba-9abb-781423525369> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Start _get_guest_xml network_info=[{"id": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "address": "fa:16:3e:fe:c8:c4", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "vif_mac": "fa:16:3e:fe:c8:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef69d29-64", "ovs_interfaceid": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4b72aa21-4aa3-4807-8481-10714a33e08b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwTNRpma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '102ba990-07fc-47ba-9abb-781423525369', 'attached_at': '', 'detached_at': '', 'volume_id': '0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0', 'serial': '0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0'}, 'attachment_id': '7e4c1508-7238-4376-99d8-cb04bf749988', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.objects.instance [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'resources' on Instance uuid 102ba990-07fc-47ba-9abb-781423525369 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.objects.base [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Object Instance<102ba990-07fc-47ba-9abb-781423525369> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.objects.instance [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'numa_topology' on Instance uuid 102ba990-07fc-47ba-9abb-781423525369 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:46:39 user nova-compute[74692]: INFO nova.compute.manager [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Detaching volume 182bad63-5b54-4cc9-bd85-321759669d90
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.objects.base [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Object Instance<102ba990-07fc-47ba-9abb-781423525369> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:46:39 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:46:39 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.objects.instance [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'vcpu_model' on Instance uuid 102ba990-07fc-47ba-9abb-781423525369 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.objects.base [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Object Instance<102ba990-07fc-47ba-9abb-781423525369> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwTNRpma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:46:39 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:46:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:46:39 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:46:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:46:39 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:46:39 user nova-compute[74692]: INFO nova.virt.block_device [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Attempting to driver detach volume 182bad63-5b54-4cc9-bd85-321759669d90 from mountpoint /dev/vdb
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Attempting to detach device vdb from instance 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:46:39 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:46:39 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:46:39 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:46:39 user nova-compute[74692]:   <serial>182bad63-5b54-4cc9-bd85-321759669d90</serial>
Nov 18 18:46:39 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:46:39 user nova-compute[74692]: </disk>
Nov 18 18:46:39 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed8df73-81e2-4ffd-bdbe-56c4271c9ef2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KwTNRpma\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 18 18:46:39 user nova-compute[74692]: node.name = iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0
Nov 18 18:46:39 user nova-compute[74692]: node.tpgt = -1
Nov 18 18:46:39 user nova-compute[74692]: node.startup = automatic
Nov 18 18:46:39 user nova-compute[74692]: node.leading_login = No
Nov 18 18:46:39 user nova-compute[74692]: iface.iscsi_ifacename = default
Nov 18 18:46:39 user nova-compute[74692]: iface.net_ifacename = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.ipaddress = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.prefix_len = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.hwaddress = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.transport_name = tcp
Nov 18 18:46:39 user nova-compute[74692]: iface.initiatorname = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.state = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.vlan_id = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.vlan_priority = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.vlan_state = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.iface_num = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.mtu = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.port = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.bootproto = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.subnet_mask = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.gateway = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.dhcp_alt_client_id_state = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.dhcp_alt_client_id = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.dhcp_dns = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.dhcp_learn_iqn = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.dhcp_req_vendor_id_state = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.dhcp_vendor_id_state = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.dhcp_vendor_id = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.dhcp_slp_da = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.fragmentation = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.gratuitous_arp = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.incoming_forwarding = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.tos_state = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.tos = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.ttl = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.delayed_ack = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.tcp_nagle = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.tcp_wsf_state = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.tcp_wsf = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.tcp_timer_scale = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.tcp_timestamp = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.redirect = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.def_task_mgmt_timeout = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.header_digest = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.data_digest = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.immediate_data = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.initial_r2t = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.data_seq_inorder = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.data_pdu_inorder = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.erl = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.max_receive_data_len = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.first_burst_len = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.max_outstanding_r2t = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.max_burst_len = 0
Nov 18 18:46:39 user nova-compute[74692]: iface.chap_auth = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.bidi_chap = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.strict_login_compliance = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.discovery_auth = <empty>
Nov 18 18:46:39 user nova-compute[74692]: iface.discovery_logout = <empty>
Nov 18 18:46:39 user nova-compute[74692]: node.discovery_address = <empty>
Nov 18 18:46:39 user nova-compute[74692]: node.discovery_port = 0
Nov 18 18:46:39 user nova-compute[74692]: node.discovery_type = static
Nov 18 18:46:39 user nova-compute[74692]: node.session.initial_cmdsn = 0
Nov 18 18:46:39 user nova-compute[74692]: node.session.initial_login_retry_max = 8
Nov 18 18:46:39 user nova-compute[74692]: node.session.xmit_thread_priority = -20
Nov 18 18:46:39 user nova-compute[74692]: node.session.cmds_max = 128
Nov 18 18:46:39 user nova-compute[74692]: node.session.queue_depth = 32
Nov 18 18:46:39 user nova-compute[74692]: node.session.nr_sessions = 1
Nov 18 18:46:39 user nova-compute[74692]: node.session.auth.authmethod = CHAP
Nov 18 18:46:39 user nova-compute[74692]: node.session.auth.username = KwTNRpma
Nov 18 18:46:39 user nova-compute[74692]: node.session.auth.password = ***
Nov 18 18:46:39 user nova-compute[74692]: node.session.auth.username_in = <empty>
Nov 18 18:46:39 user nova-compute[74692]: node.session.auth.password_in = <empty>
Nov 18 18:46:39 user nova-compute[74692]: node.session.auth.chap_algs = MD5
Nov 18 18:46:39 user nova-compute[74692]: node.session.timeo.replacement_timeout = 120
Nov 18 18:46:39 user nova-compute[74692]: node.session.err_timeo.abort_timeout = 15
Nov 18 18:46:39 user nova-compute[74692]: node.session.err_timeo.lu_reset_timeout = 30
Nov 18 18:46:39 user nova-compute[74692]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 18 18:46:39 user nova-compute[74692]: node.session.err_timeo.host_reset_timeout = 60
Nov 18 18:46:39 user nova-compute[74692]: node.session.iscsi.FastAbort = Yes
Nov 18 18:46:39 user nova-compute[74692]: node.session.iscsi.InitialR2T = No
Nov 18 18:46:39 user nova-compute[74692]: node.session.iscsi.ImmediateData = Yes
Nov 18 18:46:39 user nova-compute[74692]: node.session.iscsi.FirstBurstLength = 262144
Nov 18 18:46:39 user nova-compute[74692]: node.session.iscsi.MaxBurstLength = 16776192
Nov 18 18:46:39 user nova-compute[74692]: node.session.iscsi.DefaultTime2Retain = 0
Nov 18 18:46:39 user nova-compute[74692]: node.session.iscsi.DefaultTime2Wait = 2
Nov 18 18:46:39 user nova-compute[74692]: node.session.iscsi.MaxConnections = 1
Nov 18 18:46:39 user nova-compute[74692]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 18 18:46:39 user nova-compute[74692]: node.session.iscsi.ERL = 0
Nov 18 18:46:39 user nova-compute[74692]: node.session.scan = manual
Nov 18 18:46:39 user nova-compute[74692]: node.session.reopen_max = 0
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].address = 172.16.0.220
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].port = 3260
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].startup = manual
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].tcp.window_size = 524288
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].tcp.type_of_service = 0
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].timeo.logout_timeout = 15
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].timeo.login_timeout = 15
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].timeo.auth_timeout = 45
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].timeo.noop_out_interval = 5
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].timeo.noop_out_timeout = 5
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].iscsi.HeaderDigest = None
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].iscsi.DataDigest = None
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].iscsi.IFMarker = No
Nov 18 18:46:39 user nova-compute[74692]: node.conn[0].iscsi.OFMarker = No
Nov 18 18:46:39 user nova-compute[74692]: # END RECORD
Nov 18 18:46:39 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:39 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Successfully detached device vdb from instance 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 from the persistent domain config.
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:46:39 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:46:39 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:46:39 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:46:39 user nova-compute[74692]:   <serial>182bad63-5b54-4cc9-bd85-321759669d90</serial>
Nov 18 18:46:39 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:46:39 user nova-compute[74692]: </disk>
Nov 18 18:46:39 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aecb55-4b48-4e22-be08-7379771cf05e]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41fe4d9-072e-49f7-9d7b-30536878921e]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:46:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KwTNRpma {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KwTNRpma" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8480ff-01c2-4f98-90a4-d094a4bed4af]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KwTNRpma'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35a8cb8-9d6b-4cc4-8725-cc16c2779967]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG nova.network.neutron [req-f5bcc775-e854-4f79-b94e-d64e65dc73d2 req-8b4087fe-0338-4882-8f79-45606794650f service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Updated VIF entry in instance network info cache for port a3106847-e69a-4753-b6d9-7e0dd00a58ab. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG nova.network.neutron [req-f5bcc775-e854-4f79-b94e-d64e65dc73d2 req-8b4087fe-0338-4882-8f79-45606794650f service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Updating instance_info_cache with network_info: [{"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa879d6f-a566-4bd8-9e74-180a970177df]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:46:40 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:46:40 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:46:40 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:46:40 user nova-compute[74692]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce (non-flash)
Nov 18 18:46:40 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:46:40 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:46:40 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:46:40 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:46:40 user nova-compute[74692]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce (non-flash)
Nov 18 18:46:40 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] HCTL ('35', '0', '0', 0) found on session 39 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f5bcc775-e854-4f79-b94e-d64e65dc73d2 req-8b4087fe-0338-4882-8f79-45606794650f service nova] Releasing lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a373a5f9-762f-46a7-888a-4d097204cbc6]: (4, ('0 0 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Searching for a device in session 39 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwTNRpma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] <== connect_volume: return (178ms) {'type': 'block', 'scsi_wwn': '23063393338343364', 'path': '/dev/sdd'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063393338343364', 'path': '/dev/sdd'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1437746351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1437746351',id=33,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:45:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='704ef46081d04fc7a0ed88456cbe9fe8',ramdisk_id='',reservation_id='r-pkh5jk7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-199647198',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:45:03Z,user_data=None,user_id='1233b31e12dc4d5796a60327d93c3bfb',uuid=102ba990-07fc-47ba-9abb-781423525369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "address": "fa:16:3e:fe:c8:c4", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "vif_mac": "fa:16:3e:fe:c8:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef69d29-64", "ovs_interfaceid": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converting VIF {"id": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "address": "fa:16:3e:fe:c8:c4", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "vif_mac": "fa:16:3e:fe:c8:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef69d29-64", "ovs_interfaceid": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:c8:c4,bridge_name='br-int',has_traffic_filtering=True,id=8ef69d29-6445-4468-80c2-c9930ecb41e7,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef69d29-64') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG nova.objects.instance [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'pci_devices' on Instance uuid 102ba990-07fc-47ba-9abb-781423525369 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG nova.objects.base [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Object Instance<102ba990-07fc-47ba-9abb-781423525369> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:46:40 user nova-compute[74692]:   <uuid>102ba990-07fc-47ba-9abb-781423525369</uuid>
Nov 18 18:46:40 user nova-compute[74692]:   <name>instance-00000021</name>
Nov 18 18:46:40 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:46:40 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:46:40 user nova-compute[74692]:   <metadata>
Nov 18 18:46:40 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:46:40 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:46:40 user nova-compute[74692]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1437746351</nova:name>
Nov 18 18:46:40 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:46:39</nova:creationTime>
Nov 18 18:46:40 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:46:40 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:46:40 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:46:40 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:46:40 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:46:40 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:46:40 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:46:40 user nova-compute[74692]:       <nova:owner>
Nov 18 18:46:40 user nova-compute[74692]:         <nova:user uuid="1233b31e12dc4d5796a60327d93c3bfb">tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member</nova:user>
Nov 18 18:46:40 user nova-compute[74692]:         <nova:project uuid="704ef46081d04fc7a0ed88456cbe9fe8">tempest-ServerBootFromVolumeStableRescueTest-199647198</nova:project>
Nov 18 18:46:40 user nova-compute[74692]:       </nova:owner>
Nov 18 18:46:40 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:46:40 user nova-compute[74692]:       <nova:ports>
Nov 18 18:46:40 user nova-compute[74692]:         <nova:port uuid="8ef69d29-6445-4468-80c2-c9930ecb41e7">
Nov 18 18:46:40 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 18:46:40 user nova-compute[74692]:         </nova:port>
Nov 18 18:46:40 user nova-compute[74692]:       </nova:ports>
Nov 18 18:46:40 user nova-compute[74692]:     </nova:instance>
Nov 18 18:46:40 user nova-compute[74692]:   </metadata>
Nov 18 18:46:40 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:46:40 user nova-compute[74692]:     <system>
Nov 18 18:46:40 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:46:40 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:46:40 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:46:40 user nova-compute[74692]:       <entry name="serial">102ba990-07fc-47ba-9abb-781423525369</entry>
Nov 18 18:46:40 user nova-compute[74692]:       <entry name="uuid">102ba990-07fc-47ba-9abb-781423525369</entry>
Nov 18 18:46:40 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:46:40 user nova-compute[74692]:     </system>
Nov 18 18:46:40 user nova-compute[74692]:   </sysinfo>
Nov 18 18:46:40 user nova-compute[74692]:   <os>
Nov 18 18:46:40 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:46:40 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:46:40 user nova-compute[74692]:   </os>
Nov 18 18:46:40 user nova-compute[74692]:   <features>
Nov 18 18:46:40 user nova-compute[74692]:     <acpi/>
Nov 18 18:46:40 user nova-compute[74692]:     <apic/>
Nov 18 18:46:40 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:46:40 user nova-compute[74692]:   </features>
Nov 18 18:46:40 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:46:40 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:46:40 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:46:40 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:46:40 user nova-compute[74692]:   </clock>
Nov 18 18:46:40 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:46:40 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:46:40 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:46:40 user nova-compute[74692]:   </cpu>
Nov 18 18:46:40 user nova-compute[74692]:   <devices>
Nov 18 18:46:40 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:46:40 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:46:40 user nova-compute[74692]:       <source dev="/dev/sdd"/>
Nov 18 18:46:40 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:46:40 user nova-compute[74692]:       <serial>0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0</serial>
Nov 18 18:46:40 user nova-compute[74692]:     </disk>
Nov 18 18:46:40 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:46:40 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:46:40 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/disk.rescue"/>
Nov 18 18:46:40 user nova-compute[74692]:       <target dev="vdb" bus="virtio"/>
Nov 18 18:46:40 user nova-compute[74692]:       <boot order="1"/>
Nov 18 18:46:40 user nova-compute[74692]:     </disk>
Nov 18 18:46:40 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:46:40 user nova-compute[74692]:       <mac address="fa:16:3e:fe:c8:c4"/>
Nov 18 18:46:40 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:46:40 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:46:40 user nova-compute[74692]:       <target dev="tap8ef69d29-64"/>
Nov 18 18:46:40 user nova-compute[74692]:     </interface>
Nov 18 18:46:40 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:46:40 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/console.log" append="off"/>
Nov 18 18:46:40 user nova-compute[74692]:     </serial>
Nov 18 18:46:40 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:46:40 user nova-compute[74692]:     <video>
Nov 18 18:46:40 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:46:40 user nova-compute[74692]:     </video>
Nov 18 18:46:40 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:46:40 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:46:40 user nova-compute[74692]:     </rng>
Nov 18 18:46:40 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:46:40 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:46:40 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:46:40 user nova-compute[74692]:     </memballoon>
Nov 18 18:46:40 user nova-compute[74692]:   </devices>
Nov 18 18:46:40 user nova-compute[74692]: </domain>
Nov 18 18:46:40 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:46:40 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 102ba990-07fc-47ba-9abb-781423525369] Instance destroyed successfully.
Nov 18 18:46:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] No VIF found with MAC fa:16:3e:fe:c8:c4, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:46:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-89088192-a03a-45a3-98f6-8279b82ed153 req-7a3face6-9678-491f-8beb-6762b746560f service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-changed-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-89088192-a03a-45a3-98f6-8279b82ed153 req-7a3face6-9678-491f-8beb-6762b746560f service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Refreshing instance network info cache due to event network-changed-a3106847-e69a-4753-b6d9-7e0dd00a58ab. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-89088192-a03a-45a3-98f6-8279b82ed153 req-7a3face6-9678-491f-8beb-6762b746560f service nova] Acquiring lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-89088192-a03a-45a3-98f6-8279b82ed153 req-7a3face6-9678-491f-8beb-6762b746560f service nova] Acquired lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG nova.network.neutron [req-89088192-a03a-45a3-98f6-8279b82ed153 req-7a3face6-9678-491f-8beb-6762b746560f service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Refreshing network info cache for port a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-5410cd37-d6cf-46f8-ba7e-8931d9715bea req-22d4ea3d-1aab-40d7-b3bf-38af37bab5ec service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5410cd37-d6cf-46f8-ba7e-8931d9715bea req-22d4ea3d-1aab-40d7-b3bf-38af37bab5ec service nova] Acquiring lock "102ba990-07fc-47ba-9abb-781423525369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5410cd37-d6cf-46f8-ba7e-8931d9715bea req-22d4ea3d-1aab-40d7-b3bf-38af37bab5ec service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5410cd37-d6cf-46f8-ba7e-8931d9715bea req-22d4ea3d-1aab-40d7-b3bf-38af37bab5ec service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-5410cd37-d6cf-46f8-ba7e-8931d9715bea req-22d4ea3d-1aab-40d7-b3bf-38af37bab5ec service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] No waiting events found dispatching network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:46:41 user nova-compute[74692]: WARNING nova.compute.manager [req-5410cd37-d6cf-46f8-ba7e-8931d9715bea req-22d4ea3d-1aab-40d7-b3bf-38af37bab5ec service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received unexpected event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 for instance with vm_state active and task_state rescuing.
Nov 18 18:46:42 user nova-compute[74692]: DEBUG nova.network.neutron [req-89088192-a03a-45a3-98f6-8279b82ed153 req-7a3face6-9678-491f-8beb-6762b746560f service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Updated VIF entry in instance network info cache for port a3106847-e69a-4753-b6d9-7e0dd00a58ab. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:46:42 user nova-compute[74692]: DEBUG nova.network.neutron [req-89088192-a03a-45a3-98f6-8279b82ed153 req-7a3face6-9678-491f-8beb-6762b746560f service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Updating instance_info_cache with network_info: [{"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:46:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-89088192-a03a-45a3-98f6-8279b82ed153 req-7a3face6-9678-491f-8beb-6762b746560f service nova] Releasing lock "refresh_cache-67a67f8d-b4f3-4d34-b4d8-ac16b1145180" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:46:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:43 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a31844da-6f7e-4711-bccc-e31d2114d66d is timed out.
Nov 18 18:46:43 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Successfully detached device vdc from instance a31844da-6f7e-4711-bccc-e31d2114d66d from the live domain config.
Nov 18 18:46:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IEGtdOHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:46:43 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[448705a3-ea18-48c1-9491-81bf6f39ce4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:46:43 user nova-compute[74692]: No targets found.
Nov 18 18:46:43 user nova-compute[74692]: iSNS:
Nov 18 18:46:43 user nova-compute[74692]: No targets found.
Nov 18 18:46:43 user nova-compute[74692]: STATIC:
Nov 18 18:46:43 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0
Nov 18 18:46:43 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:46:43 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:46:43 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce
Nov 18 18:46:43 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:46:43 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:46:43 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90
Nov 18 18:46:43 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:46:43 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:46:43 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305
Nov 18 18:46:43 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:46:43 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:46:43 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:46:43 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:46:43 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:46:43 user nova-compute[74692]: FIRMWARE:
Nov 18 18:46:43 user nova-compute[74692]: No targets found.
Nov 18 18:46:43 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:46:43 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:46:43 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a452004-8ca3-496d-8c2b-783ba1562200]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f9fa2a-2119-4e4e-b20e-a15b6d8743f7]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:46:43 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:46:43 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:46:43 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:46:43 user nova-compute[74692]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce (non-flash)
Nov 18 18:46:43 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:46:43 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:46:43 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:46:43 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:46:43 user nova-compute[74692]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce (non-flash)
Nov 18 18:46:43 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c43ce170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce'): ({'sdg'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Removing single pathed devices sdg {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b716ec-0e5b-4ef2-8a94-9844e0cb1116]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c558981-ec94-4566-86c0-8d1a057d1345]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Flushing IO for device /dev/sdg {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a283da-327b-449f-b18f-d0586d0aacc0]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf9e066-17e3-4ae5-88ad-f078240ff6ea]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] SCSI volumes sdg have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1757541b-0b29-4f23-9c9a-47729508b5ee]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ed17e6-b3c0-4f28-ba91-936a0d8d5863]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce, portal: 172.16.0.220,3260]
Nov 18 18:46:43 user nova-compute[74692]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce, portal: 172.16.0.220,3260] successful.
Nov 18 18:46:43 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b3f7ed-f3cd-49e8-a41c-520479851dce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3849f5ef-ecf3-4dfa-9681-d1a3e5c23432]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] <== disconnect_volume: return (327ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG nova.compute.manager [None req-57c625fc-aa79-4f29-8720-88997a2be85c tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG nova.compute.manager [req-a3b0caae-36b9-4389-bbac-1e845b8d1722 req-fd34a15a-57e7-4c07-990f-fd0f372d5cbb service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a3b0caae-36b9-4389-bbac-1e845b8d1722 req-fd34a15a-57e7-4c07-990f-fd0f372d5cbb service nova] Acquiring lock "102ba990-07fc-47ba-9abb-781423525369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a3b0caae-36b9-4389-bbac-1e845b8d1722 req-fd34a15a-57e7-4c07-990f-fd0f372d5cbb service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a3b0caae-36b9-4389-bbac-1e845b8d1722 req-fd34a15a-57e7-4c07-990f-fd0f372d5cbb service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:43 user nova-compute[74692]: DEBUG nova.compute.manager [req-a3b0caae-36b9-4389-bbac-1e845b8d1722 req-fd34a15a-57e7-4c07-990f-fd0f372d5cbb service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] No waiting events found dispatching network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:46:43 user nova-compute[74692]: WARNING nova.compute.manager [req-a3b0caae-36b9-4389-bbac-1e845b8d1722 req-fd34a15a-57e7-4c07-990f-fd0f372d5cbb service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received unexpected event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 for instance with vm_state active and task_state rescuing.
Nov 18 18:46:44 user nova-compute[74692]: DEBUG nova.objects.instance [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'flavor' on Instance uuid a31844da-6f7e-4711-bccc-e31d2114d66d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:46:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-08f97267-9a17-410b-ba59-0939178e7e3d tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.774s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:45 user nova-compute[74692]: INFO nova.compute.manager [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Terminating instance
Nov 18 18:46:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:46:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-8f909dae-11b0-4718-aa70-b40bcb7c6199 req-0d75ce0f-092b-4564-947f-dfc965e3ad54 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received event network-vif-unplugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8f909dae-11b0-4718-aa70-b40bcb7c6199 req-0d75ce0f-092b-4564-947f-dfc965e3ad54 service nova] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8f909dae-11b0-4718-aa70-b40bcb7c6199 req-0d75ce0f-092b-4564-947f-dfc965e3ad54 service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8f909dae-11b0-4718-aa70-b40bcb7c6199 req-0d75ce0f-092b-4564-947f-dfc965e3ad54 service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-8f909dae-11b0-4718-aa70-b40bcb7c6199 req-0d75ce0f-092b-4564-947f-dfc965e3ad54 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] No waiting events found dispatching network-vif-unplugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-8f909dae-11b0-4718-aa70-b40bcb7c6199 req-0d75ce0f-092b-4564-947f-dfc965e3ad54 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received event network-vif-unplugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:46 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Instance destroyed successfully.
Nov 18 18:46:46 user nova-compute[74692]: DEBUG nova.objects.instance [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lazy-loading 'resources' on Instance uuid a31844da-6f7e-4711-bccc-e31d2114d66d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1040447622',display_name='tempest-AttachVolumeTestJSON-server-1040447622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1040447622',id=31,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/ySpPqXGmEcLYBj4PRCOsMBqwCveQxREc2GsXAKXlev7RHuKUgNfSz0yI4d6lzu8RWxsOvXI1oKm+JvWTqf0kYYDUb34UGvD9FKsnhknCJo+LJ6U+UVuGgdYqogoCC9g==',key_name='tempest-keypair-1408897553',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:43:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da05b2ed39a3489db70da40991bc8e48',ramdisk_id='',reservation_id='r-1xxk084z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-858172900',owner_user_name='tempest-AttachVolumeTestJSON-858172900-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9dad2e2f1d541bf803b5d923db5242b',uuid=a31844da-6f7e-4711-bccc-e31d2114d66d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "address": "fa:16:3e:95:47:96", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2ac737-2d", "ovs_interfaceid": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converting VIF {"id": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "address": "fa:16:3e:95:47:96", "network": {"id": "844ff68c-122f-40c0-a6ff-7ecc1f3c26d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-904612803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da05b2ed39a3489db70da40991bc8e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2ac737-2d", "ovs_interfaceid": "1a2ac737-2d49-427d-83d6-5b1c096a21ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:47:96,bridge_name='br-int',has_traffic_filtering=True,id=1a2ac737-2d49-427d-83d6-5b1c096a21ec,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2ac737-2d') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG os_vif [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:47:96,bridge_name='br-int',has_traffic_filtering=True,id=1a2ac737-2d49-427d-83d6-5b1c096a21ec,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2ac737-2d') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a2ac737-2d, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50b926d7-b670-4d18-81ca-15403c54b1f5) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:46:46 user nova-compute[74692]: INFO os_vif [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:47:96,bridge_name='br-int',has_traffic_filtering=True,id=1a2ac737-2d49-427d-83d6-5b1c096a21ec,network=Network(844ff68c-122f-40c0-a6ff-7ecc1f3c26d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2ac737-2d')
Nov 18 18:46:46 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Deleting instance files /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d_del
Nov 18 18:46:46 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Deletion of /opt/stack/data/nova/instances/a31844da-6f7e-4711-bccc-e31d2114d66d_del complete
Nov 18 18:46:46 user nova-compute[74692]: INFO nova.compute.manager [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 18 18:46:46 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:46:46 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:46:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:47 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:46:47 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Took 1.26 seconds to deallocate network for instance.
Nov 18 18:46:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-5dd166e3-b446-4460-9907-2723bbab1142 req-018f0c07-435c-419e-9988-e5006dafc1dd service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Received event network-changed-42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-5dd166e3-b446-4460-9907-2723bbab1142 req-018f0c07-435c-419e-9988-e5006dafc1dd service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Refreshing instance network info cache due to event network-changed-42c3c7e8-f568-4a60-9613-152317e0543a. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5dd166e3-b446-4460-9907-2723bbab1142 req-018f0c07-435c-419e-9988-e5006dafc1dd service nova] Acquiring lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5dd166e3-b446-4460-9907-2723bbab1142 req-018f0c07-435c-419e-9988-e5006dafc1dd service nova] Acquired lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.network.neutron [req-5dd166e3-b446-4460-9907-2723bbab1142 req-018f0c07-435c-419e-9988-e5006dafc1dd service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Refreshing network info cache for port 42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received event network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] No waiting events found dispatching network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:46:48 user nova-compute[74692]: WARNING nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received unexpected event network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec for instance with vm_state deleted and task_state None.
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received event network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] No waiting events found dispatching network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:46:48 user nova-compute[74692]: WARNING nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received unexpected event network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec for instance with vm_state deleted and task_state None.
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received event network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] No waiting events found dispatching network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:46:48 user nova-compute[74692]: WARNING nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received unexpected event network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec for instance with vm_state deleted and task_state None.
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received event network-vif-unplugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] No waiting events found dispatching network-vif-unplugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:46:48 user nova-compute[74692]: WARNING nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received unexpected event network-vif-unplugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec for instance with vm_state deleted and task_state None.
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received event network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] Acquiring lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] No waiting events found dispatching network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:46:48 user nova-compute[74692]: WARNING nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received unexpected event network-vif-plugged-1a2ac737-2d49-427d-83d6-5b1c096a21ec for instance with vm_state deleted and task_state None.
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-1e89a766-8568-4440-94be-a09f1560234b req-f60401c0-3f54-4b83-8f27-730e53ee53b6 service nova] [instance: a31844da-6f7e-4711-bccc-e31d2114d66d] Received event network-vif-deleted-1a2ac737-2d49-427d-83d6-5b1c096a21ec {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:48 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Deleted allocations for instance a31844da-6f7e-4711-bccc-e31d2114d66d
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.network.neutron [req-5dd166e3-b446-4460-9907-2723bbab1142 req-018f0c07-435c-419e-9988-e5006dafc1dd service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Updated VIF entry in instance network info cache for port 42c3c7e8-f568-4a60-9613-152317e0543a. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG nova.network.neutron [req-5dd166e3-b446-4460-9907-2723bbab1142 req-018f0c07-435c-419e-9988-e5006dafc1dd service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Updating instance_info_cache with network_info: [{"id": "42c3c7e8-f568-4a60-9613-152317e0543a", "address": "fa:16:3e:13:1b:f6", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42c3c7e8-f5", "ovs_interfaceid": "42c3c7e8-f568-4a60-9613-152317e0543a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5dd166e3-b446-4460-9907-2723bbab1142 req-018f0c07-435c-419e-9988-e5006dafc1dd service nova] Releasing lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:46:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9e974adb-cf16-44ef-bcbf-393c35d119ec tempest-AttachVolumeTestJSON-858172900 tempest-AttachVolumeTestJSON-858172900-project-member] Lock "a31844da-6f7e-4711-bccc-e31d2114d66d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.921s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Stashing vm_state: active {{(pid=74692) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:46:50 user nova-compute[74692]: INFO nova.compute.claims [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Claim successful on node user
Nov 18 18:46:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-7bbe8d95-44af-4e10-8065-cb6dca4d0ce7 req-f190723e-7770-4610-9493-1aaa16e6ecc1 service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received event network-changed-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-7bbe8d95-44af-4e10-8065-cb6dca4d0ce7 req-f190723e-7770-4610-9493-1aaa16e6ecc1 service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Refreshing instance network info cache due to event network-changed-279d81c2-cb3c-4e20-9daf-e418dbb20a2a. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7bbe8d95-44af-4e10-8065-cb6dca4d0ce7 req-f190723e-7770-4610-9493-1aaa16e6ecc1 service nova] Acquiring lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7bbe8d95-44af-4e10-8065-cb6dca4d0ce7 req-f190723e-7770-4610-9493-1aaa16e6ecc1 service nova] Acquired lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG nova.network.neutron [req-7bbe8d95-44af-4e10-8065-cb6dca4d0ce7 req-f190723e-7770-4610-9493-1aaa16e6ecc1 service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Refreshing network info cache for port 279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:46:50 user nova-compute[74692]: INFO nova.compute.resource_tracker [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Updating resource usage from migration d98a2570-e78f-4fce-b8aa-c43a238a86f4
Nov 18 18:46:50 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.414s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:50 user nova-compute[74692]: INFO nova.compute.manager [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Migrating
Nov 18 18:46:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:46:50 user nova-compute[74692]: INFO nova.compute.rpcapi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 18 18:46:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG nova.network.neutron [req-7bbe8d95-44af-4e10-8065-cb6dca4d0ce7 req-f190723e-7770-4610-9493-1aaa16e6ecc1 service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Updated VIF entry in instance network info cache for port 279d81c2-cb3c-4e20-9daf-e418dbb20a2a. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG nova.network.neutron [req-7bbe8d95-44af-4e10-8065-cb6dca4d0ce7 req-f190723e-7770-4610-9493-1aaa16e6ecc1 service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Updating instance_info_cache with network_info: [{"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7bbe8d95-44af-4e10-8065-cb6dca4d0ce7 req-f190723e-7770-4610-9493-1aaa16e6ecc1 service nova] Releasing lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquired lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Updating instance_info_cache with network_info: [{"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:46:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Releasing lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Starting migrate_disk_and_power_off {{(pid=74692) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-5081bc53-cf81-47a2-8258-35dd179ecb89 req-60d64426-02f3-4a80-bdc8-683b074c614a service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received event network-vif-unplugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5081bc53-cf81-47a2-8258-35dd179ecb89 req-60d64426-02f3-4a80-bdc8-683b074c614a service nova] Acquiring lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5081bc53-cf81-47a2-8258-35dd179ecb89 req-60d64426-02f3-4a80-bdc8-683b074c614a service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5081bc53-cf81-47a2-8258-35dd179ecb89 req-60d64426-02f3-4a80-bdc8-683b074c614a service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-5081bc53-cf81-47a2-8258-35dd179ecb89 req-60d64426-02f3-4a80-bdc8-683b074c614a service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] No waiting events found dispatching network-vif-unplugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:46:51 user nova-compute[74692]: WARNING nova.compute.manager [req-5081bc53-cf81-47a2-8258-35dd179ecb89 req-60d64426-02f3-4a80-bdc8-683b074c614a service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received unexpected event network-vif-unplugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a for instance with vm_state active and task_state resize_migrating.
Nov 18 18:46:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:51 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Instance destroyed successfully.
Nov 18 18:46:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-706612544',display_name='tempest-ServerActionsTestOtherA-server-706612544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-706612544',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaznf7JGrfMrJRV86vaxqKuCfM3AcEaoWdApdT43PQu2+VRfP7TdWdgnZDzhSHo94Y2Q6y7Dc8YLTCn+JC1yHxyJqY3YZNW3EenEWfmQ3/zXDAHD9n+p1yEmT0Bxd5Ldw==',key_name='tempest-keypair-1438330061',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:45:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fdb006c6267b42fab703cfc24d93052e',ramdisk_id='',reservation_id='r-0k8ny0uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2047740053',owner_user_name='tempest-ServerActionsTestOtherA-2047740053-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:46:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d126349e69864417bb5e02666efd534c',uuid=7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-975479299-network", "vif_mac": "fa:16:3e:7c:a6:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converting VIF {"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-975479299-network", "vif_mac": "fa:16:3e:7c:a6:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=279d81c2-cb3c-4e20-9daf-e418dbb20a2a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap279d81c2-cb') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG os_vif [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=279d81c2-cb3c-4e20-9daf-e418dbb20a2a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap279d81c2-cb') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap279d81c2-cb, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc3d5981-2460-405b-8fa7-752a73e9b9ad) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:51 user nova-compute[74692]: INFO os_vif [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=279d81c2-cb3c-4e20-9daf-e418dbb20a2a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap279d81c2-cb')
Nov 18 18:46:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIgfzFya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:46:51 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:46:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[10200ed5-ce27-4419-813d-e725ba6935c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:46:51 user nova-compute[74692]: No targets found.
Nov 18 18:46:51 user nova-compute[74692]: iSNS:
Nov 18 18:46:51 user nova-compute[74692]: No targets found.
Nov 18 18:46:51 user nova-compute[74692]: STATIC:
Nov 18 18:46:51 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0
Nov 18 18:46:51 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:46:51 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:46:51 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90
Nov 18 18:46:51 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:46:51 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:46:51 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305
Nov 18 18:46:51 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:46:51 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:46:51 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:46:51 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:46:51 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:46:51 user nova-compute[74692]: FIRMWARE:
Nov 18 18:46:51 user nova-compute[74692]: No targets found.
Nov 18 18:46:51 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:46:51 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:46:51 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce398040-ca7f-4d95-a18a-677948225d65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2058c26c-4fbc-4e7b-ba41-a1c3f7eeb2a1]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:46:51 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:46:51 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:46:51 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:46:51 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:46:51 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:46:51 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:46:51 user nova-compute[74692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:46:51 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a4784940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305'): ({'sde'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Removing single pathed devices sde {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[133ea997-a490-4254-a77e-ee0deab417ac]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f4b923-e7ad-44da-ad49-deb62a02564e]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Flushing IO for device /dev/sde {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8a5f92-280c-4c60-b5eb-23499e0665f5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[87486351-79b4-4ff0-9e46-7a5e42e6447e]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] SCSI volumes sde have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7476e4ad-5f7d-4c44-96e5-7a79e7cd2ba5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a081f767-faf3-44f2-9b1b-a399b71cd6e4]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260]
Nov 18 18:46:52 user nova-compute[74692]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260] successful.
Nov 18 18:46:52 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6444d27-b58f-49e8-98f6-1c769a02ed40]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] <== disconnect_volume: return (315ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:46:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:46:53 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Port 279d81c2-cb3c-4e20-9daf-e418dbb20a2a binding to destination host user is already ACTIVE {{(pid=74692) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 18 18:46:53 user nova-compute[74692]: DEBUG nova.compute.manager [req-99595e7f-25e8-44bc-bdb6-329858d63a49 req-b9d70495-5075-4834-a70c-1c14d43287bf service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received event network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:46:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-99595e7f-25e8-44bc-bdb6-329858d63a49 req-b9d70495-5075-4834-a70c-1c14d43287bf service nova] Acquiring lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-99595e7f-25e8-44bc-bdb6-329858d63a49 req-b9d70495-5075-4834-a70c-1c14d43287bf service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-99595e7f-25e8-44bc-bdb6-329858d63a49 req-b9d70495-5075-4834-a70c-1c14d43287bf service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:53 user nova-compute[74692]: DEBUG nova.compute.manager [req-99595e7f-25e8-44bc-bdb6-329858d63a49 req-b9d70495-5075-4834-a70c-1c14d43287bf service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] No waiting events found dispatching network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:46:53 user nova-compute[74692]: WARNING nova.compute.manager [req-99595e7f-25e8-44bc-bdb6-329858d63a49 req-b9d70495-5075-4834-a70c-1c14d43287bf service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received unexpected event network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a for instance with vm_state active and task_state resize_migrating.
Nov 18 18:46:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:46:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquired lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:46:53 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:46:53 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Updating instance_info_cache with network_info: [{"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:46:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Releasing lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG os_brick.utils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[add06906-29e1-480c-ac88-13f07c053705]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e87fad-fcd8-40b3-951c-7b024823a083]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f48ae9-67b9-4fdf-8481-fce7cdccb2c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[caeb07de-4881-4b39-a7c6-c39d25ae3ed5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:46:54 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:46:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56bd6e0-6e47-45df-8975-7cfc473c6614]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:46:54 user nova-compute[74692]: DEBUG os_brick.utils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:46:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:46:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Starting finish_migration {{(pid=74692) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 18 18:46:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Instance directory exists: not creating {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 18:46:59 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Creating image(s)
Nov 18 18:46:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 18:46:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Ensure instance console log exists: /opt/stack/data/nova/instances/7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:46:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:46:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:46:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:46:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Start _get_guest_xml network_info=[{"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-975479299-network", "vif_mac": "fa:16:3e:7c:a6:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIgfzFya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d', 'attached_at': '2023-11-18T18:47:00.000000', 'detached_at': '', 'volume_id': '0ca057ef-6541-4082-aa0e-662f53f9a305', 'serial': '0ca057ef-6541-4082-aa0e-662f53f9a305'}, 'attachment_id': '558cc35e-c0fb-443b-b5d9-dc8a4d726cd6', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:46:59 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:46:59 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:46:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:46:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIgfzFya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:47:00 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:47:00 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:47:00 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90ccae4-5738-4b16-9b15-2d9cd5c1b82a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:47:00 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1fcc8d-4603-44d8-9e1e-8fef71629913]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305] added
Nov 18 18:47:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe48480-617f-4b06-b804-e99dc09a5c3f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[471b8b4c-270c-4b2a-a813-c8c947e9164c]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIgfzFya {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIgfzFya" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a49e7bd-ab94-439d-aa4c-57b30302bc93]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rIgfzFya'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee40550a-b95c-41a2-b2ea-640033b0bc0c]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[961b5e3a-cca0-4052-be07-ca2c633f0988]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:47:00 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:47:00 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:47:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:47:00 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:47:00 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:47:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4dbdb2-cb4b-4267-9741-526d1f3b3892]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260]
Nov 18 18:47:00 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260] successful.
Nov 18 18:47:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[135a9825-88ff-4871-9ac3-be4beceaef1b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f267d2-7755-4515-a975-c11446dbdfd3]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:47:00 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:47:00 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:47:00 user nova-compute[74692]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:47:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:47:00 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:47:00 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:47:00 user nova-compute[74692]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:47:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aad7058-0ce3-450f-802c-d55bf7551b27]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIgfzFya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:47:00 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 is timed out.
Nov 18 18:47:00 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Successfully detached device vdb from instance 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 from the live domain config.
Nov 18 18:47:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smvOIzSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:47:00 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:47:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26663633466306166', 'path': '/dev/sde'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663633466306166', 'path': '/dev/sde'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.958s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-706612544',display_name='tempest-ServerActionsTestOtherA-server-706612544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-706612544',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaznf7JGrfMrJRV86vaxqKuCfM3AcEaoWdApdT43PQu2+VRfP7TdWdgnZDzhSHo94Y2Q6y7Dc8YLTCn+JC1yHxyJqY3YZNW3EenEWfmQ3/zXDAHD9n+p1yEmT0Bxd5Ldw==',key_name='tempest-keypair-1438330061',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:45:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fdb006c6267b42fab703cfc24d93052e',ramdisk_id='',reservation_id='r-0k8ny0uk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2047740053',owner_user_name='tempest-ServerActionsTestOtherA-2047740053-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d126349e69864417bb5e02666efd534c',uuid=7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-975479299-network", "vif_mac": "fa:16:3e:7c:a6:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converting VIF {"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-975479299-network", "vif_mac": "fa:16:3e:7c:a6:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=279d81c2-cb3c-4e20-9daf-e418dbb20a2a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap279d81c2-cb') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:47:01 user nova-compute[74692]:   <uuid>7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d</uuid>
Nov 18 18:47:01 user nova-compute[74692]:   <name>instance-00000022</name>
Nov 18 18:47:01 user nova-compute[74692]:   <memory>2097152</memory>
Nov 18 18:47:01 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:47:01 user nova-compute[74692]:   <metadata>
Nov 18 18:47:01 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:47:01 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:47:01 user nova-compute[74692]:       <nova:name>tempest-ServerActionsTestOtherA-server-706612544</nova:name>
Nov 18 18:47:01 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:46:59</nova:creationTime>
Nov 18 18:47:01 user nova-compute[74692]:       <nova:flavor name="m1.small">
Nov 18 18:47:01 user nova-compute[74692]:         <nova:memory>2048</nova:memory>
Nov 18 18:47:01 user nova-compute[74692]:         <nova:disk>20</nova:disk>
Nov 18 18:47:01 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:47:01 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:47:01 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:47:01 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:47:01 user nova-compute[74692]:       <nova:owner>
Nov 18 18:47:01 user nova-compute[74692]:         <nova:user uuid="d126349e69864417bb5e02666efd534c">tempest-ServerActionsTestOtherA-2047740053-project-member</nova:user>
Nov 18 18:47:01 user nova-compute[74692]:         <nova:project uuid="fdb006c6267b42fab703cfc24d93052e">tempest-ServerActionsTestOtherA-2047740053</nova:project>
Nov 18 18:47:01 user nova-compute[74692]:       </nova:owner>
Nov 18 18:47:01 user nova-compute[74692]:       <nova:ports>
Nov 18 18:47:01 user nova-compute[74692]:         <nova:port uuid="279d81c2-cb3c-4e20-9daf-e418dbb20a2a">
Nov 18 18:47:01 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 18:47:01 user nova-compute[74692]:         </nova:port>
Nov 18 18:47:01 user nova-compute[74692]:       </nova:ports>
Nov 18 18:47:01 user nova-compute[74692]:     </nova:instance>
Nov 18 18:47:01 user nova-compute[74692]:   </metadata>
Nov 18 18:47:01 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:47:01 user nova-compute[74692]:     <system>
Nov 18 18:47:01 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:47:01 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:47:01 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:47:01 user nova-compute[74692]:       <entry name="serial">7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d</entry>
Nov 18 18:47:01 user nova-compute[74692]:       <entry name="uuid">7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d</entry>
Nov 18 18:47:01 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:47:01 user nova-compute[74692]:     </system>
Nov 18 18:47:01 user nova-compute[74692]:   </sysinfo>
Nov 18 18:47:01 user nova-compute[74692]:   <os>
Nov 18 18:47:01 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:47:01 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:47:01 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:47:01 user nova-compute[74692]:   </os>
Nov 18 18:47:01 user nova-compute[74692]:   <features>
Nov 18 18:47:01 user nova-compute[74692]:     <acpi/>
Nov 18 18:47:01 user nova-compute[74692]:     <apic/>
Nov 18 18:47:01 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:47:01 user nova-compute[74692]:   </features>
Nov 18 18:47:01 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:47:01 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:47:01 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:47:01 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:47:01 user nova-compute[74692]:   </clock>
Nov 18 18:47:01 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:47:01 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:47:01 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:47:01 user nova-compute[74692]:   </cpu>
Nov 18 18:47:01 user nova-compute[74692]:   <devices>
Nov 18 18:47:01 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:47:01 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:47:01 user nova-compute[74692]:       <source dev="/dev/sde"/>
Nov 18 18:47:01 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:47:01 user nova-compute[74692]:       <serial>0ca057ef-6541-4082-aa0e-662f53f9a305</serial>
Nov 18 18:47:01 user nova-compute[74692]:     </disk>
Nov 18 18:47:01 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:47:01 user nova-compute[74692]:       <mac address="fa:16:3e:7c:a6:af"/>
Nov 18 18:47:01 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:47:01 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:47:01 user nova-compute[74692]:       <target dev="tap279d81c2-cb"/>
Nov 18 18:47:01 user nova-compute[74692]:     </interface>
Nov 18 18:47:01 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:47:01 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d/console.log" append="off"/>
Nov 18 18:47:01 user nova-compute[74692]:     </serial>
Nov 18 18:47:01 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:47:01 user nova-compute[74692]:     <video>
Nov 18 18:47:01 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:47:01 user nova-compute[74692]:     </video>
Nov 18 18:47:01 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:47:01 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:47:01 user nova-compute[74692]:     </rng>
Nov 18 18:47:01 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:47:01 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:47:01 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:47:01 user nova-compute[74692]:     </memballoon>
Nov 18 18:47:01 user nova-compute[74692]:   </devices>
Nov 18 18:47:01 user nova-compute[74692]: </domain>
Nov 18 18:47:01 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-706612544',display_name='tempest-ServerActionsTestOtherA-server-706612544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-706612544',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaznf7JGrfMrJRV86vaxqKuCfM3AcEaoWdApdT43PQu2+VRfP7TdWdgnZDzhSHo94Y2Q6y7Dc8YLTCn+JC1yHxyJqY3YZNW3EenEWfmQ3/zXDAHD9n+p1yEmT0Bxd5Ldw==',key_name='tempest-keypair-1438330061',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:45:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fdb006c6267b42fab703cfc24d93052e',ramdisk_id='',reservation_id='r-0k8ny0uk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2047740053',owner_user_name='tempest-ServerActionsTestOtherA-2047740053-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d126349e69864417bb5e02666efd534c',uuid=7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-975479299-network", "vif_mac": "fa:16:3e:7c:a6:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converting VIF {"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-975479299-network", "vif_mac": "fa:16:3e:7c:a6:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=279d81c2-cb3c-4e20-9daf-e418dbb20a2a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap279d81c2-cb') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_vif [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=279d81c2-cb3c-4e20-9daf-e418dbb20a2a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap279d81c2-cb') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f71efd-8961-4ffd-93bb-f45440b3ed1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:47:01 user nova-compute[74692]: No targets found.
Nov 18 18:47:01 user nova-compute[74692]: iSNS:
Nov 18 18:47:01 user nova-compute[74692]: No targets found.
Nov 18 18:47:01 user nova-compute[74692]: STATIC:
Nov 18 18:47:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0
Nov 18 18:47:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:47:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:47:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90
Nov 18 18:47:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:47:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:47:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305
Nov 18 18:47:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:47:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:47:01 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:47:01 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:47:01 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:47:01 user nova-compute[74692]: FIRMWARE:
Nov 18 18:47:01 user nova-compute[74692]: No targets found.
Nov 18 18:47:01 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:47:01 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:47:01 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25555126-35c9-55d0-aa6e-d45905870950', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap279d81c2-cb, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap279d81c2-cb, col_values=(('qos', UUID('ba25c4a4-aade-42fe-9dd8-a48e942fb882')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap279d81c2-cb, col_values=(('external_ids', {'iface-id': '279d81c2-cb3c-4e20-9daf-e418dbb20a2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:a6:af', 'vm-uuid': '7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a713c3d5-885a-494d-adc2-7904968132f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:01 user nova-compute[74692]: INFO os_vif [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=279d81c2-cb3c-4e20-9daf-e418dbb20a2a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap279d81c2-cb')
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65206c4-fdc2-45d3-96e6-b3cb49a7acae]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:47:01 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:47:01 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:47:01 user nova-compute[74692]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:47:01 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:47:01 user nova-compute[74692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 (non-flash)
Nov 18 18:47:01 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:47:01 user nova-compute[74692]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:47:01 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c43cc670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90'): ({'sdc'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Removing single pathed devices sdc {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[707a1a72-0d1b-4beb-b507-d0e81814df3a]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] No VIF found with MAC fa:16:3e:7c:a6:af, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8243b0-2986-4acb-84d3-c19ca397a88b]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Flushing IO for device /dev/sdc {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5de06a-6207-4a5d-a410-2f5b1a2d27bb]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddb3f6c-76f3-4d88-898e-bb0ee01b89f8]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb927c36-1df7-4b71-9719-ee4b59407ac0]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ace58be-17f9-4c9a-8188-74107707f1e5]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90, portal: 172.16.0.220,3260]
Nov 18 18:47:01 user nova-compute[74692]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90, portal: 172.16.0.220,3260] successful.
Nov 18 18:47:01 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:182bad63-5b54-4cc9-bd85-321759669d90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dcca28-613b-45a6-b834-c1b0b0759f1d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] <== disconnect_volume: return (1265ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:47:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:47:02 user nova-compute[74692]: DEBUG nova.objects.instance [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'flavor' on Instance uuid 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:47:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bdf4a355-ef7b-4633-966f-2cb61f897724 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.664s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:47:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-a9932660-9996-4c1f-8a0e-8765614fa711 req-e81bf61a-4507-4675-a036-7613d03d0180 service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received event network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:47:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a9932660-9996-4c1f-8a0e-8765614fa711 req-e81bf61a-4507-4675-a036-7613d03d0180 service nova] Acquiring lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:47:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a9932660-9996-4c1f-8a0e-8765614fa711 req-e81bf61a-4507-4675-a036-7613d03d0180 service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:47:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a9932660-9996-4c1f-8a0e-8765614fa711 req-e81bf61a-4507-4675-a036-7613d03d0180 service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:47:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-a9932660-9996-4c1f-8a0e-8765614fa711 req-e81bf61a-4507-4675-a036-7613d03d0180 service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] No waiting events found dispatching network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:47:02 user nova-compute[74692]: WARNING nova.compute.manager [req-a9932660-9996-4c1f-8a0e-8765614fa711 req-e81bf61a-4507-4675-a036-7613d03d0180 service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received unexpected event network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a for instance with vm_state active and task_state resize_finish.
Nov 18 18:47:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:04 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:47:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Instance running successfully.
Nov 18 18:47:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Failed to set time: agent not configured {{(pid=74692) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 18 18:47:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f114dd8-2ca9-4aac-a130-0e2642129229 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] finish_migration finished successfully. {{(pid=74692) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 18 18:47:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-5e996977-04aa-4760-b695-c8ee4100bfc5 req-98134212-a8f5-4044-adc3-ab3873d53b6a service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received event network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:47:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5e996977-04aa-4760-b695-c8ee4100bfc5 req-98134212-a8f5-4044-adc3-ab3873d53b6a service nova] Acquiring lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:47:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5e996977-04aa-4760-b695-c8ee4100bfc5 req-98134212-a8f5-4044-adc3-ab3873d53b6a service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:47:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5e996977-04aa-4760-b695-c8ee4100bfc5 req-98134212-a8f5-4044-adc3-ab3873d53b6a service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:47:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-5e996977-04aa-4760-b695-c8ee4100bfc5 req-98134212-a8f5-4044-adc3-ab3873d53b6a service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] No waiting events found dispatching network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:47:04 user nova-compute[74692]: WARNING nova.compute.manager [req-5e996977-04aa-4760-b695-c8ee4100bfc5 req-98134212-a8f5-4044-adc3-ab3873d53b6a service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received unexpected event network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a for instance with vm_state active and task_state resize_finish.
Nov 18 18:47:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:20 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:47:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:47:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:21 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:47:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:47:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:47:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:47:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:47:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:47:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:47:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:47:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:47:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:47:25 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:47:25 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:47:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=7850MB free_disk=24.84402847290039GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:47:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:47:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:47:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Applying migration context for instance 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d as it has an incoming, in-progress migration d98a2570-e78f-4fce-b8aa-c43a238a86f4. Migration status is finished {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 18 18:47:25 user nova-compute[74692]: INFO nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Updating resource usage from migration d98a2570-e78f-4fce-b8aa-c43a238a86f4
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 30beb8e4-0363-41e0-8089-04bef2539f4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 102ba990-07fc-47ba-9abb-781423525369 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Migration d98a2570-e78f-4fce-b8aa-c43a238a86f4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:47:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:47:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:47:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:47:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:47:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:47:30 user nova-compute[74692]: INFO nova.compute.manager [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Terminating instance
Nov 18 18:47:30 user nova-compute[74692]: DEBUG nova.compute.manager [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-ebc25a4b-7cd0-45f3-ac2f-91bf2673e5fa req-37cddce2-f0c9-45f6-a377-b51c0136b25e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-unplugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ebc25a4b-7cd0-45f3-ac2f-91bf2673e5fa req-37cddce2-f0c9-45f6-a377-b51c0136b25e service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ebc25a4b-7cd0-45f3-ac2f-91bf2673e5fa req-37cddce2-f0c9-45f6-a377-b51c0136b25e service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ebc25a4b-7cd0-45f3-ac2f-91bf2673e5fa req-37cddce2-f0c9-45f6-a377-b51c0136b25e service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-ebc25a4b-7cd0-45f3-ac2f-91bf2673e5fa req-37cddce2-f0c9-45f6-a377-b51c0136b25e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-unplugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-ebc25a4b-7cd0-45f3-ac2f-91bf2673e5fa req-37cddce2-f0c9-45f6-a377-b51c0136b25e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-unplugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Instance destroyed successfully.
Nov 18 18:47:30 user nova-compute[74692]: DEBUG nova.objects.instance [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'resources' on Instance uuid 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1487096690',display_name='tempest-ServerRescueNegativeTestJSON-server-1487096690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1487096690',id=28,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEw+cVbulXbMuVK2CD9909l6Wk27f732QqQYNxb/cZ8LjOheZfWfZ4b3pLTykV+g9E+jAQ6kGP+34RpsAwlFznuDTUI4GQQ0cT4TK0osf9l/aOh+KcLPyI0ky+EcglrOkA==',key_name='tempest-keypair-1382011767',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:43:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fead685ad47d4e96bb7c5225029f82ce',ramdisk_id='',reservation_id='r-lofdmcfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-88342386',owner_user_name='tempest-ServerRescueNegativeTestJSON-88342386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c418956015544fb8ac0a8acb6af6aacd',uuid=67a67f8d-b4f3-4d34-b4d8-ac16b1145180,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converting VIF {"id": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "address": "fa:16:3e:e1:70:8c", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3106847-e6", "ovs_interfaceid": "a3106847-e69a-4753-b6d9-7e0dd00a58ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a3106847-e69a-4753-b6d9-7e0dd00a58ab,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3106847-e6') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG os_vif [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a3106847-e69a-4753-b6d9-7e0dd00a58ab,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3106847-e6') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3106847-e6, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99387a61-8fe7-41fc-9187-51d072b4a943) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:30 user nova-compute[74692]: INFO os_vif [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a3106847-e69a-4753-b6d9-7e0dd00a58ab,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3106847-e6')
Nov 18 18:47:30 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Deleting instance files /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180_del
Nov 18 18:47:30 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Deletion of /opt/stack/data/nova/instances/67a67f8d-b4f3-4d34-b4d8-ac16b1145180_del complete
Nov 18 18:47:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:47:30 user nova-compute[74692]: INFO nova.compute.manager [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 18 18:47:30 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:47:30 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:47:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-30beb8e4-0363-41e0-8089-04bef2539f4d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:47:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-30beb8e4-0363-41e0-8089-04bef2539f4d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:47:31 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:47:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:31 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Updating instance_info_cache with network_info: [{"id": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "address": "fa:16:3e:13:6d:73", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f50121f-e3", "ovs_interfaceid": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:47:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-30beb8e4-0363-41e0-8089-04bef2539f4d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:47:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:47:31 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:47:32 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Took 1.04 seconds to deallocate network for instance.
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-8abc0415-f719-4fe6-8b01-6366d78be76e req-de334439-d55f-4d23-9ade-540e64b59c3b service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-deleted-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:47:32 user nova-compute[74692]: INFO nova.compute.manager [req-8abc0415-f719-4fe6-8b01-6366d78be76e req-de334439-d55f-4d23-9ade-540e64b59c3b service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Neutron deleted interface a3106847-e69a-4753-b6d9-7e0dd00a58ab; detaching it from the instance and deleting it from the info cache
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.network.neutron [req-8abc0415-f719-4fe6-8b01-6366d78be76e req-de334439-d55f-4d23-9ade-540e64b59c3b service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-8abc0415-f719-4fe6-8b01-6366d78be76e req-de334439-d55f-4d23-9ade-540e64b59c3b service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Detach interface failed, port_id=a3106847-e69a-4753-b6d9-7e0dd00a58ab, reason: Instance 67a67f8d-b4f3-4d34-b4d8-ac16b1145180 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:47:32 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Deleted allocations for instance 67a67f8d-b4f3-4d34-b4d8-ac16b1145180
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-58232355-0934-4cd2-b190-8a2651a88e92 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.415s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:47:32 user nova-compute[74692]: WARNING nova.compute.manager [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received unexpected event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with vm_state deleted and task_state None.
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:47:32 user nova-compute[74692]: WARNING nova.compute.manager [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received unexpected event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with vm_state deleted and task_state None.
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:47:32 user nova-compute[74692]: WARNING nova.compute.manager [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received unexpected event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with vm_state deleted and task_state None.
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-unplugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-unplugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:47:32 user nova-compute[74692]: WARNING nova.compute.manager [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received unexpected event network-vif-unplugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with vm_state deleted and task_state None.
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] Acquiring lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] Lock "67a67f8d-b4f3-4d34-b4d8-ac16b1145180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:47:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] No waiting events found dispatching network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:47:32 user nova-compute[74692]: WARNING nova.compute.manager [req-91365415-184e-4987-abe8-633f7874c786 req-4fa950d6-0a11-4d1a-9b0c-14202c5b9f5e service nova] [instance: 67a67f8d-b4f3-4d34-b4d8-ac16b1145180] Received unexpected event network-vif-plugged-a3106847-e69a-4753-b6d9-7e0dd00a58ab for instance with vm_state deleted and task_state None.
Nov 18 18:47:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:47:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:47:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 18:47:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:47:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:47:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:47:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:47:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:48:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 18:48:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:48:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:48:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "30beb8e4-0363-41e0-8089-04bef2539f4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "30beb8e4-0363-41e0-8089-04bef2539f4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:11 user nova-compute[74692]: INFO nova.compute.manager [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Terminating instance
Nov 18 18:48:11 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:48:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG nova.compute.manager [req-e6a359d3-f18a-4dbd-a5ba-73dd07d72288 req-e8f15cd7-5654-4b4c-881c-7ee691eeac30 service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Received event network-vif-unplugged-6f50121f-e38b-4e98-a37f-a9f272ded70a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e6a359d3-f18a-4dbd-a5ba-73dd07d72288 req-e8f15cd7-5654-4b4c-881c-7ee691eeac30 service nova] Acquiring lock "30beb8e4-0363-41e0-8089-04bef2539f4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e6a359d3-f18a-4dbd-a5ba-73dd07d72288 req-e8f15cd7-5654-4b4c-881c-7ee691eeac30 service nova] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e6a359d3-f18a-4dbd-a5ba-73dd07d72288 req-e8f15cd7-5654-4b4c-881c-7ee691eeac30 service nova] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG nova.compute.manager [req-e6a359d3-f18a-4dbd-a5ba-73dd07d72288 req-e8f15cd7-5654-4b4c-881c-7ee691eeac30 service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] No waiting events found dispatching network-vif-unplugged-6f50121f-e38b-4e98-a37f-a9f272ded70a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG nova.compute.manager [req-e6a359d3-f18a-4dbd-a5ba-73dd07d72288 req-e8f15cd7-5654-4b4c-881c-7ee691eeac30 service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Received event network-vif-unplugged-6f50121f-e38b-4e98-a37f-a9f272ded70a for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:48:12 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Instance destroyed successfully.
Nov 18 18:48:12 user nova-compute[74692]: DEBUG nova.objects.instance [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lazy-loading 'resources' on Instance uuid 30beb8e4-0363-41e0-8089-04bef2539f4d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2092295282',display_name='tempest-ServersNegativeTestJSON-server-2092295282',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2092295282',id=27,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:39:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e2df1316b5841adb2eadb476e70fcb1',ramdisk_id='',reservation_id='r-th6l80oi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1078755651',owner_user_name='tempest-ServersNegativeTestJSON-1078755651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:39:34Z,user_data=None,user_id='b4286ee787ba4de8b4318f8e14259b52',uuid=30beb8e4-0363-41e0-8089-04bef2539f4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "address": "fa:16:3e:13:6d:73", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f50121f-e3", "ovs_interfaceid": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Converting VIF {"id": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "address": "fa:16:3e:13:6d:73", "network": {"id": "096fe7c9-e167-4c06-a783-984e868249dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1206350052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e2df1316b5841adb2eadb476e70fcb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f50121f-e3", "ovs_interfaceid": "6f50121f-e38b-4e98-a37f-a9f272ded70a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:6d:73,bridge_name='br-int',has_traffic_filtering=True,id=6f50121f-e38b-4e98-a37f-a9f272ded70a,network=Network(096fe7c9-e167-4c06-a783-984e868249dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f50121f-e3') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG os_vif [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6d:73,bridge_name='br-int',has_traffic_filtering=True,id=6f50121f-e38b-4e98-a37f-a9f272ded70a,network=Network(096fe7c9-e167-4c06-a783-984e868249dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f50121f-e3') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f50121f-e3, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=221a3d3a-2a5c-4229-9d99-7f5f539b8b98) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:12 user nova-compute[74692]: INFO os_vif [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6d:73,bridge_name='br-int',has_traffic_filtering=True,id=6f50121f-e38b-4e98-a37f-a9f272ded70a,network=Network(096fe7c9-e167-4c06-a783-984e868249dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f50121f-e3')
Nov 18 18:48:12 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Deleting instance files /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d_del
Nov 18 18:48:12 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Deletion of /opt/stack/data/nova/instances/30beb8e4-0363-41e0-8089-04bef2539f4d_del complete
Nov 18 18:48:12 user nova-compute[74692]: INFO nova.compute.manager [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 18 18:48:12 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:48:12 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:48:13 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:48:13 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Took 0.48 seconds to deallocate network for instance.
Nov 18 18:48:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:13 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:48:13 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:48:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:13 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Deleted allocations for instance 30beb8e4-0363-41e0-8089-04bef2539f4d
Nov 18 18:48:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2a16715f-9705-4863-9d7b-daffc2e2a818 tempest-ServersNegativeTestJSON-1078755651 tempest-ServersNegativeTestJSON-1078755651-project-member] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.930s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-5dbedfa8-aa6f-4f95-9812-f33ef735fbde req-492a6cf7-24b5-4f4a-b02d-05d39781a88b service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Received event network-vif-plugged-6f50121f-e38b-4e98-a37f-a9f272ded70a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:48:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5dbedfa8-aa6f-4f95-9812-f33ef735fbde req-492a6cf7-24b5-4f4a-b02d-05d39781a88b service nova] Acquiring lock "30beb8e4-0363-41e0-8089-04bef2539f4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5dbedfa8-aa6f-4f95-9812-f33ef735fbde req-492a6cf7-24b5-4f4a-b02d-05d39781a88b service nova] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5dbedfa8-aa6f-4f95-9812-f33ef735fbde req-492a6cf7-24b5-4f4a-b02d-05d39781a88b service nova] Lock "30beb8e4-0363-41e0-8089-04bef2539f4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-5dbedfa8-aa6f-4f95-9812-f33ef735fbde req-492a6cf7-24b5-4f4a-b02d-05d39781a88b service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] No waiting events found dispatching network-vif-plugged-6f50121f-e38b-4e98-a37f-a9f272ded70a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:48:14 user nova-compute[74692]: WARNING nova.compute.manager [req-5dbedfa8-aa6f-4f95-9812-f33ef735fbde req-492a6cf7-24b5-4f4a-b02d-05d39781a88b service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Received unexpected event network-vif-plugged-6f50121f-e38b-4e98-a37f-a9f272ded70a for instance with vm_state deleted and task_state None.
Nov 18 18:48:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-5dbedfa8-aa6f-4f95-9812-f33ef735fbde req-492a6cf7-24b5-4f4a-b02d-05d39781a88b service nova] [instance: 30beb8e4-0363-41e0-8089-04bef2539f4d] Received event network-vif-deleted-6f50121f-e38b-4e98-a37f-a9f272ded70a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:48:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:21 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:48:21 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:48:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:21 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:48:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:48:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:48:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:48:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:48:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:48:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:48:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:48:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:48:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:48:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:48:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:48:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:48:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:48:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:48:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:48:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:48:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:48:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:48:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:48:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:48:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:48:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:48:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:48:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:48:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:48:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:48:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:48:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:48:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:48:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:48:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:48:25 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:48:25 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8226MB free_disk=24.88105010986328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Applying migration context for instance 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d as it has an incoming, in-progress migration d98a2570-e78f-4fce-b8aa-c43a238a86f4. Migration status is finished {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 18 18:48:25 user nova-compute[74692]: INFO nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Updating resource usage from migration d98a2570-e78f-4fce-b8aa-c43a238a86f4
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d949d403-0a45-48bc-b64a-f63b114d1944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 102ba990-07fc-47ba-9abb-781423525369 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Migration d98a2570-e78f-4fce-b8aa-c43a238a86f4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:48:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.510s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "d949d403-0a45-48bc-b64a-f63b114d1944" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "d949d403-0a45-48bc-b64a-f63b114d1944" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:26 user nova-compute[74692]: INFO nova.compute.manager [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Terminating instance
Nov 18 18:48:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:48:26 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:48:26 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:48:26 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:48:26 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:48:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:48:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:26 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-2f91fa1c-09c2-4d64-a1dd-3561c6f32aae req-f5dac711-08ac-4103-a9a9-472d75e1a6a1 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received event network-vif-unplugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2f91fa1c-09c2-4d64-a1dd-3561c6f32aae req-f5dac711-08ac-4103-a9a9-472d75e1a6a1 service nova] Acquiring lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2f91fa1c-09c2-4d64-a1dd-3561c6f32aae req-f5dac711-08ac-4103-a9a9-472d75e1a6a1 service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2f91fa1c-09c2-4d64-a1dd-3561c6f32aae req-f5dac711-08ac-4103-a9a9-472d75e1a6a1 service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-2f91fa1c-09c2-4d64-a1dd-3561c6f32aae req-f5dac711-08ac-4103-a9a9-472d75e1a6a1 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] No waiting events found dispatching network-vif-unplugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-2f91fa1c-09c2-4d64-a1dd-3561c6f32aae req-f5dac711-08ac-4103-a9a9-472d75e1a6a1 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received event network-vif-unplugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:27 user nova-compute[74692]: INFO nova.compute.manager [None req-c8323b74-630a-47e1-9832-e6fbc2508311 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Unrescuing
Nov 18 18:48:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c8323b74-630a-47e1-9832-e6fbc2508311 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "refresh_cache-102ba990-07fc-47ba-9abb-781423525369" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c8323b74-630a-47e1-9832-e6fbc2508311 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquired lock "refresh_cache-102ba990-07fc-47ba-9abb-781423525369" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c8323b74-630a-47e1-9832-e6fbc2508311 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:48:27 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Instance destroyed successfully.
Nov 18 18:48:27 user nova-compute[74692]: DEBUG nova.objects.instance [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'resources' on Instance uuid d949d403-0a45-48bc-b64a-f63b114d1944 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-32162393',display_name='tempest-ServerRescueNegativeTestJSON-server-32162393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-32162393',id=15,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:34:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fead685ad47d4e96bb7c5225029f82ce',ramdisk_id='',reservation_id='r-7p8a4cme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-88342386',owner_user_name='tempest-ServerRescueNegativeTestJSON-88342386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:34:21Z,user_data=None,user_id='c418956015544fb8ac0a8acb6af6aacd',uuid=d949d403-0a45-48bc-b64a-f63b114d1944,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converting VIF {"id": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "address": "fa:16:3e:cc:41:ab", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8afbd9d-a9", "ovs_interfaceid": "e8afbd9d-a907-4180-9db9-9eee0652b0f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:41:ab,bridge_name='br-int',has_traffic_filtering=True,id=e8afbd9d-a907-4180-9db9-9eee0652b0f9,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8afbd9d-a9') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG os_vif [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:41:ab,bridge_name='br-int',has_traffic_filtering=True,id=e8afbd9d-a907-4180-9db9-9eee0652b0f9,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8afbd9d-a9') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8afbd9d-a9, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efd1e4a6-2afb-430b-a532-b4ab5632dd39) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:27 user nova-compute[74692]: INFO os_vif [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:41:ab,bridge_name='br-int',has_traffic_filtering=True,id=e8afbd9d-a907-4180-9db9-9eee0652b0f9,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8afbd9d-a9')
Nov 18 18:48:27 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Deleting instance files /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944_del
Nov 18 18:48:27 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Deletion of /opt/stack/data/nova/instances/d949d403-0a45-48bc-b64a-f63b114d1944_del complete
Nov 18 18:48:27 user nova-compute[74692]: INFO nova.compute.manager [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 18 18:48:27 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c8323b74-630a-47e1-9832-e6fbc2508311 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Updating instance_info_cache with network_info: [{"id": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "address": "fa:16:3e:fe:c8:c4", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef69d29-64", "ovs_interfaceid": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c8323b74-630a-47e1-9832-e6fbc2508311 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Releasing lock "refresh_cache-102ba990-07fc-47ba-9abb-781423525369" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c8323b74-630a-47e1-9832-e6fbc2508311 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'flavor' on Instance uuid 102ba990-07fc-47ba-9abb-781423525369 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:48:27 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:48:27 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Took 0.50 seconds to deallocate network for instance.
Nov 18 18:48:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-959e4ae1-75eb-4e7c-96b0-9801d94b0bbc req-a0cccb26-63fa-4d0e-95eb-f3c4869f52e1 service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received event network-vif-deleted-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:48:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-b5427280-8b35-43a5-b156-365276e1c578 req-bd3e31ba-07f4-45b1-b310-9b83aaf130c3 service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received event network-vif-unplugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:48:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b5427280-8b35-43a5-b156-365276e1c578 req-bd3e31ba-07f4-45b1-b310-9b83aaf130c3 service nova] Acquiring lock "102ba990-07fc-47ba-9abb-781423525369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b5427280-8b35-43a5-b156-365276e1c578 req-bd3e31ba-07f4-45b1-b310-9b83aaf130c3 service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b5427280-8b35-43a5-b156-365276e1c578 req-bd3e31ba-07f4-45b1-b310-9b83aaf130c3 service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-b5427280-8b35-43a5-b156-365276e1c578 req-bd3e31ba-07f4-45b1-b310-9b83aaf130c3 service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] No waiting events found dispatching network-vif-unplugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:48:28 user nova-compute[74692]: WARNING nova.compute.manager [req-b5427280-8b35-43a5-b156-365276e1c578 req-bd3e31ba-07f4-45b1-b310-9b83aaf130c3 service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received unexpected event network-vif-unplugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:48:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:28 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:48:28 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:48:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.612s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:28 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 102ba990-07fc-47ba-9abb-781423525369] Instance destroyed successfully.
Nov 18 18:48:28 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Deleted allocations for instance d949d403-0a45-48bc-b64a-f63b114d1944
Nov 18 18:48:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-bed4e1fc-ee3b-455d-9002-0553f8533074 tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "d949d403-0a45-48bc-b64a-f63b114d1944" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.073s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:48:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-0fac4e74-cb20-47c4-b8b5-fcbfd23a2e75 req-346e9678-2e25-486a-8117-5659b157074b service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received event network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:48:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0fac4e74-cb20-47c4-b8b5-fcbfd23a2e75 req-346e9678-2e25-486a-8117-5659b157074b service nova] Acquiring lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0fac4e74-cb20-47c4-b8b5-fcbfd23a2e75 req-346e9678-2e25-486a-8117-5659b157074b service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0fac4e74-cb20-47c4-b8b5-fcbfd23a2e75 req-346e9678-2e25-486a-8117-5659b157074b service nova] Lock "d949d403-0a45-48bc-b64a-f63b114d1944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-0fac4e74-cb20-47c4-b8b5-fcbfd23a2e75 req-346e9678-2e25-486a-8117-5659b157074b service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] No waiting events found dispatching network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:48:29 user nova-compute[74692]: WARNING nova.compute.manager [req-0fac4e74-cb20-47c4-b8b5-fcbfd23a2e75 req-346e9678-2e25-486a-8117-5659b157074b service nova] [instance: d949d403-0a45-48bc-b64a-f63b114d1944] Received unexpected event network-vif-plugged-e8afbd9d-a907-4180-9db9-9eee0652b0f9 for instance with vm_state deleted and task_state None.
Nov 18 18:48:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-9654962c-2512-45c0-a99d-e64d2fd7c13e req-9483ddcb-926b-42eb-8775-87b2a30523ee service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:48:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9654962c-2512-45c0-a99d-e64d2fd7c13e req-9483ddcb-926b-42eb-8775-87b2a30523ee service nova] Acquiring lock "102ba990-07fc-47ba-9abb-781423525369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9654962c-2512-45c0-a99d-e64d2fd7c13e req-9483ddcb-926b-42eb-8775-87b2a30523ee service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9654962c-2512-45c0-a99d-e64d2fd7c13e req-9483ddcb-926b-42eb-8775-87b2a30523ee service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-9654962c-2512-45c0-a99d-e64d2fd7c13e req-9483ddcb-926b-42eb-8775-87b2a30523ee service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] No waiting events found dispatching network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:48:30 user nova-compute[74692]: WARNING nova.compute.manager [req-9654962c-2512-45c0-a99d-e64d2fd7c13e req-9483ddcb-926b-42eb-8775-87b2a30523ee service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received unexpected event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:48:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-9654962c-2512-45c0-a99d-e64d2fd7c13e req-9483ddcb-926b-42eb-8775-87b2a30523ee service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:48:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9654962c-2512-45c0-a99d-e64d2fd7c13e req-9483ddcb-926b-42eb-8775-87b2a30523ee service nova] Acquiring lock "102ba990-07fc-47ba-9abb-781423525369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9654962c-2512-45c0-a99d-e64d2fd7c13e req-9483ddcb-926b-42eb-8775-87b2a30523ee service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9654962c-2512-45c0-a99d-e64d2fd7c13e req-9483ddcb-926b-42eb-8775-87b2a30523ee service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:30 user nova-compute[74692]: DEBUG nova.compute.manager [req-9654962c-2512-45c0-a99d-e64d2fd7c13e req-9483ddcb-926b-42eb-8775-87b2a30523ee service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] No waiting events found dispatching network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:48:30 user nova-compute[74692]: WARNING nova.compute.manager [req-9654962c-2512-45c0-a99d-e64d2fd7c13e req-9483ddcb-926b-42eb-8775-87b2a30523ee service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received unexpected event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 for instance with vm_state rescued and task_state unrescuing.
Nov 18 18:48:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:48:30 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:48:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:48:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:48:31 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:48:31 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Updating instance_info_cache with network_info: [{"id": "539dfea4-e055-4443-ace6-20e5df4740d7", "address": "fa:16:3e:23:86:69", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539dfea4-e0", "ovs_interfaceid": "539dfea4-e055-4443-ace6-20e5df4740d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:48:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:48:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:48:31 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:48:32 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c8323b74-630a-47e1-9832-e6fbc2508311 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:48:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-a4f6632f-4371-4166-9fe9-998590e0984c req-216b9b15-8f6b-4a30-8f6a-0ae7e820b1dc service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:48:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a4f6632f-4371-4166-9fe9-998590e0984c req-216b9b15-8f6b-4a30-8f6a-0ae7e820b1dc service nova] Acquiring lock "102ba990-07fc-47ba-9abb-781423525369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a4f6632f-4371-4166-9fe9-998590e0984c req-216b9b15-8f6b-4a30-8f6a-0ae7e820b1dc service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a4f6632f-4371-4166-9fe9-998590e0984c req-216b9b15-8f6b-4a30-8f6a-0ae7e820b1dc service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-a4f6632f-4371-4166-9fe9-998590e0984c req-216b9b15-8f6b-4a30-8f6a-0ae7e820b1dc service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] No waiting events found dispatching network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:48:32 user nova-compute[74692]: WARNING nova.compute.manager [req-a4f6632f-4371-4166-9fe9-998590e0984c req-216b9b15-8f6b-4a30-8f6a-0ae7e820b1dc service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received unexpected event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 for instance with vm_state active and task_state None.
Nov 18 18:48:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Going to confirm migration 1 {{(pid=74692) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 18 18:48:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:48:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquired lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:48:39 user nova-compute[74692]: DEBUG nova.network.neutron [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:48:39 user nova-compute[74692]: DEBUG nova.objects.instance [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lazy-loading 'info_cache' on Instance uuid 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:48:40 user nova-compute[74692]: DEBUG nova.network.neutron [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Updating instance_info_cache with network_info: [{"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:48:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Releasing lock "refresh_cache-7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:48:40 user nova-compute[74692]: DEBUG nova.objects.instance [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lazy-loading 'migration_context' on Instance uuid 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:48:40 user nova-compute[74692]: DEBUG nova.objects.base [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Object Instance<7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d> lazy-loaded attributes: info_cache,migration_context {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:48:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:48:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:48:40 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:48:40 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:48:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.349s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:40 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Deleted allocation for migration d98a2570-e78f-4fce-b8aa-c43a238a86f4
Nov 18 18:48:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-16079f3a-30cb-4fab-9562-1f442a66ac93 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.292s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:48:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:48:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:48:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:48:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:49:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:49:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:49:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:49:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:49:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:49:17 user nova-compute[74692]: INFO nova.compute.manager [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Terminating instance
Nov 18 18:49:17 user nova-compute[74692]: DEBUG nova.compute.manager [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:49:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-f531f064-9e64-418e-a144-7d5051c640bc req-d6456381-56a0-4776-847d-4def5dfc26ab service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-unplugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f531f064-9e64-418e-a144-7d5051c640bc req-d6456381-56a0-4776-847d-4def5dfc26ab service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f531f064-9e64-418e-a144-7d5051c640bc req-d6456381-56a0-4776-847d-4def5dfc26ab service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f531f064-9e64-418e-a144-7d5051c640bc req-d6456381-56a0-4776-847d-4def5dfc26ab service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-f531f064-9e64-418e-a144-7d5051c640bc req-d6456381-56a0-4776-847d-4def5dfc26ab service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-unplugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-f531f064-9e64-418e-a144-7d5051c640bc req-d6456381-56a0-4776-847d-4def5dfc26ab service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-unplugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:18 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Instance destroyed successfully.
Nov 18 18:49:18 user nova-compute[74692]: DEBUG nova.objects.instance [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lazy-loading 'resources' on Instance uuid 7540540c-af3e-4992-8756-3497a3bd4bf6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-165218259',display_name='tempest-ServerRescueNegativeTestJSON-server-165218259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-165218259',id=14,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:37:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fead685ad47d4e96bb7c5225029f82ce',ramdisk_id='',reservation_id='r-w164i9re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-88342386',owner_user_name='tempest-ServerRescueNegativeTestJSON-88342386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:39:05Z,user_data=None,user_id='c418956015544fb8ac0a8acb6af6aacd',uuid=7540540c-af3e-4992-8756-3497a3bd4bf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converting VIF {"id": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "address": "fa:16:3e:05:a8:7e", "network": {"id": "8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-826118876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fead685ad47d4e96bb7c5225029f82ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256c4bff-9e", "ovs_interfaceid": "256c4bff-9e08-4f42-9a9a-ba78ede662e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=256c4bff-9e08-4f42-9a9a-ba78ede662e8,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256c4bff-9e') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG os_vif [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=256c4bff-9e08-4f42-9a9a-ba78ede662e8,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256c4bff-9e') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap256c4bff-9e, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93f0f7b8-acd2-4541-94af-5c6405cea496) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:49:18 user nova-compute[74692]: INFO os_vif [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=256c4bff-9e08-4f42-9a9a-ba78ede662e8,network=Network(8ff251a5-c5b3-4a9a-bf2a-857a4a6baa78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256c4bff-9e')
Nov 18 18:49:18 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Deleting instance files /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6_del
Nov 18 18:49:18 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Deletion of /opt/stack/data/nova/instances/7540540c-af3e-4992-8756-3497a3bd4bf6_del complete
Nov 18 18:49:18 user nova-compute[74692]: INFO nova.compute.manager [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 18 18:49:18 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:49:18 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:49:19 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:49:19 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Took 0.43 seconds to deallocate network for instance.
Nov 18 18:49:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-2a5b9962-c2c1-48fc-91f7-249019c9ad88 req-0c6fb212-2c68-48e0-9ce8-f72a979a0c8a service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-deleted-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:49:19 user nova-compute[74692]: INFO nova.compute.manager [req-2a5b9962-c2c1-48fc-91f7-249019c9ad88 req-0c6fb212-2c68-48e0-9ce8-f72a979a0c8a service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Neutron deleted interface 256c4bff-9e08-4f42-9a9a-ba78ede662e8; detaching it from the instance and deleting it from the info cache
Nov 18 18:49:19 user nova-compute[74692]: DEBUG nova.network.neutron [req-2a5b9962-c2c1-48fc-91f7-249019c9ad88 req-0c6fb212-2c68-48e0-9ce8-f72a979a0c8a service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:49:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-2a5b9962-c2c1-48fc-91f7-249019c9ad88 req-0c6fb212-2c68-48e0-9ce8-f72a979a0c8a service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Detach interface failed, port_id=256c4bff-9e08-4f42-9a9a-ba78ede662e8, reason: Instance 7540540c-af3e-4992-8756-3497a3bd4bf6 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:49:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:49:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:49:19 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:49:19 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:49:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:49:19 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Deleted allocations for instance 7540540c-af3e-4992-8756-3497a3bd4bf6
Nov 18 18:49:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-313e0554-543c-485a-8ee3-84d414ea299e tempest-ServerRescueNegativeTestJSON-88342386 tempest-ServerRescueNegativeTestJSON-88342386-project-member] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.806s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:49:19 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:49:19 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 18:49:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-82a605e0-ac57-4ee6-a597-bad739c1a733 req-371932f1-cdc2-4535-afb4-4101b750ac02 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:49:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-82a605e0-ac57-4ee6-a597-bad739c1a733 req-371932f1-cdc2-4535-afb4-4101b750ac02 service nova] Acquiring lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:49:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-82a605e0-ac57-4ee6-a597-bad739c1a733 req-371932f1-cdc2-4535-afb4-4101b750ac02 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:49:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-82a605e0-ac57-4ee6-a597-bad739c1a733 req-371932f1-cdc2-4535-afb4-4101b750ac02 service nova] Lock "7540540c-af3e-4992-8756-3497a3bd4bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:49:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-82a605e0-ac57-4ee6-a597-bad739c1a733 req-371932f1-cdc2-4535-afb4-4101b750ac02 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] No waiting events found dispatching network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:49:20 user nova-compute[74692]: WARNING nova.compute.manager [req-82a605e0-ac57-4ee6-a597-bad739c1a733 req-371932f1-cdc2-4535-afb4-4101b750ac02 service nova] [instance: 7540540c-af3e-4992-8756-3497a3bd4bf6] Received unexpected event network-vif-plugged-256c4bff-9e08-4f42-9a9a-ba78ede662e8 for instance with vm_state deleted and task_state None.
Nov 18 18:49:22 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:49:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:49:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:49:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:49:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:49:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:49:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:49:23 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:49:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:49:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:49:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:49:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:49:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:49:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:49:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:49:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:49:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:49:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:49:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:49:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:49:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:49:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:49:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:49:25 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:49:25 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:49:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8362MB free_disk=24.92862319946289GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:49:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:49:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:49:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:49:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:49:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:49:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:49:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 102ba990-07fc-47ba-9abb-781423525369 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:49:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:49:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:49:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:49:26 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:49:26 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:49:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:49:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:49:26 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:49:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 18:49:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] There are 0 instances to clean {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 18:49:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:49:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:49:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:49:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:49:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:49:32 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:49:32 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:49:32 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Didn't find any instances for network info cache update. {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 18:49:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:49:33 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:49:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:49:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:49:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "ac108610-6f06-48e0-93fe-14563906178c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:49:57 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:49:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:49:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:49:57 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:49:57 user nova-compute[74692]: INFO nova.compute.claims [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Claim successful on node user
Nov 18 18:49:57 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:49:57 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:49:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:49:57 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:49:57 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:49:57 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:49:57 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:49:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:57 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG nova.policy [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81e4fbd0fddf4c0d8051c4020165681a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eff44b3a1f5486296f293bcaa879f04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:49:58 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Creating image(s)
Nov 18 18:49:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "/opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "/opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f.part --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Successfully created port: 2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f.part --force-share --output=json" returned: 0 in 0.198s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG nova.virt.images [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] 180cb580-e4b8-404f-9bc6-d48f84e37d71 was qcow2, converting to raw {{(pid=74692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f.part /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f.converted {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f.part /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f.converted" returned: 0 in 0.125s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:49:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f.converted --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.960s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f --force-share --output=json" returned: 0 in 0.189s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f,backing_fmt=raw /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f,backing_fmt=raw /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk 1073741824" returned: 0 in 0.112s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Successfully updated port: 2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquired lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-60c58d47-7d5c-43e4-b63f-85a90e6c9ae5 req-2f5d9ed6-665a-4abc-ace5-49e2cd34b7a8 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-changed-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-60c58d47-7d5c-43e4-b63f-85a90e6c9ae5 req-2f5d9ed6-665a-4abc-ace5-49e2cd34b7a8 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Refreshing instance network info cache due to event network-changed-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-60c58d47-7d5c-43e4-b63f-85a90e6c9ae5 req-2f5d9ed6-665a-4abc-ace5-49e2cd34b7a8 service nova] Acquiring lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Cannot resize image /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Ensure instance console log exists: /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:49:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updating instance_info_cache with network_info: [{"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Releasing lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Instance network_info: |[{"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-60c58d47-7d5c-43e4-b63f-85a90e6c9ae5 req-2f5d9ed6-665a-4abc-ace5-49e2cd34b7a8 service nova] Acquired lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.network.neutron [req-60c58d47-7d5c-43e4-b63f-85a90e6c9ae5 req-2f5d9ed6-665a-4abc-ace5-49e2cd34b7a8 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Refreshing network info cache for port 2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Start _get_guest_xml network_info=[{"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:49:55Z,direct_url=<?>,disk_format='qcow2',id=180cb580-e4b8-404f-9bc6-d48f84e37d71,min_disk=0,min_ram=0,name='tempest-scenario-img--1476338208',owner='7eff44b3a1f5486296f293bcaa879f04',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:49:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '180cb580-e4b8-404f-9bc6-d48f84e37d71'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:50:00 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:50:00 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:49:55Z,direct_url=<?>,disk_format='qcow2',id=180cb580-e4b8-404f-9bc6-d48f84e37d71,min_disk=0,min_ram=0,name='tempest-scenario-img--1476338208',owner='7eff44b3a1f5486296f293bcaa879f04',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:49:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-393233064',display_name='tempest-TestMinimumBasicScenario-server-393233064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-393233064',id=35,image_ref='180cb580-e4b8-404f-9bc6-d48f84e37d71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNA4KvlxqrTIIKDvhSKfJ3XU3ntHC/3i/+xwD/BIw+RSHdiP8VwGhtxhDQjwPdH4a0qcX71w/dHEHyruK0pUhAiQzvFhCoAz0JtAhfXvdzxPBo36TRfUwQwTRuz8StN8g==',key_name='tempest-TestMinimumBasicScenario-812410050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eff44b3a1f5486296f293bcaa879f04',ramdisk_id='',reservation_id='r-2te0wbel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='180cb580-e4b8-404f-9bc6-d48f84e37d71',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1654716799',owner_user_name='tempest-TestMinimumBasicScenario-1654716799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:49:58Z,user_data=None,user_id='81e4fbd0fddf4c0d8051c4020165681a',uuid=ac108610-6f06-48e0-93fe-14563906178c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converting VIF {"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7a0ee4-6a') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lazy-loading 'pci_devices' on Instance uuid ac108610-6f06-48e0-93fe-14563906178c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:50:00 user nova-compute[74692]:   <uuid>ac108610-6f06-48e0-93fe-14563906178c</uuid>
Nov 18 18:50:00 user nova-compute[74692]:   <name>instance-00000023</name>
Nov 18 18:50:00 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:50:00 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:50:00 user nova-compute[74692]:   <metadata>
Nov 18 18:50:00 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:50:00 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:50:00 user nova-compute[74692]:       <nova:name>tempest-TestMinimumBasicScenario-server-393233064</nova:name>
Nov 18 18:50:00 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:50:00</nova:creationTime>
Nov 18 18:50:00 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:50:00 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:50:00 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:50:00 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:50:00 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:50:00 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:50:00 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:50:00 user nova-compute[74692]:       <nova:owner>
Nov 18 18:50:00 user nova-compute[74692]:         <nova:user uuid="81e4fbd0fddf4c0d8051c4020165681a">tempest-TestMinimumBasicScenario-1654716799-project-member</nova:user>
Nov 18 18:50:00 user nova-compute[74692]:         <nova:project uuid="7eff44b3a1f5486296f293bcaa879f04">tempest-TestMinimumBasicScenario-1654716799</nova:project>
Nov 18 18:50:00 user nova-compute[74692]:       </nova:owner>
Nov 18 18:50:00 user nova-compute[74692]:       <nova:root type="image" uuid="180cb580-e4b8-404f-9bc6-d48f84e37d71"/>
Nov 18 18:50:00 user nova-compute[74692]:       <nova:ports>
Nov 18 18:50:00 user nova-compute[74692]:         <nova:port uuid="2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5">
Nov 18 18:50:00 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 18 18:50:00 user nova-compute[74692]:         </nova:port>
Nov 18 18:50:00 user nova-compute[74692]:       </nova:ports>
Nov 18 18:50:00 user nova-compute[74692]:     </nova:instance>
Nov 18 18:50:00 user nova-compute[74692]:   </metadata>
Nov 18 18:50:00 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:50:00 user nova-compute[74692]:     <system>
Nov 18 18:50:00 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:50:00 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:50:00 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:50:00 user nova-compute[74692]:       <entry name="serial">ac108610-6f06-48e0-93fe-14563906178c</entry>
Nov 18 18:50:00 user nova-compute[74692]:       <entry name="uuid">ac108610-6f06-48e0-93fe-14563906178c</entry>
Nov 18 18:50:00 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:50:00 user nova-compute[74692]:     </system>
Nov 18 18:50:00 user nova-compute[74692]:   </sysinfo>
Nov 18 18:50:00 user nova-compute[74692]:   <os>
Nov 18 18:50:00 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:50:00 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:50:00 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:50:00 user nova-compute[74692]:   </os>
Nov 18 18:50:00 user nova-compute[74692]:   <features>
Nov 18 18:50:00 user nova-compute[74692]:     <acpi/>
Nov 18 18:50:00 user nova-compute[74692]:     <apic/>
Nov 18 18:50:00 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:50:00 user nova-compute[74692]:   </features>
Nov 18 18:50:00 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:50:00 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:50:00 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:50:00 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:50:00 user nova-compute[74692]:   </clock>
Nov 18 18:50:00 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:50:00 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:50:00 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:50:00 user nova-compute[74692]:   </cpu>
Nov 18 18:50:00 user nova-compute[74692]:   <devices>
Nov 18 18:50:00 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:50:00 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:50:00 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk"/>
Nov 18 18:50:00 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:50:00 user nova-compute[74692]:     </disk>
Nov 18 18:50:00 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:50:00 user nova-compute[74692]:       <mac address="fa:16:3e:2e:f7:c5"/>
Nov 18 18:50:00 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:50:00 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:50:00 user nova-compute[74692]:       <target dev="tap2e7a0ee4-6a"/>
Nov 18 18:50:00 user nova-compute[74692]:     </interface>
Nov 18 18:50:00 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:50:00 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/console.log" append="off"/>
Nov 18 18:50:00 user nova-compute[74692]:     </serial>
Nov 18 18:50:00 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:50:00 user nova-compute[74692]:     <video>
Nov 18 18:50:00 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:50:00 user nova-compute[74692]:     </video>
Nov 18 18:50:00 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:50:00 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:50:00 user nova-compute[74692]:     </rng>
Nov 18 18:50:00 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:50:00 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:50:00 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:50:00 user nova-compute[74692]:     </memballoon>
Nov 18 18:50:00 user nova-compute[74692]:   </devices>
Nov 18 18:50:00 user nova-compute[74692]: </domain>
Nov 18 18:50:00 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-393233064',display_name='tempest-TestMinimumBasicScenario-server-393233064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-393233064',id=35,image_ref='180cb580-e4b8-404f-9bc6-d48f84e37d71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNA4KvlxqrTIIKDvhSKfJ3XU3ntHC/3i/+xwD/BIw+RSHdiP8VwGhtxhDQjwPdH4a0qcX71w/dHEHyruK0pUhAiQzvFhCoAz0JtAhfXvdzxPBo36TRfUwQwTRuz8StN8g==',key_name='tempest-TestMinimumBasicScenario-812410050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eff44b3a1f5486296f293bcaa879f04',ramdisk_id='',reservation_id='r-2te0wbel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='180cb580-e4b8-404f-9bc6-d48f84e37d71',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1654716799',owner_user_name='tempest-TestMinimumBasicScenario-1654716799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:49:58Z,user_data=None,user_id='81e4fbd0fddf4c0d8051c4020165681a',uuid=ac108610-6f06-48e0-93fe-14563906178c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converting VIF {"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7a0ee4-6a') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG os_vif [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7a0ee4-6a') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31762cfe-2585-5d19-aa7d-cf0d9782e3e7', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e7a0ee4-6a, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e7a0ee4-6a, col_values=(('qos', UUID('888d37fa-bfd0-4c61-ba90-513ad0576455')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e7a0ee4-6a, col_values=(('external_ids', {'iface-id': '2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:f7:c5', 'vm-uuid': 'ac108610-6f06-48e0-93fe-14563906178c'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:00 user nova-compute[74692]: INFO os_vif [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7a0ee4-6a')
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] No VIF found with MAC fa:16:3e:2e:f7:c5, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.network.neutron [req-60c58d47-7d5c-43e4-b63f-85a90e6c9ae5 req-2f5d9ed6-665a-4abc-ace5-49e2cd34b7a8 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updated VIF entry in instance network info cache for port 2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG nova.network.neutron [req-60c58d47-7d5c-43e4-b63f-85a90e6c9ae5 req-2f5d9ed6-665a-4abc-ace5-49e2cd34b7a8 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updating instance_info_cache with network_info: [{"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:50:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-60c58d47-7d5c-43e4-b63f-85a90e6c9ae5 req-2f5d9ed6-665a-4abc-ace5-49e2cd34b7a8 service nova] Releasing lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:50:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-2ececfa6-9fa3-4ad2-811d-86fe46ccda7f req-381bc579-b378-42cd-bc10-8db6f44dba9d service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:50:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2ececfa6-9fa3-4ad2-811d-86fe46ccda7f req-381bc579-b378-42cd-bc10-8db6f44dba9d service nova] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2ececfa6-9fa3-4ad2-811d-86fe46ccda7f req-381bc579-b378-42cd-bc10-8db6f44dba9d service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2ececfa6-9fa3-4ad2-811d-86fe46ccda7f req-381bc579-b378-42cd-bc10-8db6f44dba9d service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-2ececfa6-9fa3-4ad2-811d-86fe46ccda7f req-381bc579-b378-42cd-bc10-8db6f44dba9d service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] No waiting events found dispatching network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:50:01 user nova-compute[74692]: WARNING nova.compute.manager [req-2ececfa6-9fa3-4ad2-811d-86fe46ccda7f req-381bc579-b378-42cd-bc10-8db6f44dba9d service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received unexpected event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 for instance with vm_state building and task_state spawning.
Nov 18 18:50:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:50:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:50:03 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: ac108610-6f06-48e0-93fe-14563906178c] Instance spawned successfully.
Nov 18 18:50:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:50:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:50:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:50:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:50:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:50:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:50:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:50:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-40120b83-91c7-43db-ac65-bcd8a04bd39d req-bf494afb-6c82-4ec8-8256-5914dc3cc91d service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:50:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-40120b83-91c7-43db-ac65-bcd8a04bd39d req-bf494afb-6c82-4ec8-8256-5914dc3cc91d service nova] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-40120b83-91c7-43db-ac65-bcd8a04bd39d req-bf494afb-6c82-4ec8-8256-5914dc3cc91d service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-40120b83-91c7-43db-ac65-bcd8a04bd39d req-bf494afb-6c82-4ec8-8256-5914dc3cc91d service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-40120b83-91c7-43db-ac65-bcd8a04bd39d req-bf494afb-6c82-4ec8-8256-5914dc3cc91d service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] No waiting events found dispatching network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:50:03 user nova-compute[74692]: WARNING nova.compute.manager [req-40120b83-91c7-43db-ac65-bcd8a04bd39d req-bf494afb-6c82-4ec8-8256-5914dc3cc91d service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received unexpected event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 for instance with vm_state building and task_state spawning.
Nov 18 18:50:03 user nova-compute[74692]: INFO nova.compute.manager [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 18 18:50:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:50:03 user nova-compute[74692]: INFO nova.compute.manager [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Took 6.26 seconds to build instance.
Nov 18 18:50:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c813ad21-ba20-480b-811b-42d623bb3fbf tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "ac108610-6f06-48e0-93fe-14563906178c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.359s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "102ba990-07fc-47ba-9abb-781423525369" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "102ba990-07fc-47ba-9abb-781423525369" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "102ba990-07fc-47ba-9abb-781423525369-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "102ba990-07fc-47ba-9abb-781423525369-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "102ba990-07fc-47ba-9abb-781423525369-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:18 user nova-compute[74692]: INFO nova.compute.manager [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Terminating instance
Nov 18 18:50:18 user nova-compute[74692]: DEBUG nova.compute.manager [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:50:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-207bc166-2c97-4206-bba8-0cd659beb0d9 req-73d97eb4-623b-40f0-9cc8-ef67eb0360cd service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received event network-vif-unplugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:50:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-207bc166-2c97-4206-bba8-0cd659beb0d9 req-73d97eb4-623b-40f0-9cc8-ef67eb0360cd service nova] Acquiring lock "102ba990-07fc-47ba-9abb-781423525369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-207bc166-2c97-4206-bba8-0cd659beb0d9 req-73d97eb4-623b-40f0-9cc8-ef67eb0360cd service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-207bc166-2c97-4206-bba8-0cd659beb0d9 req-73d97eb4-623b-40f0-9cc8-ef67eb0360cd service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-207bc166-2c97-4206-bba8-0cd659beb0d9 req-73d97eb4-623b-40f0-9cc8-ef67eb0360cd service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] No waiting events found dispatching network-vif-unplugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:50:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-207bc166-2c97-4206-bba8-0cd659beb0d9 req-73d97eb4-623b-40f0-9cc8-ef67eb0360cd service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received event network-vif-unplugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:50:19 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 102ba990-07fc-47ba-9abb-781423525369] Instance destroyed successfully.
Nov 18 18:50:19 user nova-compute[74692]: DEBUG nova.objects.instance [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'resources' on Instance uuid 102ba990-07fc-47ba-9abb-781423525369 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1437746351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1437746351',id=33,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:46:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='704ef46081d04fc7a0ed88456cbe9fe8',ramdisk_id='',reservation_id='r-pkh5jk7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-199647198',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:48:32Z,user_data=None,user_id='1233b31e12dc4d5796a60327d93c3bfb',uuid=102ba990-07fc-47ba-9abb-781423525369,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "address": "fa:16:3e:fe:c8:c4", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef69d29-64", "ovs_interfaceid": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converting VIF {"id": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "address": "fa:16:3e:fe:c8:c4", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef69d29-64", "ovs_interfaceid": "8ef69d29-6445-4468-80c2-c9930ecb41e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:c8:c4,bridge_name='br-int',has_traffic_filtering=True,id=8ef69d29-6445-4468-80c2-c9930ecb41e7,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef69d29-64') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_vif [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:c8:c4,bridge_name='br-int',has_traffic_filtering=True,id=8ef69d29-6445-4468-80c2-c9930ecb41e7,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef69d29-64') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ef69d29-64, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec116099-2ecc-4a94-96a4-3571d3c1dbeb) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:50:19 user nova-compute[74692]: INFO os_vif [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:c8:c4,bridge_name='br-int',has_traffic_filtering=True,id=8ef69d29-6445-4468-80c2-c9930ecb41e7,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef69d29-64')
Nov 18 18:50:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwTNRpma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:50:19 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[be265341-e4c7-475f-9516-c3f480ebd8e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:50:19 user nova-compute[74692]: No targets found.
Nov 18 18:50:19 user nova-compute[74692]: iSNS:
Nov 18 18:50:19 user nova-compute[74692]: No targets found.
Nov 18 18:50:19 user nova-compute[74692]: STATIC:
Nov 18 18:50:19 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0
Nov 18 18:50:19 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:50:19 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:50:19 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305
Nov 18 18:50:19 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:50:19 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:50:19 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:50:19 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:50:19 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:50:19 user nova-compute[74692]: FIRMWARE:
Nov 18 18:50:19 user nova-compute[74692]: No targets found.
Nov 18 18:50:19 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:50:19 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:50:19 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d58286-a71e-4c5c-80f8-51c48799ddd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[405b920c-89f9-4e27-8815-d7dcfcf6096b]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:50:19 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:50:19 user nova-compute[74692]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:50:19 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:50:19 user nova-compute[74692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 (non-flash)
Nov 18 18:50:19 user nova-compute[74692]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:50:19 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a46ae440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0'): ({'sdd'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Removing single pathed devices sdd {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c541d44f-755e-4add-a662-b9b51b3692a5]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc2d483-1766-41d8-9dac-eb3a48de3977]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Flushing IO for device /dev/sdd {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c73026-b60a-4c33-a77d-b67a27911dc4]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a78623-2e18-4cd5-be74-e1a7b8697d3b]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f38325-bc94-430e-88cf-37addf618f1b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c18c67-3cd8-4228-8e24-d539891fe3a3]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0, portal: 172.16.0.220,3260]
Nov 18 18:50:19 user nova-compute[74692]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0, portal: 172.16.0.220,3260] successful.
Nov 18 18:50:19 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457e2a1-c733-4e6c-8c0e-d02f2cdb96d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e196ea77-3596-49e8-bfdc-caa9c943c1ef]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] <== disconnect_volume: return (318ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:50:19 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Deleting instance files /opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369_del
Nov 18 18:50:19 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Deletion of /opt/stack/data/nova/instances/102ba990-07fc-47ba-9abb-781423525369_del complete
Nov 18 18:50:19 user nova-compute[74692]: INFO nova.compute.manager [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 18 18:50:19 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 102ba990-07fc-47ba-9abb-781423525369] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:50:19 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 102ba990-07fc-47ba-9abb-781423525369] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:50:20 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 102ba990-07fc-47ba-9abb-781423525369] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:50:20 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 102ba990-07fc-47ba-9abb-781423525369] Took 0.54 seconds to deallocate network for instance.
Nov 18 18:50:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-05cef2ee-567e-4c9b-8cb6-d57fae668e38 req-2ad68cdf-65a2-47b6-8e46-744731af143c service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received event network-vif-deleted-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:50:20 user nova-compute[74692]: INFO nova.compute.manager [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 102ba990-07fc-47ba-9abb-781423525369] Took 0.71 seconds to detach 1 volumes for instance.
Nov 18 18:50:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-a4d54434-4f79-4c44-8be8-88d471b274b4 req-bc04e5ab-757b-4cb9-9278-8b52fe943d57 service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:50:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a4d54434-4f79-4c44-8be8-88d471b274b4 req-bc04e5ab-757b-4cb9-9278-8b52fe943d57 service nova] Acquiring lock "102ba990-07fc-47ba-9abb-781423525369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a4d54434-4f79-4c44-8be8-88d471b274b4 req-bc04e5ab-757b-4cb9-9278-8b52fe943d57 service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a4d54434-4f79-4c44-8be8-88d471b274b4 req-bc04e5ab-757b-4cb9-9278-8b52fe943d57 service nova] Lock "102ba990-07fc-47ba-9abb-781423525369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-a4d54434-4f79-4c44-8be8-88d471b274b4 req-bc04e5ab-757b-4cb9-9278-8b52fe943d57 service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] No waiting events found dispatching network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:50:20 user nova-compute[74692]: WARNING nova.compute.manager [req-a4d54434-4f79-4c44-8be8-88d471b274b4 req-bc04e5ab-757b-4cb9-9278-8b52fe943d57 service nova] [instance: 102ba990-07fc-47ba-9abb-781423525369] Received unexpected event network-vif-plugged-8ef69d29-6445-4468-80c2-c9930ecb41e7 for instance with vm_state active and task_state deleting.
Nov 18 18:50:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:21 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:50:21 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:50:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:21 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Deleted allocations for instance 102ba990-07fc-47ba-9abb-781423525369
Nov 18 18:50:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-728cdcca-4552-49fc-b7c7-34fa662d6ccc tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "102ba990-07fc-47ba-9abb-781423525369" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.988s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:50:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:50:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:23 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:50:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:50:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:50:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:26 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:50:26 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8361MB free_disk=24.83774185180664GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance ac108610-6f06-48e0-93fe-14563906178c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing inventories for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating ProviderTree inventory for provider 582be55c-ee9f-496e-b354-5900b8401d2c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating inventory in ProviderTree for provider 582be55c-ee9f-496e-b354-5900b8401d2c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing aggregate associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, aggregates: None {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing trait associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:50:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:50:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:50:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:50:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:50:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:50:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:50:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:30 user nova-compute[74692]: INFO nova.compute.manager [None req-c919981e-b95b-4879-936e-2dc2e64e05f9 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Get console output
Nov 18 18:50:30 user nova-compute[74692]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 18 18:50:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:50:32 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:50:32 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:50:32 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 18:50:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-dd434b0c-593a-47ad-9109-0f8b5f545b6c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:50:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-dd434b0c-593a-47ad-9109-0f8b5f545b6c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:50:33 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:50:33 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid dd434b0c-593a-47ad-9109-0f8b5f545b6c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:50:33 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Updating instance_info_cache with network_info: [{"id": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "address": "fa:16:3e:93:8d:60", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc879593e-46", "ovs_interfaceid": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:50:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-dd434b0c-593a-47ad-9109-0f8b5f545b6c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:50:33 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:50:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:50:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "18fc06c8-a112-462b-8302-83a41ee9c352" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "18fc06c8-a112-462b-8302-83a41ee9c352" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:50:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:38 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:50:38 user nova-compute[74692]: INFO nova.compute.claims [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Claim successful on node user
Nov 18 18:50:38 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:50:38 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG nova.network.neutron [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:50:39 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:50:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG nova.policy [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bbd290cbd4e49b59aab5217f553c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb3bc45280424122aa275a118909d6f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:50:39 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Creating image(s)
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "/opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "/opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "/opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.169s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk 1073741824" returned: 0 in 0.046s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG nova.network.neutron [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Successfully created port: 6de20cf2-f163-4dae-bb89-bc55ce87896e {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:50:39 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Cannot resize image /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Ensure instance console log exists: /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.network.neutron [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Successfully updated port: 6de20cf2-f163-4dae-bb89-bc55ce87896e {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "refresh_cache-18fc06c8-a112-462b-8302-83a41ee9c352" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquired lock "refresh_cache-18fc06c8-a112-462b-8302-83a41ee9c352" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.network.neutron [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-b79b356f-2e10-4d29-a8c6-1ac0ed497fb8 req-381f0c1c-446f-421d-ae6f-8a5ad3c64723 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Received event network-changed-6de20cf2-f163-4dae-bb89-bc55ce87896e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.compute.manager [req-b79b356f-2e10-4d29-a8c6-1ac0ed497fb8 req-381f0c1c-446f-421d-ae6f-8a5ad3c64723 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Refreshing instance network info cache due to event network-changed-6de20cf2-f163-4dae-bb89-bc55ce87896e. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b79b356f-2e10-4d29-a8c6-1ac0ed497fb8 req-381f0c1c-446f-421d-ae6f-8a5ad3c64723 service nova] Acquiring lock "refresh_cache-18fc06c8-a112-462b-8302-83a41ee9c352" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.network.neutron [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.network.neutron [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Updating instance_info_cache with network_info: [{"id": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "address": "fa:16:3e:2c:3d:06", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de20cf2-f1", "ovs_interfaceid": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Releasing lock "refresh_cache-18fc06c8-a112-462b-8302-83a41ee9c352" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Instance network_info: |[{"id": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "address": "fa:16:3e:2c:3d:06", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de20cf2-f1", "ovs_interfaceid": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b79b356f-2e10-4d29-a8c6-1ac0ed497fb8 req-381f0c1c-446f-421d-ae6f-8a5ad3c64723 service nova] Acquired lock "refresh_cache-18fc06c8-a112-462b-8302-83a41ee9c352" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.network.neutron [req-b79b356f-2e10-4d29-a8c6-1ac0ed497fb8 req-381f0c1c-446f-421d-ae6f-8a5ad3c64723 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Refreshing network info cache for port 6de20cf2-f163-4dae-bb89-bc55ce87896e {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Start _get_guest_xml network_info=[{"id": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "address": "fa:16:3e:2c:3d:06", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de20cf2-f1", "ovs_interfaceid": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:50:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:50:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1047458037',display_name='tempest-VolumesSnapshotTestJSON-instance-1047458037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1047458037',id=36,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoBkj2C3ETViz55/K6T5pbKbbhE3B47Mza4Ai1s1v3LFXOgI9WxLkcLEPpxJXnEEplLn6SJPTU/yWcRnAKfvDpphKemK2A8Sg/PCMNvFt71CL98gcHfxL5DsDje+0meKg==',key_name='tempest-keypair-1030479069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb3bc45280424122aa275a118909d6f4',ramdisk_id='',reservation_id='r-l72ymp54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1571543916',owner_user_name='tempest-VolumesSnapshotTestJSON-1571543916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bbd290cbd4e49b59aab5217f553c6f0',uuid=18fc06c8-a112-462b-8302-83a41ee9c352,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "address": "fa:16:3e:2c:3d:06", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de20cf2-f1", "ovs_interfaceid": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Converting VIF {"id": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "address": "fa:16:3e:2c:3d:06", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de20cf2-f1", "ovs_interfaceid": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:3d:06,bridge_name='br-int',has_traffic_filtering=True,id=6de20cf2-f163-4dae-bb89-bc55ce87896e,network=Network(70fdfeca-f8bb-4437-95bb-8479471c0733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de20cf2-f1') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lazy-loading 'pci_devices' on Instance uuid 18fc06c8-a112-462b-8302-83a41ee9c352 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:50:40 user nova-compute[74692]:   <uuid>18fc06c8-a112-462b-8302-83a41ee9c352</uuid>
Nov 18 18:50:40 user nova-compute[74692]:   <name>instance-00000024</name>
Nov 18 18:50:40 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:50:40 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:50:40 user nova-compute[74692]:   <metadata>
Nov 18 18:50:40 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:50:40 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:50:40 user nova-compute[74692]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1047458037</nova:name>
Nov 18 18:50:40 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:50:40</nova:creationTime>
Nov 18 18:50:40 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:50:40 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:50:40 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:50:40 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:50:40 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:50:40 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:50:40 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:50:40 user nova-compute[74692]:       <nova:owner>
Nov 18 18:50:40 user nova-compute[74692]:         <nova:user uuid="8bbd290cbd4e49b59aab5217f553c6f0">tempest-VolumesSnapshotTestJSON-1571543916-project-member</nova:user>
Nov 18 18:50:40 user nova-compute[74692]:         <nova:project uuid="fb3bc45280424122aa275a118909d6f4">tempest-VolumesSnapshotTestJSON-1571543916</nova:project>
Nov 18 18:50:40 user nova-compute[74692]:       </nova:owner>
Nov 18 18:50:40 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:50:40 user nova-compute[74692]:       <nova:ports>
Nov 18 18:50:40 user nova-compute[74692]:         <nova:port uuid="6de20cf2-f163-4dae-bb89-bc55ce87896e">
Nov 18 18:50:40 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 18 18:50:40 user nova-compute[74692]:         </nova:port>
Nov 18 18:50:40 user nova-compute[74692]:       </nova:ports>
Nov 18 18:50:40 user nova-compute[74692]:     </nova:instance>
Nov 18 18:50:40 user nova-compute[74692]:   </metadata>
Nov 18 18:50:40 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:50:40 user nova-compute[74692]:     <system>
Nov 18 18:50:40 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:50:40 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:50:40 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:50:40 user nova-compute[74692]:       <entry name="serial">18fc06c8-a112-462b-8302-83a41ee9c352</entry>
Nov 18 18:50:40 user nova-compute[74692]:       <entry name="uuid">18fc06c8-a112-462b-8302-83a41ee9c352</entry>
Nov 18 18:50:40 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:50:40 user nova-compute[74692]:     </system>
Nov 18 18:50:40 user nova-compute[74692]:   </sysinfo>
Nov 18 18:50:40 user nova-compute[74692]:   <os>
Nov 18 18:50:40 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:50:40 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:50:40 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:50:40 user nova-compute[74692]:   </os>
Nov 18 18:50:40 user nova-compute[74692]:   <features>
Nov 18 18:50:40 user nova-compute[74692]:     <acpi/>
Nov 18 18:50:40 user nova-compute[74692]:     <apic/>
Nov 18 18:50:40 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:50:40 user nova-compute[74692]:   </features>
Nov 18 18:50:40 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:50:40 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:50:40 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:50:40 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:50:40 user nova-compute[74692]:   </clock>
Nov 18 18:50:40 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:50:40 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:50:40 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:50:40 user nova-compute[74692]:   </cpu>
Nov 18 18:50:40 user nova-compute[74692]:   <devices>
Nov 18 18:50:40 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:50:40 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:50:40 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk"/>
Nov 18 18:50:40 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:50:40 user nova-compute[74692]:     </disk>
Nov 18 18:50:40 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:50:40 user nova-compute[74692]:       <mac address="fa:16:3e:2c:3d:06"/>
Nov 18 18:50:40 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:50:40 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:50:40 user nova-compute[74692]:       <target dev="tap6de20cf2-f1"/>
Nov 18 18:50:40 user nova-compute[74692]:     </interface>
Nov 18 18:50:40 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:50:40 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/console.log" append="off"/>
Nov 18 18:50:40 user nova-compute[74692]:     </serial>
Nov 18 18:50:40 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:50:40 user nova-compute[74692]:     <video>
Nov 18 18:50:40 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:50:40 user nova-compute[74692]:     </video>
Nov 18 18:50:40 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:50:40 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:50:40 user nova-compute[74692]:     </rng>
Nov 18 18:50:40 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:50:40 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:50:40 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:50:40 user nova-compute[74692]:     </memballoon>
Nov 18 18:50:40 user nova-compute[74692]:   </devices>
Nov 18 18:50:40 user nova-compute[74692]: </domain>
Nov 18 18:50:40 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1047458037',display_name='tempest-VolumesSnapshotTestJSON-instance-1047458037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1047458037',id=36,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoBkj2C3ETViz55/K6T5pbKbbhE3B47Mza4Ai1s1v3LFXOgI9WxLkcLEPpxJXnEEplLn6SJPTU/yWcRnAKfvDpphKemK2A8Sg/PCMNvFt71CL98gcHfxL5DsDje+0meKg==',key_name='tempest-keypair-1030479069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb3bc45280424122aa275a118909d6f4',ramdisk_id='',reservation_id='r-l72ymp54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1571543916',owner_user_name='tempest-VolumesSnapshotTestJSON-1571543916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bbd290cbd4e49b59aab5217f553c6f0',uuid=18fc06c8-a112-462b-8302-83a41ee9c352,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "address": "fa:16:3e:2c:3d:06", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de20cf2-f1", "ovs_interfaceid": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Converting VIF {"id": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "address": "fa:16:3e:2c:3d:06", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de20cf2-f1", "ovs_interfaceid": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:3d:06,bridge_name='br-int',has_traffic_filtering=True,id=6de20cf2-f163-4dae-bb89-bc55ce87896e,network=Network(70fdfeca-f8bb-4437-95bb-8479471c0733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de20cf2-f1') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG os_vif [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:3d:06,bridge_name='br-int',has_traffic_filtering=True,id=6de20cf2-f163-4dae-bb89-bc55ce87896e,network=Network(70fdfeca-f8bb-4437-95bb-8479471c0733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de20cf2-f1') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '865934d1-022a-5832-beb6-2ba32c3aab83', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6de20cf2-f1, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6de20cf2-f1, col_values=(('qos', UUID('1b6264ec-b1f8-4717-96f9-5e1489043583')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6de20cf2-f1, col_values=(('external_ids', {'iface-id': '6de20cf2-f163-4dae-bb89-bc55ce87896e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:3d:06', 'vm-uuid': '18fc06c8-a112-462b-8302-83a41ee9c352'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:40 user nova-compute[74692]: INFO os_vif [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:3d:06,bridge_name='br-int',has_traffic_filtering=True,id=6de20cf2-f163-4dae-bb89-bc55ce87896e,network=Network(70fdfeca-f8bb-4437-95bb-8479471c0733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de20cf2-f1')
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:50:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] No VIF found with MAC fa:16:3e:2c:3d:06, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:50:41 user nova-compute[74692]: DEBUG nova.network.neutron [req-b79b356f-2e10-4d29-a8c6-1ac0ed497fb8 req-381f0c1c-446f-421d-ae6f-8a5ad3c64723 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Updated VIF entry in instance network info cache for port 6de20cf2-f163-4dae-bb89-bc55ce87896e. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:50:41 user nova-compute[74692]: DEBUG nova.network.neutron [req-b79b356f-2e10-4d29-a8c6-1ac0ed497fb8 req-381f0c1c-446f-421d-ae6f-8a5ad3c64723 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Updating instance_info_cache with network_info: [{"id": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "address": "fa:16:3e:2c:3d:06", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de20cf2-f1", "ovs_interfaceid": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:50:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b79b356f-2e10-4d29-a8c6-1ac0ed497fb8 req-381f0c1c-446f-421d-ae6f-8a5ad3c64723 service nova] Releasing lock "refresh_cache-18fc06c8-a112-462b-8302-83a41ee9c352" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:50:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-fc176388-1720-4585-830a-0619e0f9701f req-bdf25694-f3c5-4163-b5b3-9fe6a2a1b8d4 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Received event network-vif-plugged-6de20cf2-f163-4dae-bb89-bc55ce87896e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:50:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fc176388-1720-4585-830a-0619e0f9701f req-bdf25694-f3c5-4163-b5b3-9fe6a2a1b8d4 service nova] Acquiring lock "18fc06c8-a112-462b-8302-83a41ee9c352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fc176388-1720-4585-830a-0619e0f9701f req-bdf25694-f3c5-4163-b5b3-9fe6a2a1b8d4 service nova] Lock "18fc06c8-a112-462b-8302-83a41ee9c352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fc176388-1720-4585-830a-0619e0f9701f req-bdf25694-f3c5-4163-b5b3-9fe6a2a1b8d4 service nova] Lock "18fc06c8-a112-462b-8302-83a41ee9c352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-fc176388-1720-4585-830a-0619e0f9701f req-bdf25694-f3c5-4163-b5b3-9fe6a2a1b8d4 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] No waiting events found dispatching network-vif-plugged-6de20cf2-f163-4dae-bb89-bc55ce87896e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:50:42 user nova-compute[74692]: WARNING nova.compute.manager [req-fc176388-1720-4585-830a-0619e0f9701f req-bdf25694-f3c5-4163-b5b3-9fe6a2a1b8d4 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Received unexpected event network-vif-plugged-6de20cf2-f163-4dae-bb89-bc55ce87896e for instance with vm_state building and task_state spawning.
Nov 18 18:50:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:44 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:50:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:50:44 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Instance spawned successfully.
Nov 18 18:50:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:50:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:50:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:50:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:50:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:50:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:50:44 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:50:44 user nova-compute[74692]: INFO nova.compute.manager [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 18 18:50:44 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:50:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-38614338-d5c1-4ce6-b0d8-ad2556cf10a6 req-6e000a38-4f98-4615-a997-7c25dac84d92 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Received event network-vif-plugged-6de20cf2-f163-4dae-bb89-bc55ce87896e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:50:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-38614338-d5c1-4ce6-b0d8-ad2556cf10a6 req-6e000a38-4f98-4615-a997-7c25dac84d92 service nova] Acquiring lock "18fc06c8-a112-462b-8302-83a41ee9c352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:50:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-38614338-d5c1-4ce6-b0d8-ad2556cf10a6 req-6e000a38-4f98-4615-a997-7c25dac84d92 service nova] Lock "18fc06c8-a112-462b-8302-83a41ee9c352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:50:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-38614338-d5c1-4ce6-b0d8-ad2556cf10a6 req-6e000a38-4f98-4615-a997-7c25dac84d92 service nova] Lock "18fc06c8-a112-462b-8302-83a41ee9c352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-38614338-d5c1-4ce6-b0d8-ad2556cf10a6 req-6e000a38-4f98-4615-a997-7c25dac84d92 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] No waiting events found dispatching network-vif-plugged-6de20cf2-f163-4dae-bb89-bc55ce87896e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:50:44 user nova-compute[74692]: WARNING nova.compute.manager [req-38614338-d5c1-4ce6-b0d8-ad2556cf10a6 req-6e000a38-4f98-4615-a997-7c25dac84d92 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Received unexpected event network-vif-plugged-6de20cf2-f163-4dae-bb89-bc55ce87896e for instance with vm_state building and task_state spawning.
Nov 18 18:50:44 user nova-compute[74692]: INFO nova.compute.manager [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Took 5.84 seconds to build instance.
Nov 18 18:50:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3115caf4-6c83-47df-8db0-b56e5b67935f tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "18fc06c8-a112-462b-8302-83a41ee9c352" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.929s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:50:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:50:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:09 user nova-compute[74692]: INFO nova.compute.manager [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Terminating instance
Nov 18 18:51:09 user nova-compute[74692]: DEBUG nova.compute.manager [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-75a5d239-f64e-40dc-851d-df99aeea2e19 req-1e5d1157-33e8-4d95-8f7a-43dca7c3aa8e service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Received event network-vif-unplugged-539dfea4-e055-4443-ace6-20e5df4740d7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-75a5d239-f64e-40dc-851d-df99aeea2e19 req-1e5d1157-33e8-4d95-8f7a-43dca7c3aa8e service nova] Acquiring lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-75a5d239-f64e-40dc-851d-df99aeea2e19 req-1e5d1157-33e8-4d95-8f7a-43dca7c3aa8e service nova] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-75a5d239-f64e-40dc-851d-df99aeea2e19 req-1e5d1157-33e8-4d95-8f7a-43dca7c3aa8e service nova] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-75a5d239-f64e-40dc-851d-df99aeea2e19 req-1e5d1157-33e8-4d95-8f7a-43dca7c3aa8e service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] No waiting events found dispatching network-vif-unplugged-539dfea4-e055-4443-ace6-20e5df4740d7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-75a5d239-f64e-40dc-851d-df99aeea2e19 req-1e5d1157-33e8-4d95-8f7a-43dca7c3aa8e service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Received event network-vif-unplugged-539dfea4-e055-4443-ace6-20e5df4740d7 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:09 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Instance destroyed successfully.
Nov 18 18:51:09 user nova-compute[74692]: DEBUG nova.objects.instance [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'resources' on Instance uuid 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:41:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1724405019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1724405019',id=30,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:41:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='704ef46081d04fc7a0ed88456cbe9fe8',ramdisk_id='',reservation_id='r-gz5n8rcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-199647198',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:43:43Z,user_data=None,user_id='1233b31e12dc4d5796a60327d93c3bfb',uuid=73cc50c0-f4e2-4a5f-92f6-84aa50cf5449,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "539dfea4-e055-4443-ace6-20e5df4740d7", "address": "fa:16:3e:23:86:69", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539dfea4-e0", "ovs_interfaceid": "539dfea4-e055-4443-ace6-20e5df4740d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converting VIF {"id": "539dfea4-e055-4443-ace6-20e5df4740d7", "address": "fa:16:3e:23:86:69", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539dfea4-e0", "ovs_interfaceid": "539dfea4-e055-4443-ace6-20e5df4740d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:86:69,bridge_name='br-int',has_traffic_filtering=True,id=539dfea4-e055-4443-ace6-20e5df4740d7,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539dfea4-e0') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG os_vif [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:86:69,bridge_name='br-int',has_traffic_filtering=True,id=539dfea4-e055-4443-ace6-20e5df4740d7,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539dfea4-e0') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap539dfea4-e0, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bbfb2c7-3203-4eb2-9f46-f3eb4ddf2ff0) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:09 user nova-compute[74692]: INFO os_vif [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:86:69,bridge_name='br-int',has_traffic_filtering=True,id=539dfea4-e055-4443-ace6-20e5df4740d7,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539dfea4-e0')
Nov 18 18:51:09 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Deleting instance files /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449_del
Nov 18 18:51:09 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Deletion of /opt/stack/data/nova/instances/73cc50c0-f4e2-4a5f-92f6-84aa50cf5449_del complete
Nov 18 18:51:09 user nova-compute[74692]: INFO nova.compute.manager [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 18 18:51:09 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:51:09 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:51:10 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:51:10 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Took 0.45 seconds to deallocate network for instance.
Nov 18 18:51:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:10 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:51:10 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:51:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:10 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Deleted allocations for instance 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449
Nov 18 18:51:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-1b5a67ea-9df3-4143-a7e0-18f8e164a4bb tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.702s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:11 user nova-compute[74692]: DEBUG nova.compute.manager [req-826d4470-8b7f-4277-b4c2-e2651a4cc447 req-ffdde11c-4d00-4467-8326-e3a3b26762c0 service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Received event network-vif-plugged-539dfea4-e055-4443-ace6-20e5df4740d7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:51:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-826d4470-8b7f-4277-b4c2-e2651a4cc447 req-ffdde11c-4d00-4467-8326-e3a3b26762c0 service nova] Acquiring lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-826d4470-8b7f-4277-b4c2-e2651a4cc447 req-ffdde11c-4d00-4467-8326-e3a3b26762c0 service nova] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-826d4470-8b7f-4277-b4c2-e2651a4cc447 req-ffdde11c-4d00-4467-8326-e3a3b26762c0 service nova] Lock "73cc50c0-f4e2-4a5f-92f6-84aa50cf5449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:11 user nova-compute[74692]: DEBUG nova.compute.manager [req-826d4470-8b7f-4277-b4c2-e2651a4cc447 req-ffdde11c-4d00-4467-8326-e3a3b26762c0 service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] No waiting events found dispatching network-vif-plugged-539dfea4-e055-4443-ace6-20e5df4740d7 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:51:11 user nova-compute[74692]: WARNING nova.compute.manager [req-826d4470-8b7f-4277-b4c2-e2651a4cc447 req-ffdde11c-4d00-4467-8326-e3a3b26762c0 service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Received unexpected event network-vif-plugged-539dfea4-e055-4443-ace6-20e5df4740d7 for instance with vm_state deleted and task_state None.
Nov 18 18:51:11 user nova-compute[74692]: DEBUG nova.compute.manager [req-826d4470-8b7f-4277-b4c2-e2651a4cc447 req-ffdde11c-4d00-4467-8326-e3a3b26762c0 service nova] [instance: 73cc50c0-f4e2-4a5f-92f6-84aa50cf5449] Received event network-vif-deleted-539dfea4-e055-4443-ace6-20e5df4740d7 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:51:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:51:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:51:24 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:51:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:24 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:51:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:51:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:51:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:26 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:51:26 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:51:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8326MB free_disk=24.931034088134766GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:51:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:27 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:51:27 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fd9a073-962e-44de-9252-2d5e339093bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:51:27 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d17071fc-5d5b-4e06-8a47-05174014167c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:51:27 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:51:27 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance ac108610-6f06-48e0-93fe-14563906178c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:51:27 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 18fc06c8-a112-462b-8302-83a41ee9c352 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:51:27 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:51:27 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:51:27 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:51:27 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:51:27 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:51:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:51:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:51:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:51:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:51:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:51:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:51:30 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:51:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:51:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:31 user nova-compute[74692]: INFO nova.compute.manager [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Terminating instance
Nov 18 18:51:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:51:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-c64f40a1-a57e-4ea1-8557-c917826d416a req-e75b1cb2-2945-4643-b13b-3c7af229cfa3 service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received event network-vif-unplugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:51:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c64f40a1-a57e-4ea1-8557-c917826d416a req-e75b1cb2-2945-4643-b13b-3c7af229cfa3 service nova] Acquiring lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c64f40a1-a57e-4ea1-8557-c917826d416a req-e75b1cb2-2945-4643-b13b-3c7af229cfa3 service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c64f40a1-a57e-4ea1-8557-c917826d416a req-e75b1cb2-2945-4643-b13b-3c7af229cfa3 service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-c64f40a1-a57e-4ea1-8557-c917826d416a req-e75b1cb2-2945-4643-b13b-3c7af229cfa3 service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] No waiting events found dispatching network-vif-unplugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:51:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-c64f40a1-a57e-4ea1-8557-c917826d416a req-e75b1cb2-2945-4643-b13b-3c7af229cfa3 service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received event network-vif-unplugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:51:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Instance destroyed successfully.
Nov 18 18:51:32 user nova-compute[74692]: DEBUG nova.objects.instance [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lazy-loading 'resources' on Instance uuid 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-706612544',display_name='tempest-ServerActionsTestOtherA-server-706612544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-706612544',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaznf7JGrfMrJRV86vaxqKuCfM3AcEaoWdApdT43PQu2+VRfP7TdWdgnZDzhSHo94Y2Q6y7Dc8YLTCn+JC1yHxyJqY3YZNW3EenEWfmQ3/zXDAHD9n+p1yEmT0Bxd5Ldw==',key_name='tempest-keypair-1438330061',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:47:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdb006c6267b42fab703cfc24d93052e',ramdisk_id='',reservation_id='r-0k8ny0uk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2047740053',owner_user_name='tempest-ServerActionsTestOtherA-2047740053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d126349e69864417bb5e02666efd534c',uuid=7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converting VIF {"id": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "address": "fa:16:3e:7c:a6:af", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap279d81c2-cb", "ovs_interfaceid": "279d81c2-cb3c-4e20-9daf-e418dbb20a2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=279d81c2-cb3c-4e20-9daf-e418dbb20a2a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap279d81c2-cb') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_vif [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=279d81c2-cb3c-4e20-9daf-e418dbb20a2a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap279d81c2-cb') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap279d81c2-cb, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba25c4a4-aade-42fe-9dd8-a48e942fb882) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:32 user nova-compute[74692]: INFO os_vif [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=279d81c2-cb3c-4e20-9daf-e418dbb20a2a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap279d81c2-cb')
Nov 18 18:51:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIgfzFya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:51:32 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1dc0c5-7586-44b5-830e-ca5150679fbb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:51:32 user nova-compute[74692]: No targets found.
Nov 18 18:51:32 user nova-compute[74692]: iSNS:
Nov 18 18:51:32 user nova-compute[74692]: No targets found.
Nov 18 18:51:32 user nova-compute[74692]: STATIC:
Nov 18 18:51:32 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305
Nov 18 18:51:32 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:51:32 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:51:32 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:51:32 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:51:32 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:51:32 user nova-compute[74692]: FIRMWARE:
Nov 18 18:51:32 user nova-compute[74692]: No targets found.
Nov 18 18:51:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:51:32 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:51:32 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[940dc5a2-037b-44ea-b17a-74276cfe5f2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b151220-994e-4d41-92fd-ca62ee523848]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:51:32 user nova-compute[74692]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:51:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:51:32 user nova-compute[74692]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 (non-flash)
Nov 18 18:51:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41d418ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305'): ({'sde'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Removing single pathed devices sde {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b69472-7b31-4b31-a97c-416509f97eff]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d76bd3-37f7-4c09-9c36-7f73c573b466]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Flushing IO for device /dev/sde {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e54bf18-1356-494b-b4b4-dd3062738f08]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[55524ca3-519b-4a65-990b-781bfa4da18f]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] SCSI volumes sde have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_72cbf55c', '/dev/disk/by-id/scsi-1SCST_BIO72cbf55c-fcc4f0aff5228df4', '/dev/disk/by-id/scsi-26663633466306166') {{(pid=84932) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a20d30-0e1c-4bf8-9ffa-ad2cbacc389b]: (4, None) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[014fcf07-b940-472e-8e86-b2f822e44e75]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b62ae94-d287-432d-a8df-6259a3c71b77]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260]
Nov 18 18:51:32 user nova-compute[74692]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305, portal: 172.16.0.220,3260] successful.
Nov 18 18:51:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca057ef-6541-4082-aa0e-662f53f9a305 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[648d5067-ad17-4c4e-bd6f-cf8703c83710]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] <== disconnect_volume: return (306ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:51:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Deleting instance files /opt/stack/data/nova/instances/7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d_del
Nov 18 18:51:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Deletion of /opt/stack/data/nova/instances/7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d_del complete
Nov 18 18:51:32 user nova-compute[74692]: INFO nova.compute.manager [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 18 18:51:32 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:51:32 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:51:33 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:51:33 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Took 0.73 seconds to deallocate network for instance.
Nov 18 18:51:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-8b84a1d8-4ee5-4e1d-8c99-f37436bc78df req-454f72c3-d465-4680-973a-a7520a8527d7 service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received event network-vif-deleted-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:51:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-46dad80f-00ab-403b-99e2-408c8d49ee2c req-2c03cf8b-05d6-4e1e-ab2f-f326137e3a9c service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received event network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:51:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-46dad80f-00ab-403b-99e2-408c8d49ee2c req-2c03cf8b-05d6-4e1e-ab2f-f326137e3a9c service nova] Acquiring lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-46dad80f-00ab-403b-99e2-408c8d49ee2c req-2c03cf8b-05d6-4e1e-ab2f-f326137e3a9c service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-46dad80f-00ab-403b-99e2-408c8d49ee2c req-2c03cf8b-05d6-4e1e-ab2f-f326137e3a9c service nova] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-46dad80f-00ab-403b-99e2-408c8d49ee2c req-2c03cf8b-05d6-4e1e-ab2f-f326137e3a9c service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] No waiting events found dispatching network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:51:33 user nova-compute[74692]: WARNING nova.compute.manager [req-46dad80f-00ab-403b-99e2-408c8d49ee2c req-2c03cf8b-05d6-4e1e-ab2f-f326137e3a9c service nova] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Received unexpected event network-vif-plugged-279d81c2-cb3c-4e20-9daf-e418dbb20a2a for instance with vm_state active and task_state deleting.
Nov 18 18:51:34 user nova-compute[74692]: INFO nova.compute.manager [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Took 0.75 seconds to detach 1 volumes for instance.
Nov 18 18:51:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d] Deleting volume: 0ca057ef-6541-4082-aa0e-662f53f9a305 {{(pid=74692) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 18:51:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:34 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:51:34 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:51:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:34 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Deleted allocations for instance 7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d
Nov 18 18:51:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ab93c89e-18ad-4e46-b975-c76cfa937e4b tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "7f3faf4c-2f20-40b2-b8a8-5e73fdbc417d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.104s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:51:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:51:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:51:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:51:35 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:51:35 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Updating instance_info_cache with network_info: [{"id": "42c3c7e8-f568-4a60-9613-152317e0543a", "address": "fa:16:3e:13:1b:f6", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42c3c7e8-f5", "ovs_interfaceid": "42c3c7e8-f568-4a60-9613-152317e0543a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:51:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-3fd9a073-962e-44de-9252-2d5e339093bc" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:51:35 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:51:35 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:51:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:51:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "ac108610-6f06-48e0-93fe-14563906178c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:50 user nova-compute[74692]: DEBUG nova.objects.instance [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lazy-loading 'flavor' on Instance uuid ac108610-6f06-48e0-93fe-14563906178c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:51:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "ac108610-6f06-48e0-93fe-14563906178c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "ac108610-6f06-48e0-93fe-14563906178c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:50 user nova-compute[74692]: INFO nova.compute.manager [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Attaching volume 6be70347-3504-4271-bc4b-97420f1ac1b8 to /dev/vdb
Nov 18 18:51:50 user nova-compute[74692]: DEBUG os_brick.utils [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:51:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54a87f4-c0f6-4e1b-a6bf-61115fa62569]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[013d503b-668c-4a61-950c-ebe688657a6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84d8ab3-e35d-45f8-9d01-3a6aa29a2a2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1182cd78-3f5e-43ec-bd6e-7ab85802d425]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:51:51 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:51:51 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[67473c51-8726-466d-80a8-6ed24172985c]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG os_brick.utils [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:51:51 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updating existing volume attachment record: d835a294-0f4c-4145-a5a8-ec5eddc6c51c {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:51:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLvaUhPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:51:56 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:51:56 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:51:56 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ada7f79-10fe-4beb-9fef-b79d0f6aef6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:51:56 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d58759c-db8d-4d8f-9060-7abe346b295d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8] added
Nov 18 18:51:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[488561a5-6ba2-41bf-9b17-12018bf1928f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c7d124-d808-4a0e-9aab-957745b950f2]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dLvaUhPB {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dLvaUhPB" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6528c042-b5a8-4d5b-82d2-6ddacecf7dd2]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dLvaUhPB'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57de569-c278-45bd-981a-06bf5c0239d7]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e0e965-6a9a-4f87-8f1c-649fae3c841a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:51:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:51:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac856331-205c-4b58-9071-334003617dee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260]
Nov 18 18:51:56 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260] successful.
Nov 18 18:51:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1827deb8-945e-4d82-98f7-278006ae0c09]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1906778-aaa3-43f8-8d6b-95cc649d0f6e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:51:56 user nova-compute[74692]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:51:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:51:56 user nova-compute[74692]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:51:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[873041f5-0c4f-452e-9cad-33487dd92587]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:51:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLvaUhPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:51:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:51:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23633303636666336', 'path': '/dev/sdc'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:51:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633303636666336', 'path': '/dev/sdc'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:51:57 user nova-compute[74692]: DEBUG nova.objects.instance [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lazy-loading 'flavor' on Instance uuid ac108610-6f06-48e0-93fe-14563906178c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:51:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:51:57 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:51:57 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:51:57 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:51:57 user nova-compute[74692]:   <serial>6be70347-3504-4271-bc4b-97420f1ac1b8</serial>
Nov 18 18:51:57 user nova-compute[74692]: </disk>
Nov 18 18:51:57 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:51:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:51:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:51:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] No VIF found with MAC fa:16:3e:2e:f7:c5, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:51:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5678eda7-bf8b-459f-bccf-62f53a00f644 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "ac108610-6f06-48e0-93fe-14563906178c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.182s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "d17071fc-5d5b-4e06-8a47-05174014167c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:59 user nova-compute[74692]: INFO nova.compute.manager [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Terminating instance
Nov 18 18:51:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:51:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-008b74b5-ee50-46af-85af-6a7cbfa04f75 req-510bf2c4-f9df-498e-a2dd-84a21fac9db4 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received event network-vif-unplugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:51:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-008b74b5-ee50-46af-85af-6a7cbfa04f75 req-510bf2c4-f9df-498e-a2dd-84a21fac9db4 service nova] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:51:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-008b74b5-ee50-46af-85af-6a7cbfa04f75 req-510bf2c4-f9df-498e-a2dd-84a21fac9db4 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:51:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-008b74b5-ee50-46af-85af-6a7cbfa04f75 req-510bf2c4-f9df-498e-a2dd-84a21fac9db4 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:51:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-008b74b5-ee50-46af-85af-6a7cbfa04f75 req-510bf2c4-f9df-498e-a2dd-84a21fac9db4 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] No waiting events found dispatching network-vif-unplugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:51:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-008b74b5-ee50-46af-85af-6a7cbfa04f75 req-510bf2c4-f9df-498e-a2dd-84a21fac9db4 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received event network-vif-unplugged-14c60d63-2b64-480b-bd2e-8a26567cab7e for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:51:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:51:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:00 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Instance destroyed successfully.
Nov 18 18:52:00 user nova-compute[74692]: DEBUG nova.objects.instance [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'resources' on Instance uuid d17071fc-5d5b-4e06-8a47-05174014167c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-677677591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-677677591',id=23,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:38:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='704ef46081d04fc7a0ed88456cbe9fe8',ramdisk_id='',reservation_id='r-428x2dz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-199647198',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:39:59Z,user_data=None,user_id='1233b31e12dc4d5796a60327d93c3bfb',uuid=d17071fc-5d5b-4e06-8a47-05174014167c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converting VIF {"id": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "address": "fa:16:3e:f2:01:49", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c60d63-2b", "ovs_interfaceid": "14c60d63-2b64-480b-bd2e-8a26567cab7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:01:49,bridge_name='br-int',has_traffic_filtering=True,id=14c60d63-2b64-480b-bd2e-8a26567cab7e,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c60d63-2b') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_vif [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:01:49,bridge_name='br-int',has_traffic_filtering=True,id=14c60d63-2b64-480b-bd2e-8a26567cab7e,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c60d63-2b') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14c60d63-2b, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4bb753fa-1cfb-4c43-b13c-b8cfbe7d2da1) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:00 user nova-compute[74692]: INFO os_vif [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:01:49,bridge_name='br-int',has_traffic_filtering=True,id=14c60d63-2b64-480b-bd2e-8a26567cab7e,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c60d63-2b')
Nov 18 18:52:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXzvMjCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:52:00 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1259e2-b4ff-4b67-8ba6-15a8a9e5520a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:52:00 user nova-compute[74692]: No targets found.
Nov 18 18:52:00 user nova-compute[74692]: iSNS:
Nov 18 18:52:00 user nova-compute[74692]: No targets found.
Nov 18 18:52:00 user nova-compute[74692]: STATIC:
Nov 18 18:52:00 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8
Nov 18 18:52:00 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:52:00 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:52:00 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962
Nov 18 18:52:00 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:52:00 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:52:00 user nova-compute[74692]: FIRMWARE:
Nov 18 18:52:00 user nova-compute[74692]: No targets found.
Nov 18 18:52:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:52:00 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:52:00 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91fe4f6-fdd8-4b41-b39f-f0dc07c8d2be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[222a315e-6745-421f-ae6a-154a167c50e9]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:52:00 user nova-compute[74692]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:52:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 (non-flash)
Nov 18 18:52:00 user nova-compute[74692]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:52:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a455add0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51fbc40-7013-484c-9adf-644f9ee3a2cc]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5907a1a-b62d-45cf-a8a7-2c966befa1fd]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1d773e-9d90-4821-8bcf-af5fdf8affdc]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c629ea87-5259-4a02-a8b4-d529a9d4e522]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[70345ec3-dd27-4ba1-82d3-02f866365e57]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7746f2e-d3f2-4ef7-949b-308bf6227aba]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962, portal: 172.16.0.220,3260]
Nov 18 18:52:00 user nova-compute[74692]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962, portal: 172.16.0.220,3260] successful.
Nov 18 18:52:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f918f8b1-52ea-4a14-8217-1c1fe0d18962 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22a60fc-c11b-42b8-906b-72ca11261195]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] <== disconnect_volume: return (292ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:52:00 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Deleting instance files /opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c_del
Nov 18 18:52:00 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Deletion of /opt/stack/data/nova/instances/d17071fc-5d5b-4e06-8a47-05174014167c_del complete
Nov 18 18:52:00 user nova-compute[74692]: INFO nova.compute.manager [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 18 18:52:00 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:52:00 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:52:01 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:52:01 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Took 0.53 seconds to deallocate network for instance.
Nov 18 18:52:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-80a43112-89aa-4abf-858a-f4ac359480bd req-b9f14834-a9bd-4f87-a0bd-7043723970a4 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received event network-vif-deleted-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:52:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-00ba5b30-44ca-41cc-8a21-c78ea29cd0de req-94ef76e2-acb7-435f-a4df-c5472088eac2 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:52:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-00ba5b30-44ca-41cc-8a21-c78ea29cd0de req-94ef76e2-acb7-435f-a4df-c5472088eac2 service nova] Acquiring lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-00ba5b30-44ca-41cc-8a21-c78ea29cd0de req-94ef76e2-acb7-435f-a4df-c5472088eac2 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-00ba5b30-44ca-41cc-8a21-c78ea29cd0de req-94ef76e2-acb7-435f-a4df-c5472088eac2 service nova] Lock "d17071fc-5d5b-4e06-8a47-05174014167c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-00ba5b30-44ca-41cc-8a21-c78ea29cd0de req-94ef76e2-acb7-435f-a4df-c5472088eac2 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] No waiting events found dispatching network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:52:01 user nova-compute[74692]: WARNING nova.compute.manager [req-00ba5b30-44ca-41cc-8a21-c78ea29cd0de req-94ef76e2-acb7-435f-a4df-c5472088eac2 service nova] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Received unexpected event network-vif-plugged-14c60d63-2b64-480b-bd2e-8a26567cab7e for instance with vm_state active and task_state deleting.
Nov 18 18:52:02 user nova-compute[74692]: INFO nova.compute.manager [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: d17071fc-5d5b-4e06-8a47-05174014167c] Took 0.71 seconds to detach 1 volumes for instance.
Nov 18 18:52:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:02 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:52:02 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:52:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:02 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Deleted allocations for instance d17071fc-5d5b-4e06-8a47-05174014167c
Nov 18 18:52:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aa85be2f-2d5b-4c73-90bc-3505d10de7c7 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "d17071fc-5d5b-4e06-8a47-05174014167c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.837s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-158fedf8-9802-424b-ba3f-83d98e99431a req-2d99aa1a-e48c-40e7-88ff-c677b4fb30f9 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-changed-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:52:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-158fedf8-9802-424b-ba3f-83d98e99431a req-2d99aa1a-e48c-40e7-88ff-c677b4fb30f9 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Refreshing instance network info cache due to event network-changed-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:52:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-158fedf8-9802-424b-ba3f-83d98e99431a req-2d99aa1a-e48c-40e7-88ff-c677b4fb30f9 service nova] Acquiring lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:52:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-158fedf8-9802-424b-ba3f-83d98e99431a req-2d99aa1a-e48c-40e7-88ff-c677b4fb30f9 service nova] Acquired lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:52:03 user nova-compute[74692]: DEBUG nova.network.neutron [req-158fedf8-9802-424b-ba3f-83d98e99431a req-2d99aa1a-e48c-40e7-88ff-c677b4fb30f9 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Refreshing network info cache for port 2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:52:04 user nova-compute[74692]: DEBUG nova.network.neutron [req-158fedf8-9802-424b-ba3f-83d98e99431a req-2d99aa1a-e48c-40e7-88ff-c677b4fb30f9 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updated VIF entry in instance network info cache for port 2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:52:04 user nova-compute[74692]: DEBUG nova.network.neutron [req-158fedf8-9802-424b-ba3f-83d98e99431a req-2d99aa1a-e48c-40e7-88ff-c677b4fb30f9 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updating instance_info_cache with network_info: [{"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:52:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-158fedf8-9802-424b-ba3f-83d98e99431a req-2d99aa1a-e48c-40e7-88ff-c677b4fb30f9 service nova] Releasing lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:52:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-4b52ec2b-69be-4d00-a000-1f54114373d6 req-5d55e94a-bb73-4f99-b5d0-89a9ff20a1b0 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-changed-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:52:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-4b52ec2b-69be-4d00-a000-1f54114373d6 req-5d55e94a-bb73-4f99-b5d0-89a9ff20a1b0 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Refreshing instance network info cache due to event network-changed-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:52:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4b52ec2b-69be-4d00-a000-1f54114373d6 req-5d55e94a-bb73-4f99-b5d0-89a9ff20a1b0 service nova] Acquiring lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:52:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4b52ec2b-69be-4d00-a000-1f54114373d6 req-5d55e94a-bb73-4f99-b5d0-89a9ff20a1b0 service nova] Acquired lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:52:06 user nova-compute[74692]: DEBUG nova.network.neutron [req-4b52ec2b-69be-4d00-a000-1f54114373d6 req-5d55e94a-bb73-4f99-b5d0-89a9ff20a1b0 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Refreshing network info cache for port 2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:52:06 user nova-compute[74692]: DEBUG nova.network.neutron [req-4b52ec2b-69be-4d00-a000-1f54114373d6 req-5d55e94a-bb73-4f99-b5d0-89a9ff20a1b0 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updated VIF entry in instance network info cache for port 2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:52:06 user nova-compute[74692]: DEBUG nova.network.neutron [req-4b52ec2b-69be-4d00-a000-1f54114373d6 req-5d55e94a-bb73-4f99-b5d0-89a9ff20a1b0 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updating instance_info_cache with network_info: [{"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:52:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4b52ec2b-69be-4d00-a000-1f54114373d6 req-5d55e94a-bb73-4f99-b5d0-89a9ff20a1b0 service nova] Releasing lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:52:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "ac108610-6f06-48e0-93fe-14563906178c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:08 user nova-compute[74692]: INFO nova.compute.manager [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Rebooting instance
Nov 18 18:52:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:52:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquired lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:52:08 user nova-compute[74692]: DEBUG nova.network.neutron [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:52:08 user nova-compute[74692]: DEBUG nova.network.neutron [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updating instance_info_cache with network_info: [{"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:52:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Releasing lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:52:08 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-c5131c41-cd15-4e47-87cd-289c4a2176b4 req-6690cf93-a43d-4a23-a0c7-821b2438f23f service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-vif-unplugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c5131c41-cd15-4e47-87cd-289c4a2176b4 req-6690cf93-a43d-4a23-a0c7-821b2438f23f service nova] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c5131c41-cd15-4e47-87cd-289c4a2176b4 req-6690cf93-a43d-4a23-a0c7-821b2438f23f service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c5131c41-cd15-4e47-87cd-289c4a2176b4 req-6690cf93-a43d-4a23-a0c7-821b2438f23f service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-c5131c41-cd15-4e47-87cd-289c4a2176b4 req-6690cf93-a43d-4a23-a0c7-821b2438f23f service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] No waiting events found dispatching network-vif-unplugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:52:09 user nova-compute[74692]: WARNING nova.compute.manager [req-c5131c41-cd15-4e47-87cd-289c4a2176b4 req-6690cf93-a43d-4a23-a0c7-821b2438f23f service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received unexpected event network-vif-unplugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 for instance with vm_state active and task_state reboot_started_hard.
Nov 18 18:52:09 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: ac108610-6f06-48e0-93fe-14563906178c] Instance destroyed successfully.
Nov 18 18:52:09 user nova-compute[74692]: DEBUG nova.objects.instance [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lazy-loading 'resources' on Instance uuid ac108610-6f06-48e0-93fe-14563906178c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-393233064',display_name='tempest-TestMinimumBasicScenario-server-393233064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-393233064',id=35,image_ref='180cb580-e4b8-404f-9bc6-d48f84e37d71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNA4KvlxqrTIIKDvhSKfJ3XU3ntHC/3i/+xwD/BIw+RSHdiP8VwGhtxhDQjwPdH4a0qcX71w/dHEHyruK0pUhAiQzvFhCoAz0JtAhfXvdzxPBo36TRfUwQwTRuz8StN8g==',key_name='tempest-TestMinimumBasicScenario-812410050',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:50:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eff44b3a1f5486296f293bcaa879f04',ramdisk_id='',reservation_id='r-2te0wbel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='180cb580-e4b8-404f-9bc6-d48f84e37d71',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1654716799',owner_user_name='tempest-TestMinimumBasicScenario-1654716799-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:52:09Z,user_data=None,user_id='81e4fbd0fddf4c0d8051c4020165681a',uuid=ac108610-6f06-48e0-93fe-14563906178c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converting VIF {"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7a0ee4-6a') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG os_vif [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7a0ee4-6a') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e7a0ee4-6a, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=888d37fa-bfd0-4c61-ba90-513ad0576455) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:52:09 user nova-compute[74692]: INFO os_vif [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7a0ee4-6a')
Nov 18 18:52:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLvaUhPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:52:09 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:52:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a662bbe5-58cb-4929-8e76-d38ee747e543]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:52:09 user nova-compute[74692]: No targets found.
Nov 18 18:52:09 user nova-compute[74692]: iSNS:
Nov 18 18:52:09 user nova-compute[74692]: No targets found.
Nov 18 18:52:09 user nova-compute[74692]: STATIC:
Nov 18 18:52:09 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8
Nov 18 18:52:09 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:52:09 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:52:09 user nova-compute[74692]: FIRMWARE:
Nov 18 18:52:09 user nova-compute[74692]: No targets found.
Nov 18 18:52:09 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:52:09 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:52:09 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac297ba-da1a-4b9f-8b9f-aaeeb42669dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6ac368-ee38-45a6-9b15-f1a88bc056eb]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:52:09 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:52:09 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a455b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8'): ({'sdc'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Removing single pathed devices sdc {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a7acf6-36b9-487c-b17a-9be1f4a03f2f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[348b68ba-d2c3-48e0-bf33-4f29bd6a4b28]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Flushing IO for device /dev/sdc {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c0df79-c8a7-4a03-b3b5-dd1f58a19fab]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:52:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[52520efa-7a80-4691-8c2c-65d43771012f]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a39c9d-7959-4817-8220-5d527dc7d9a2]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cecbb43-747d-43ec-8823-1869cc4ab51c]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260]
Nov 18 18:52:10 user nova-compute[74692]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260] successful.
Nov 18 18:52:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0809b9-888e-456e-9c51-ca891593cdbc]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] <== disconnect_volume: return (292ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Start _get_guest_xml network_info=[{"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=180cb580-e4b8-404f-9bc6-d48f84e37d71,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '180cb580-e4b8-404f-9bc6-d48f84e37d71'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLvaUhPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'ac108610-6f06-48e0-93fe-14563906178c', 'attached_at': '', 'detached_at': '', 'volume_id': '6be70347-3504-4271-bc4b-97420f1ac1b8', 'serial': '6be70347-3504-4271-bc4b-97420f1ac1b8'}, 'attachment_id': 'd835a294-0f4c-4145-a5a8-ec5eddc6c51c', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:52:10 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:52:10 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=180cb580-e4b8-404f-9bc6-d48f84e37d71,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.objects.instance [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lazy-loading 'vcpu_model' on Instance uuid ac108610-6f06-48e0-93fe-14563906178c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.objects.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Object Instance<ac108610-6f06-48e0-93fe-14563906178c> lazy-loaded attributes: resources,vcpu_model {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLvaUhPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:52:10 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:52:10 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:52:10 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2f6722-e259-4993-a1c3-9e6381ec055b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:52:10 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e163308-6d5e-45d5-a268-069ecc6167a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8] added
Nov 18 18:52:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eafb16-aea9-41c6-868f-4a7f9a60e807]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8669b9c-bc39-4c1f-a276-646aaea606c5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dLvaUhPB {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dLvaUhPB" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa864e3d-bfdf-4f6e-bed9-7d7119ca08ce]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dLvaUhPB'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d914106e-e49b-45de-a3ec-fbd8e3c473c8]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e8c0de-a1a0-4b57-b530-52e0f968e9cb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 18:52:10 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 18:52:10 user nova-compute[74692]:  {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:52:10 user nova-compute[74692]: WARNING os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 18:52:10 user nova-compute[74692]: 
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3ae7e0-85df-4dbc-8297-d00d09b80858]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260]
Nov 18 18:52:10 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260] successful.
Nov 18 18:52:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.127s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[296407a7-6335-4c2d-8183-598cdb288b74]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1badef-ffa0-4959-bc52-0e5767eba32f]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:52:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:52:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.452s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f4d570-918b-44e3-bf2e-538449f79379]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG nova.compute.manager [req-8c5afdee-6f7b-4b2d-bf89-520072bc6e4e req-554554cd-c8f7-440c-b8bb-428172ba9a0f service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8c5afdee-6f7b-4b2d-bf89-520072bc6e4e req-554554cd-c8f7-440c-b8bb-428172ba9a0f service nova] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8c5afdee-6f7b-4b2d-bf89-520072bc6e4e req-554554cd-c8f7-440c-b8bb-428172ba9a0f service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8c5afdee-6f7b-4b2d-bf89-520072bc6e4e req-554554cd-c8f7-440c-b8bb-428172ba9a0f service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG nova.compute.manager [req-8c5afdee-6f7b-4b2d-bf89-520072bc6e4e req-554554cd-c8f7-440c-b8bb-428172ba9a0f service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] No waiting events found dispatching network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:52:11 user nova-compute[74692]: WARNING nova.compute.manager [req-8c5afdee-6f7b-4b2d-bf89-520072bc6e4e req-554554cd-c8f7-440c-b8bb-428172ba9a0f service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received unexpected event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 for instance with vm_state active and task_state reboot_started_hard.
Nov 18 18:52:11 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLvaUhPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.485s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] <== connect_volume: return (1486ms) {'type': 'block', 'scsi_wwn': '23633303636666336', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633303636666336', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-393233064',display_name='tempest-TestMinimumBasicScenario-server-393233064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-393233064',id=35,image_ref='180cb580-e4b8-404f-9bc6-d48f84e37d71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNA4KvlxqrTIIKDvhSKfJ3XU3ntHC/3i/+xwD/BIw+RSHdiP8VwGhtxhDQjwPdH4a0qcX71w/dHEHyruK0pUhAiQzvFhCoAz0JtAhfXvdzxPBo36TRfUwQwTRuz8StN8g==',key_name='tempest-TestMinimumBasicScenario-812410050',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:50:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eff44b3a1f5486296f293bcaa879f04',ramdisk_id='',reservation_id='r-2te0wbel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='180cb580-e4b8-404f-9bc6-d48f84e37d71',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1654716799',owner_user_name='tempest-TestMinimumBasicScenario-1654716799-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:52:09Z,user_data=None,user_id='81e4fbd0fddf4c0d8051c4020165681a',uuid=ac108610-6f06-48e0-93fe-14563906178c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converting VIF {"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7a0ee4-6a') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG nova.objects.instance [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lazy-loading 'pci_devices' on Instance uuid ac108610-6f06-48e0-93fe-14563906178c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG nova.objects.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Object Instance<ac108610-6f06-48e0-93fe-14563906178c> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:52:11 user nova-compute[74692]:   <uuid>ac108610-6f06-48e0-93fe-14563906178c</uuid>
Nov 18 18:52:11 user nova-compute[74692]:   <name>instance-00000023</name>
Nov 18 18:52:11 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:52:11 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:52:11 user nova-compute[74692]:   <metadata>
Nov 18 18:52:11 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:52:11 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:52:11 user nova-compute[74692]:       <nova:name>tempest-TestMinimumBasicScenario-server-393233064</nova:name>
Nov 18 18:52:11 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:52:10</nova:creationTime>
Nov 18 18:52:11 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:52:11 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:52:11 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:52:11 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:52:11 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:52:11 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:52:11 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:52:11 user nova-compute[74692]:       <nova:owner>
Nov 18 18:52:11 user nova-compute[74692]:         <nova:user uuid="81e4fbd0fddf4c0d8051c4020165681a">tempest-TestMinimumBasicScenario-1654716799-project-member</nova:user>
Nov 18 18:52:11 user nova-compute[74692]:         <nova:project uuid="7eff44b3a1f5486296f293bcaa879f04">tempest-TestMinimumBasicScenario-1654716799</nova:project>
Nov 18 18:52:11 user nova-compute[74692]:       </nova:owner>
Nov 18 18:52:11 user nova-compute[74692]:       <nova:root type="image" uuid="180cb580-e4b8-404f-9bc6-d48f84e37d71"/>
Nov 18 18:52:11 user nova-compute[74692]:       <nova:ports>
Nov 18 18:52:11 user nova-compute[74692]:         <nova:port uuid="2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5">
Nov 18 18:52:11 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 18 18:52:11 user nova-compute[74692]:         </nova:port>
Nov 18 18:52:11 user nova-compute[74692]:       </nova:ports>
Nov 18 18:52:11 user nova-compute[74692]:     </nova:instance>
Nov 18 18:52:11 user nova-compute[74692]:   </metadata>
Nov 18 18:52:11 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:52:11 user nova-compute[74692]:     <system>
Nov 18 18:52:11 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:52:11 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:52:11 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:52:11 user nova-compute[74692]:       <entry name="serial">ac108610-6f06-48e0-93fe-14563906178c</entry>
Nov 18 18:52:11 user nova-compute[74692]:       <entry name="uuid">ac108610-6f06-48e0-93fe-14563906178c</entry>
Nov 18 18:52:11 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:52:11 user nova-compute[74692]:     </system>
Nov 18 18:52:11 user nova-compute[74692]:   </sysinfo>
Nov 18 18:52:11 user nova-compute[74692]:   <os>
Nov 18 18:52:11 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:52:11 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:52:11 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:52:11 user nova-compute[74692]:   </os>
Nov 18 18:52:11 user nova-compute[74692]:   <features>
Nov 18 18:52:11 user nova-compute[74692]:     <acpi/>
Nov 18 18:52:11 user nova-compute[74692]:     <apic/>
Nov 18 18:52:11 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:52:11 user nova-compute[74692]:   </features>
Nov 18 18:52:11 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:52:11 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:52:11 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:52:11 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:52:11 user nova-compute[74692]:   </clock>
Nov 18 18:52:11 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:52:11 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:52:11 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:52:11 user nova-compute[74692]:   </cpu>
Nov 18 18:52:11 user nova-compute[74692]:   <devices>
Nov 18 18:52:11 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:52:11 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:52:11 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk"/>
Nov 18 18:52:11 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:52:11 user nova-compute[74692]:     </disk>
Nov 18 18:52:11 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:52:11 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:52:11 user nova-compute[74692]:       <source dev="/dev/sdb"/>
Nov 18 18:52:11 user nova-compute[74692]:       <target dev="vdb" bus="virtio"/>
Nov 18 18:52:11 user nova-compute[74692]:       <serial>6be70347-3504-4271-bc4b-97420f1ac1b8</serial>
Nov 18 18:52:11 user nova-compute[74692]:     </disk>
Nov 18 18:52:11 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:52:11 user nova-compute[74692]:       <mac address="fa:16:3e:2e:f7:c5"/>
Nov 18 18:52:11 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:52:11 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:52:11 user nova-compute[74692]:       <target dev="tap2e7a0ee4-6a"/>
Nov 18 18:52:11 user nova-compute[74692]:     </interface>
Nov 18 18:52:11 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:52:11 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/console.log" append="off"/>
Nov 18 18:52:11 user nova-compute[74692]:     </serial>
Nov 18 18:52:11 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:52:11 user nova-compute[74692]:     <video>
Nov 18 18:52:11 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:52:11 user nova-compute[74692]:     </video>
Nov 18 18:52:11 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:52:11 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:52:11 user nova-compute[74692]:     </rng>
Nov 18 18:52:11 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:52:11 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:52:11 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:52:11 user nova-compute[74692]:     </memballoon>
Nov 18 18:52:11 user nova-compute[74692]:   </devices>
Nov 18 18:52:11 user nova-compute[74692]: </domain>
Nov 18 18:52:11 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG nova.objects.instance [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lazy-loading 'trusted_certs' on Instance uuid ac108610-6f06-48e0-93fe-14563906178c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG nova.objects.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Object Instance<ac108610-6f06-48e0-93fe-14563906178c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Cannot resize image /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG nova.objects.instance [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lazy-loading 'migration_context' on Instance uuid ac108610-6f06-48e0-93fe-14563906178c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG nova.objects.base [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Object Instance<ac108610-6f06-48e0-93fe-14563906178c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-393233064',display_name='tempest-TestMinimumBasicScenario-server-393233064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-393233064',id=35,image_ref='180cb580-e4b8-404f-9bc6-d48f84e37d71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNA4KvlxqrTIIKDvhSKfJ3XU3ntHC/3i/+xwD/BIw+RSHdiP8VwGhtxhDQjwPdH4a0qcX71w/dHEHyruK0pUhAiQzvFhCoAz0JtAhfXvdzxPBo36TRfUwQwTRuz8StN8g==',key_name='tempest-TestMinimumBasicScenario-812410050',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:50:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='7eff44b3a1f5486296f293bcaa879f04',ramdisk_id='',reservation_id='r-2te0wbel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='180cb580-e4b8-404f-9bc6-d48f84e37d71',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1654716799',owner_user_name='tempest-TestMinimumBasicScenario-1654716799-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:52:09Z,user_data=None,user_id='81e4fbd0fddf4c0d8051c4020165681a',uuid=ac108610-6f06-48e0-93fe-14563906178c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converting VIF {"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7a0ee4-6a') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG os_vif [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7a0ee4-6a') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31762cfe-2585-5d19-aa7d-cf0d9782e3e7', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e7a0ee4-6a, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e7a0ee4-6a, col_values=(('qos', UUID('dfd25ec4-8024-4e77-bd31-d949e37dc56f')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e7a0ee4-6a, col_values=(('external_ids', {'iface-id': '2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:f7:c5', 'vm-uuid': 'ac108610-6f06-48e0-93fe-14563906178c'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:52:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:12 user nova-compute[74692]: INFO os_vif [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7a0ee4-6a')
Nov 18 18:52:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-36541686-c689-411b-96d5-ca1bb04c10ca req-f5deef09-f98b-48c2-b3f3-012f7db8293b service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:52:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-36541686-c689-411b-96d5-ca1bb04c10ca req-f5deef09-f98b-48c2-b3f3-012f7db8293b service nova] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-36541686-c689-411b-96d5-ca1bb04c10ca req-f5deef09-f98b-48c2-b3f3-012f7db8293b service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-36541686-c689-411b-96d5-ca1bb04c10ca req-f5deef09-f98b-48c2-b3f3-012f7db8293b service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-36541686-c689-411b-96d5-ca1bb04c10ca req-f5deef09-f98b-48c2-b3f3-012f7db8293b service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] No waiting events found dispatching network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:52:14 user nova-compute[74692]: WARNING nova.compute.manager [req-36541686-c689-411b-96d5-ca1bb04c10ca req-f5deef09-f98b-48c2-b3f3-012f7db8293b service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received unexpected event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 for instance with vm_state active and task_state reboot_started_hard.
Nov 18 18:52:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:15 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:52:15 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: ac108610-6f06-48e0-93fe-14563906178c] Instance rebooted successfully.
Nov 18 18:52:15 user nova-compute[74692]: DEBUG nova.compute.manager [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:52:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b299a375-7f2c-4e95-9a2f-fd02d86827dc tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "ac108610-6f06-48e0-93fe-14563906178c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.637s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-389b34e3-7e9d-422e-bf4c-79c62cedf007 req-aa3d15df-facb-4036-8363-025b3b01c9e2 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:52:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-389b34e3-7e9d-422e-bf4c-79c62cedf007 req-aa3d15df-facb-4036-8363-025b3b01c9e2 service nova] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-389b34e3-7e9d-422e-bf4c-79c62cedf007 req-aa3d15df-facb-4036-8363-025b3b01c9e2 service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-389b34e3-7e9d-422e-bf4c-79c62cedf007 req-aa3d15df-facb-4036-8363-025b3b01c9e2 service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-389b34e3-7e9d-422e-bf4c-79c62cedf007 req-aa3d15df-facb-4036-8363-025b3b01c9e2 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] No waiting events found dispatching network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:52:16 user nova-compute[74692]: WARNING nova.compute.manager [req-389b34e3-7e9d-422e-bf4c-79c62cedf007 req-aa3d15df-facb-4036-8363-025b3b01c9e2 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received unexpected event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 for instance with vm_state active and task_state None.
Nov 18 18:52:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "3fd9a073-962e-44de-9252-2d5e339093bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "3fd9a073-962e-44de-9252-2d5e339093bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "3fd9a073-962e-44de-9252-2d5e339093bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "3fd9a073-962e-44de-9252-2d5e339093bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "3fd9a073-962e-44de-9252-2d5e339093bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:24 user nova-compute[74692]: INFO nova.compute.manager [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Terminating instance
Nov 18 18:52:24 user nova-compute[74692]: DEBUG nova.compute.manager [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-98395f95-f5ef-4977-a445-f3edca1a4540 req-992156a2-7e92-405d-b548-b5beaceb4d1e service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Received event network-vif-unplugged-42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-98395f95-f5ef-4977-a445-f3edca1a4540 req-992156a2-7e92-405d-b548-b5beaceb4d1e service nova] Acquiring lock "3fd9a073-962e-44de-9252-2d5e339093bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-98395f95-f5ef-4977-a445-f3edca1a4540 req-992156a2-7e92-405d-b548-b5beaceb4d1e service nova] Lock "3fd9a073-962e-44de-9252-2d5e339093bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-98395f95-f5ef-4977-a445-f3edca1a4540 req-992156a2-7e92-405d-b548-b5beaceb4d1e service nova] Lock "3fd9a073-962e-44de-9252-2d5e339093bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-98395f95-f5ef-4977-a445-f3edca1a4540 req-992156a2-7e92-405d-b548-b5beaceb4d1e service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] No waiting events found dispatching network-vif-unplugged-42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-98395f95-f5ef-4977-a445-f3edca1a4540 req-992156a2-7e92-405d-b548-b5beaceb4d1e service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Received event network-vif-unplugged-42c3c7e8-f568-4a60-9613-152317e0543a for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:52:24 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Instance destroyed successfully.
Nov 18 18:52:24 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG nova.objects.instance [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lazy-loading 'resources' on Instance uuid 3fd9a073-962e-44de-9252-2d5e339093bc {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-210749516',display_name='tempest-ServerActionsTestOtherA-server-210749516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-210749516',id=19,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaznf7JGrfMrJRV86vaxqKuCfM3AcEaoWdApdT43PQu2+VRfP7TdWdgnZDzhSHo94Y2Q6y7Dc8YLTCn+JC1yHxyJqY3YZNW3EenEWfmQ3/zXDAHD9n+p1yEmT0Bxd5Ldw==',key_name='tempest-keypair-1438330061',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:33:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdb006c6267b42fab703cfc24d93052e',ramdisk_id='',reservation_id='r-rvvvfvlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2047740053',owner_user_name='tempest-ServerActionsTestOtherA-2047740053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d126349e69864417bb5e02666efd534c',uuid=3fd9a073-962e-44de-9252-2d5e339093bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42c3c7e8-f568-4a60-9613-152317e0543a", "address": "fa:16:3e:13:1b:f6", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42c3c7e8-f5", "ovs_interfaceid": "42c3c7e8-f568-4a60-9613-152317e0543a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converting VIF {"id": "42c3c7e8-f568-4a60-9613-152317e0543a", "address": "fa:16:3e:13:1b:f6", "network": {"id": "5b9b7069-6849-4149-9f41-8dda27282363", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-975479299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb006c6267b42fab703cfc24d93052e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42c3c7e8-f5", "ovs_interfaceid": "42c3c7e8-f568-4a60-9613-152317e0543a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:1b:f6,bridge_name='br-int',has_traffic_filtering=True,id=42c3c7e8-f568-4a60-9613-152317e0543a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42c3c7e8-f5') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG os_vif [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:1b:f6,bridge_name='br-int',has_traffic_filtering=True,id=42c3c7e8-f568-4a60-9613-152317e0543a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42c3c7e8-f5') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42c3c7e8-f5, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95f98f1e-ec81-459b-97a1-99c21ecece38) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:52:24 user nova-compute[74692]: INFO os_vif [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:1b:f6,bridge_name='br-int',has_traffic_filtering=True,id=42c3c7e8-f568-4a60-9613-152317e0543a,network=Network(5b9b7069-6849-4149-9f41-8dda27282363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42c3c7e8-f5')
Nov 18 18:52:24 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Deleting instance files /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc_del
Nov 18 18:52:24 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Deletion of /opt/stack/data/nova/instances/3fd9a073-962e-44de-9252-2d5e339093bc_del complete
Nov 18 18:52:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:25 user nova-compute[74692]: INFO nova.compute.manager [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 18 18:52:25 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:25 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Error from libvirt while getting description of instance-00000013: [Error Code 42] Domain not found: no domain with matching uuid '3fd9a073-962e-44de-9252-2d5e339093bc' (instance-00000013): libvirt.libvirtError: Domain not found: no domain with matching uuid '3fd9a073-962e-44de-9252-2d5e339093bc' (instance-00000013)
Nov 18 18:52:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-2c5b3b90-be33-4225-9d38-4f4d1e1067e7 req-3c1136bb-5280-4fbb-870d-40ff1b23763b service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Received event network-vif-deleted-42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:52:25 user nova-compute[74692]: INFO nova.compute.manager [req-2c5b3b90-be33-4225-9d38-4f4d1e1067e7 req-3c1136bb-5280-4fbb-870d-40ff1b23763b service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Neutron deleted interface 42c3c7e8-f568-4a60-9613-152317e0543a; detaching it from the instance and deleting it from the info cache
Nov 18 18:52:25 user nova-compute[74692]: DEBUG nova.network.neutron [req-2c5b3b90-be33-4225-9d38-4f4d1e1067e7 req-3c1136bb-5280-4fbb-870d-40ff1b23763b service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:52:25 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Took 0.50 seconds to deallocate network for instance.
Nov 18 18:52:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-2c5b3b90-be33-4225-9d38-4f4d1e1067e7 req-3c1136bb-5280-4fbb-870d-40ff1b23763b service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Detach interface failed, port_id=42c3c7e8-f568-4a60-9613-152317e0543a, reason: Instance 3fd9a073-962e-44de-9252-2d5e339093bc could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:52:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:26 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Deleted allocations for instance 3fd9a073-962e-44de-9252-2d5e339093bc
Nov 18 18:52:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-ba3a64ff-d036-439e-9759-a4d769c770e1 tempest-ServerActionsTestOtherA-2047740053 tempest-ServerActionsTestOtherA-2047740053-project-member] Lock "3fd9a073-962e-44de-9252-2d5e339093bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.038s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG nova.compute.manager [req-653898fc-f7e7-4758-803b-8bf2e911eed7 req-ecbc6f93-26db-4bc2-8757-70ea5d9b40f5 service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Received event network-vif-plugged-42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-653898fc-f7e7-4758-803b-8bf2e911eed7 req-ecbc6f93-26db-4bc2-8757-70ea5d9b40f5 service nova] Acquiring lock "3fd9a073-962e-44de-9252-2d5e339093bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-653898fc-f7e7-4758-803b-8bf2e911eed7 req-ecbc6f93-26db-4bc2-8757-70ea5d9b40f5 service nova] Lock "3fd9a073-962e-44de-9252-2d5e339093bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-653898fc-f7e7-4758-803b-8bf2e911eed7 req-ecbc6f93-26db-4bc2-8757-70ea5d9b40f5 service nova] Lock "3fd9a073-962e-44de-9252-2d5e339093bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG nova.compute.manager [req-653898fc-f7e7-4758-803b-8bf2e911eed7 req-ecbc6f93-26db-4bc2-8757-70ea5d9b40f5 service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] No waiting events found dispatching network-vif-plugged-42c3c7e8-f568-4a60-9613-152317e0543a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:52:26 user nova-compute[74692]: WARNING nova.compute.manager [req-653898fc-f7e7-4758-803b-8bf2e911eed7 req-ecbc6f93-26db-4bc2-8757-70ea5d9b40f5 service nova] [instance: 3fd9a073-962e-44de-9252-2d5e339093bc] Received unexpected event network-vif-plugged-42c3c7e8-f568-4a60-9613-152317e0543a for instance with vm_state deleted and task_state None.
Nov 18 18:52:26 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:52:26 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:52:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8613MB free_disk=24.94845199584961GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance ac108610-6f06-48e0-93fe-14563906178c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 18fc06c8-a112-462b-8302-83a41ee9c352 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:52:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:52:27 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:52:27 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:52:27 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:52:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-7d2415dd-2c61-463f-a19a-2a8f64e8d41c req-740f49cc-60db-4936-94c1-07dad283069c service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Received event network-changed-6de20cf2-f163-4dae-bb89-bc55ce87896e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-7d2415dd-2c61-463f-a19a-2a8f64e8d41c req-740f49cc-60db-4936-94c1-07dad283069c service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Refreshing instance network info cache due to event network-changed-6de20cf2-f163-4dae-bb89-bc55ce87896e. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7d2415dd-2c61-463f-a19a-2a8f64e8d41c req-740f49cc-60db-4936-94c1-07dad283069c service nova] Acquiring lock "refresh_cache-18fc06c8-a112-462b-8302-83a41ee9c352" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7d2415dd-2c61-463f-a19a-2a8f64e8d41c req-740f49cc-60db-4936-94c1-07dad283069c service nova] Acquired lock "refresh_cache-18fc06c8-a112-462b-8302-83a41ee9c352" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG nova.network.neutron [req-7d2415dd-2c61-463f-a19a-2a8f64e8d41c req-740f49cc-60db-4936-94c1-07dad283069c service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Refreshing network info cache for port 6de20cf2-f163-4dae-bb89-bc55ce87896e {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "18fc06c8-a112-462b-8302-83a41ee9c352" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "18fc06c8-a112-462b-8302-83a41ee9c352" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG nova.objects.instance [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lazy-loading 'flavor' on Instance uuid 18fc06c8-a112-462b-8302-83a41ee9c352 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:52:29 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Ignoring supplied device name: /dev/vdb
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "18fc06c8-a112-462b-8302-83a41ee9c352" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG nova.network.neutron [req-7d2415dd-2c61-463f-a19a-2a8f64e8d41c req-740f49cc-60db-4936-94c1-07dad283069c service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Updated VIF entry in instance network info cache for port 6de20cf2-f163-4dae-bb89-bc55ce87896e. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG nova.network.neutron [req-7d2415dd-2c61-463f-a19a-2a8f64e8d41c req-740f49cc-60db-4936-94c1-07dad283069c service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Updating instance_info_cache with network_info: [{"id": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "address": "fa:16:3e:2c:3d:06", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de20cf2-f1", "ovs_interfaceid": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7d2415dd-2c61-463f-a19a-2a8f64e8d41c req-740f49cc-60db-4936-94c1-07dad283069c service nova] Releasing lock "refresh_cache-18fc06c8-a112-462b-8302-83a41ee9c352" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "18fc06c8-a112-462b-8302-83a41ee9c352" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "18fc06c8-a112-462b-8302-83a41ee9c352" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:29 user nova-compute[74692]: INFO nova.compute.manager [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Attaching volume 4de0b5f9-869d-42eb-9445-d054fb16ed94 to /dev/vdb
Nov 18 18:52:29 user nova-compute[74692]: DEBUG os_brick.utils [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bd6f2d-9105-4edd-8718-6fe46c83698c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6343508d-5256-4da4-a8a3-9c7f548d32d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac6c633-dc54-4388-8f18-26edd1874b31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e69db38-36ad-4dad-be33-fa3a6be8e182]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:52:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:52:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:52:30 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:52:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f608d15-9ea8-479e-b0f8-59133a2f7da4]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:52:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:52:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:52:30 user nova-compute[74692]: DEBUG os_brick.utils [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:52:30 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Updating existing volume attachment record: 36ea60fc-de27-48e9-b73f-dca82f0e939b {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:52:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:52:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:52:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:52:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:52:30 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:52:31 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:52:32 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:52:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:52:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FEZHLgTb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:52:35 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:52:35 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:52:35 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: ac108610-6f06-48e0-93fe-14563906178c] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a572558-9a95-4426-9d3b-810239f5fabb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:52:35 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca24c1ae-376b-400b-b37a-bb1fdbced70b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94] added
Nov 18 18:52:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[851cd9cd-e769-4b34-b93b-41ceb74c53c0]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddea035b-3b87-44f0-a334-4685f1c25ca8]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FEZHLgTb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FEZHLgTb" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c216aa7-8dc8-49d8-a31e-33e89dbcf949]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FEZHLgTb'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[693b87a2-83fc-411e-b0f4-4f07db76f195]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[56211463-f280-45f7-9e4d-fc21cd990ce3]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:52:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:52:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01f68d3-d214-4269-9a71-532e336cc9df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94, portal: 172.16.0.220,3260]
Nov 18 18:52:35 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94, portal: 172.16.0.220,3260] successful.
Nov 18 18:52:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e080e727-ede8-4b56-b50f-dbcb8321d073]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d99ae6-790a-4a4f-b5b6-480144ea650c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:52:35 user nova-compute[74692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 (non-flash)
Nov 18 18:52:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:52:35 user nova-compute[74692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 (non-flash)
Nov 18 18:52:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[27115971-52e5-4a5c-87b8-d87327018309]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FEZHLgTb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updating instance_info_cache with network_info: [{"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:52:35 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:52:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:52:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23463623336333361', 'path': '/dev/sdc'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:52:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463623336333361', 'path': '/dev/sdc'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:52:36 user nova-compute[74692]: DEBUG nova.objects.instance [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lazy-loading 'flavor' on Instance uuid 18fc06c8-a112-462b-8302-83a41ee9c352 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:52:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:52:36 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:52:36 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:52:36 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:52:36 user nova-compute[74692]:   <serial>4de0b5f9-869d-42eb-9445-d054fb16ed94</serial>
Nov 18 18:52:36 user nova-compute[74692]: </disk>
Nov 18 18:52:36 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:52:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:52:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:52:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] No VIF found with MAC fa:16:3e:2c:3d:06, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:52:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-d36541d7-ca59-4758-b64e-7f54300cfefd tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "18fc06c8-a112-462b-8302-83a41ee9c352" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.076s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:50 user nova-compute[74692]: INFO nova.compute.manager [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Terminating instance
Nov 18 18:52:50 user nova-compute[74692]: DEBUG nova.compute.manager [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-191e214d-c632-448c-9cd6-6e54f836fbd9 req-9fcacad9-6de0-4ba3-b26d-252946deef38 service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Received event network-vif-unplugged-c879593e-46f0-444c-9bce-fdd7d77a8e4b {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-191e214d-c632-448c-9cd6-6e54f836fbd9 req-9fcacad9-6de0-4ba3-b26d-252946deef38 service nova] Acquiring lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-191e214d-c632-448c-9cd6-6e54f836fbd9 req-9fcacad9-6de0-4ba3-b26d-252946deef38 service nova] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-191e214d-c632-448c-9cd6-6e54f836fbd9 req-9fcacad9-6de0-4ba3-b26d-252946deef38 service nova] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-191e214d-c632-448c-9cd6-6e54f836fbd9 req-9fcacad9-6de0-4ba3-b26d-252946deef38 service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] No waiting events found dispatching network-vif-unplugged-c879593e-46f0-444c-9bce-fdd7d77a8e4b {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:52:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-191e214d-c632-448c-9cd6-6e54f836fbd9 req-9fcacad9-6de0-4ba3-b26d-252946deef38 service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Received event network-vif-unplugged-c879593e-46f0-444c-9bce-fdd7d77a8e4b for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:51 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Instance destroyed successfully.
Nov 18 18:52:51 user nova-compute[74692]: DEBUG nova.objects.instance [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lazy-loading 'resources' on Instance uuid dd434b0c-593a-47ad-9109-0f8b5f545b6c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:33:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1007732731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1007732731',id=18,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:33:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='704ef46081d04fc7a0ed88456cbe9fe8',ramdisk_id='',reservation_id='r-qkle8bok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-199647198',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:35:10Z,user_data=None,user_id='1233b31e12dc4d5796a60327d93c3bfb',uuid=dd434b0c-593a-47ad-9109-0f8b5f545b6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "address": "fa:16:3e:93:8d:60", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc879593e-46", "ovs_interfaceid": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converting VIF {"id": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "address": "fa:16:3e:93:8d:60", "network": {"id": "b3980fbe-e831-46f5-b88d-45c2b6a2c765", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1218529888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "704ef46081d04fc7a0ed88456cbe9fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc879593e-46", "ovs_interfaceid": "c879593e-46f0-444c-9bce-fdd7d77a8e4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:8d:60,bridge_name='br-int',has_traffic_filtering=True,id=c879593e-46f0-444c-9bce-fdd7d77a8e4b,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc879593e-46') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG os_vif [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:8d:60,bridge_name='br-int',has_traffic_filtering=True,id=c879593e-46f0-444c-9bce-fdd7d77a8e4b,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc879593e-46') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc879593e-46, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc00651b-79c7-4152-8251-2efdb5363008) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:52:51 user nova-compute[74692]: INFO os_vif [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:8d:60,bridge_name='br-int',has_traffic_filtering=True,id=c879593e-46f0-444c-9bce-fdd7d77a8e4b,network=Network(b3980fbe-e831-46f5-b88d-45c2b6a2c765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc879593e-46')
Nov 18 18:52:51 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Deleting instance files /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c_del
Nov 18 18:52:51 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Deletion of /opt/stack/data/nova/instances/dd434b0c-593a-47ad-9109-0f8b5f545b6c_del complete
Nov 18 18:52:51 user nova-compute[74692]: INFO nova.compute.manager [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 18 18:52:51 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:52:51 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Took 0.42 seconds to deallocate network for instance.
Nov 18 18:52:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-04ceeac6-216c-43ab-b0e2-fca0864c1089 req-9782d80a-2bee-4d26-b011-d8117ed5ce23 service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Received event network-vif-deleted-c879593e-46f0-444c-9bce-fdd7d77a8e4b {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:52:51 user nova-compute[74692]: INFO nova.compute.manager [req-04ceeac6-216c-43ab-b0e2-fca0864c1089 req-9782d80a-2bee-4d26-b011-d8117ed5ce23 service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Neutron deleted interface c879593e-46f0-444c-9bce-fdd7d77a8e4b; detaching it from the instance and deleting it from the info cache
Nov 18 18:52:51 user nova-compute[74692]: DEBUG nova.network.neutron [req-04ceeac6-216c-43ab-b0e2-fca0864c1089 req-9782d80a-2bee-4d26-b011-d8117ed5ce23 service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-04ceeac6-216c-43ab-b0e2-fca0864c1089 req-9782d80a-2bee-4d26-b011-d8117ed5ce23 service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Detach interface failed, port_id=c879593e-46f0-444c-9bce-fdd7d77a8e4b, reason: Instance dd434b0c-593a-47ad-9109-0f8b5f545b6c could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:52 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:52:52 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:52:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:52 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Deleted allocations for instance dd434b0c-593a-47ad-9109-0f8b5f545b6c
Nov 18 18:52:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-10b96b3f-0bce-4d2d-aeaf-7b6042aaaa86 tempest-ServerBootFromVolumeStableRescueTest-199647198 tempest-ServerBootFromVolumeStableRescueTest-199647198-project-member] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.837s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "18fc06c8-a112-462b-8302-83a41ee9c352" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "18fc06c8-a112-462b-8302-83a41ee9c352" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:52 user nova-compute[74692]: INFO nova.compute.manager [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Detaching volume 4de0b5f9-869d-42eb-9445-d054fb16ed94
Nov 18 18:52:53 user nova-compute[74692]: INFO nova.virt.block_device [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Attempting to driver detach volume 4de0b5f9-869d-42eb-9445-d054fb16ed94 from mountpoint /dev/vdb
Nov 18 18:52:53 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Attempting to detach device vdb from instance 18fc06c8-a112-462b-8302-83a41ee9c352 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:52:53 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:52:53 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:52:53 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:52:53 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:52:53 user nova-compute[74692]:   <serial>4de0b5f9-869d-42eb-9445-d054fb16ed94</serial>
Nov 18 18:52:53 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:52:53 user nova-compute[74692]: </disk>
Nov 18 18:52:53 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:52:53 user nova-compute[74692]: DEBUG nova.compute.manager [req-d8a570c4-3301-43f3-9b23-d39ad2afadf9 req-0d3245dc-6b35-4d16-9e80-f4913ddac28b service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Received event network-vif-plugged-c879593e-46f0-444c-9bce-fdd7d77a8e4b {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:52:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d8a570c4-3301-43f3-9b23-d39ad2afadf9 req-0d3245dc-6b35-4d16-9e80-f4913ddac28b service nova] Acquiring lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d8a570c4-3301-43f3-9b23-d39ad2afadf9 req-0d3245dc-6b35-4d16-9e80-f4913ddac28b service nova] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:52:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d8a570c4-3301-43f3-9b23-d39ad2afadf9 req-0d3245dc-6b35-4d16-9e80-f4913ddac28b service nova] Lock "dd434b0c-593a-47ad-9109-0f8b5f545b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:52:53 user nova-compute[74692]: DEBUG nova.compute.manager [req-d8a570c4-3301-43f3-9b23-d39ad2afadf9 req-0d3245dc-6b35-4d16-9e80-f4913ddac28b service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] No waiting events found dispatching network-vif-plugged-c879593e-46f0-444c-9bce-fdd7d77a8e4b {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:52:53 user nova-compute[74692]: WARNING nova.compute.manager [req-d8a570c4-3301-43f3-9b23-d39ad2afadf9 req-0d3245dc-6b35-4d16-9e80-f4913ddac28b service nova] [instance: dd434b0c-593a-47ad-9109-0f8b5f545b6c] Received unexpected event network-vif-plugged-c879593e-46f0-444c-9bce-fdd7d77a8e4b for instance with vm_state deleted and task_state None.
Nov 18 18:52:53 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Successfully detached device vdb from instance 18fc06c8-a112-462b-8302-83a41ee9c352 from the persistent domain config.
Nov 18 18:52:53 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 18fc06c8-a112-462b-8302-83a41ee9c352 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:52:53 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:52:53 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:52:53 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:52:53 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:52:53 user nova-compute[74692]:   <serial>4de0b5f9-869d-42eb-9445-d054fb16ed94</serial>
Nov 18 18:52:53 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:52:53 user nova-compute[74692]: </disk>
Nov 18 18:52:53 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:52:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "18fc06c8-a112-462b-8302-83a41ee9c352" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:52:53 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 18fc06c8-a112-462b-8302-83a41ee9c352 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:52:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:53:13 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 18fc06c8-a112-462b-8302-83a41ee9c352 is timed out.
Nov 18 18:53:13 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Successfully detached device vdb from instance 18fc06c8-a112-462b-8302-83a41ee9c352 from the live domain config.
Nov 18 18:53:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FEZHLgTb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:53:13 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacffc6b-4c91-4df5-b74d-b94cb59be686]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:53:13 user nova-compute[74692]: No targets found.
Nov 18 18:53:13 user nova-compute[74692]: iSNS:
Nov 18 18:53:13 user nova-compute[74692]: No targets found.
Nov 18 18:53:13 user nova-compute[74692]: STATIC:
Nov 18 18:53:13 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94
Nov 18 18:53:13 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:53:13 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:53:13 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8
Nov 18 18:53:13 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:53:13 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:53:13 user nova-compute[74692]: FIRMWARE:
Nov 18 18:53:13 user nova-compute[74692]: No targets found.
Nov 18 18:53:13 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:53:13 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:53:13 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e58bda-5115-44a1-9f77-946c76c39c75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e10dd7-61b8-4f3f-85ad-95a5df484329]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:53:13 user nova-compute[74692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 (non-flash)
Nov 18 18:53:13 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:53:13 user nova-compute[74692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 (non-flash)
Nov 18 18:53:13 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c46723b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94'): ({'sdc'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Removing single pathed devices sdc {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfe2636-5866-4a90-af61-2710a749273f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb87223-8810-480b-b88b-00b74214b7c7]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Flushing IO for device /dev/sdc {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c07abdb-abcb-4a6f-936b-1d7cb1dc4515]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a46bdd9-b11b-4fa9-b44a-37f185b56b0f]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d96a8a9-d6d2-4a40-a448-3f409a77ce12]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb538aa4-af55-4712-a937-78e7ca1b2bbf]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94, portal: 172.16.0.220,3260]
Nov 18 18:53:13 user nova-compute[74692]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94, portal: 172.16.0.220,3260] successful.
Nov 18 18:53:13 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11d7943-9844-40aa-ab8a-5c1dd78775e8]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] <== disconnect_volume: return (274ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:53:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG nova.objects.instance [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lazy-loading 'flavor' on Instance uuid 18fc06c8-a112-462b-8302-83a41ee9c352 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b5c08a79-e205-47f2-bb91-f76796854fe5 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "18fc06c8-a112-462b-8302-83a41ee9c352" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.582s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "18fc06c8-a112-462b-8302-83a41ee9c352" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.461s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "18fc06c8-a112-462b-8302-83a41ee9c352-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "18fc06c8-a112-462b-8302-83a41ee9c352-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "18fc06c8-a112-462b-8302-83a41ee9c352-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:14 user nova-compute[74692]: INFO nova.compute.manager [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Terminating instance
Nov 18 18:53:14 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-2065450d-7e5b-4e1f-89b4-1a32c178b801 req-3747c750-04c9-46bc-a261-82835af22072 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Received event network-vif-unplugged-6de20cf2-f163-4dae-bb89-bc55ce87896e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2065450d-7e5b-4e1f-89b4-1a32c178b801 req-3747c750-04c9-46bc-a261-82835af22072 service nova] Acquiring lock "18fc06c8-a112-462b-8302-83a41ee9c352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2065450d-7e5b-4e1f-89b4-1a32c178b801 req-3747c750-04c9-46bc-a261-82835af22072 service nova] Lock "18fc06c8-a112-462b-8302-83a41ee9c352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2065450d-7e5b-4e1f-89b4-1a32c178b801 req-3747c750-04c9-46bc-a261-82835af22072 service nova] Lock "18fc06c8-a112-462b-8302-83a41ee9c352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-2065450d-7e5b-4e1f-89b4-1a32c178b801 req-3747c750-04c9-46bc-a261-82835af22072 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] No waiting events found dispatching network-vif-unplugged-6de20cf2-f163-4dae-bb89-bc55ce87896e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:53:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-2065450d-7e5b-4e1f-89b4-1a32c178b801 req-3747c750-04c9-46bc-a261-82835af22072 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Received event network-vif-unplugged-6de20cf2-f163-4dae-bb89-bc55ce87896e for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:53:15 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Instance destroyed successfully.
Nov 18 18:53:15 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lazy-loading 'resources' on Instance uuid 18fc06c8-a112-462b-8302-83a41ee9c352 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1047458037',display_name='tempest-VolumesSnapshotTestJSON-instance-1047458037',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1047458037',id=36,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoBkj2C3ETViz55/K6T5pbKbbhE3B47Mza4Ai1s1v3LFXOgI9WxLkcLEPpxJXnEEplLn6SJPTU/yWcRnAKfvDpphKemK2A8Sg/PCMNvFt71CL98gcHfxL5DsDje+0meKg==',key_name='tempest-keypair-1030479069',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb3bc45280424122aa275a118909d6f4',ramdisk_id='',reservation_id='r-l72ymp54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1571543916',owner_user_name='tempest-VolumesSnapshotTestJSON-1571543916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bbd290cbd4e49b59aab5217f553c6f0',uuid=18fc06c8-a112-462b-8302-83a41ee9c352,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "address": "fa:16:3e:2c:3d:06", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de20cf2-f1", "ovs_interfaceid": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Converting VIF {"id": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "address": "fa:16:3e:2c:3d:06", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de20cf2-f1", "ovs_interfaceid": "6de20cf2-f163-4dae-bb89-bc55ce87896e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:3d:06,bridge_name='br-int',has_traffic_filtering=True,id=6de20cf2-f163-4dae-bb89-bc55ce87896e,network=Network(70fdfeca-f8bb-4437-95bb-8479471c0733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de20cf2-f1') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG os_vif [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:3d:06,bridge_name='br-int',has_traffic_filtering=True,id=6de20cf2-f163-4dae-bb89-bc55ce87896e,network=Network(70fdfeca-f8bb-4437-95bb-8479471c0733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de20cf2-f1') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6de20cf2-f1, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b6264ec-b1f8-4717-96f9-5e1489043583) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:53:15 user nova-compute[74692]: INFO os_vif [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:3d:06,bridge_name='br-int',has_traffic_filtering=True,id=6de20cf2-f163-4dae-bb89-bc55ce87896e,network=Network(70fdfeca-f8bb-4437-95bb-8479471c0733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de20cf2-f1')
Nov 18 18:53:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FEZHLgTb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:53:15 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:53:15 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8990ea73-da8d-4866-811f-537df809761d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:53:15 user nova-compute[74692]: No targets found.
Nov 18 18:53:15 user nova-compute[74692]: iSNS:
Nov 18 18:53:15 user nova-compute[74692]: No targets found.
Nov 18 18:53:15 user nova-compute[74692]: STATIC:
Nov 18 18:53:15 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8
Nov 18 18:53:15 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:53:15 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:53:15 user nova-compute[74692]: FIRMWARE:
Nov 18 18:53:15 user nova-compute[74692]: No targets found.
Nov 18 18:53:15 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:53:15 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:53:15 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4de0b5f9-869d-42eb-9445-d054fb16ed94', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4446694-810f-4a4a-a17b-3c2c0295fabd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6821b455-6af2-4f21-9af0-bb0da252cadd]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:53:15 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:53:15 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a45ad2d0>, {}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Disconnecting from: [] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] <== disconnect_volume: return (72ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:53:15 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Deleting instance files /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352_del
Nov 18 18:53:15 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Deletion of /opt/stack/data/nova/instances/18fc06c8-a112-462b-8302-83a41ee9c352_del complete
Nov 18 18:53:15 user nova-compute[74692]: INFO nova.compute.manager [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 18 18:53:15 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:53:15 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:53:16 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:53:16 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Took 0.65 seconds to deallocate network for instance.
Nov 18 18:53:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-29c5e4a9-61a0-4b73-99a0-e3716d62190a req-bf495f97-6792-4239-a668-104324fe30e7 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Received event network-vif-deleted-6de20cf2-f163-4dae-bb89-bc55ce87896e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:53:16 user nova-compute[74692]: INFO nova.compute.manager [req-29c5e4a9-61a0-4b73-99a0-e3716d62190a req-bf495f97-6792-4239-a668-104324fe30e7 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Neutron deleted interface 6de20cf2-f163-4dae-bb89-bc55ce87896e; detaching it from the instance and deleting it from the info cache
Nov 18 18:53:16 user nova-compute[74692]: DEBUG nova.network.neutron [req-29c5e4a9-61a0-4b73-99a0-e3716d62190a req-bf495f97-6792-4239-a668-104324fe30e7 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:53:16 user nova-compute[74692]: WARNING nova.volume.cinder [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Attachment 36ea60fc-de27-48e9-b73f-dca82f0e939b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 36ea60fc-de27-48e9-b73f-dca82f0e939b. (HTTP 404) (Request-ID: req-0d14c4d6-6570-45a8-8d30-ba1302e7a780)
Nov 18 18:53:16 user nova-compute[74692]: INFO nova.compute.manager [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Took 0.03 seconds to detach 1 volumes for instance.
Nov 18 18:53:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-29c5e4a9-61a0-4b73-99a0-e3716d62190a req-bf495f97-6792-4239-a668-104324fe30e7 service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Detach interface failed, port_id=6de20cf2-f163-4dae-bb89-bc55ce87896e, reason: Instance 18fc06c8-a112-462b-8302-83a41ee9c352 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:53:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:16 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:53:16 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:53:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:16 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Deleted allocations for instance 18fc06c8-a112-462b-8302-83a41ee9c352
Nov 18 18:53:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3546c440-e347-4cfa-971f-4c5bf777d902 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "18fc06c8-a112-462b-8302-83a41ee9c352" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.921s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-76c5616d-45c3-446e-8680-29848869344b req-13cafbf0-1bab-44a2-8d1a-a8b5a3f611ad service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Received event network-vif-plugged-6de20cf2-f163-4dae-bb89-bc55ce87896e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:53:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-76c5616d-45c3-446e-8680-29848869344b req-13cafbf0-1bab-44a2-8d1a-a8b5a3f611ad service nova] Acquiring lock "18fc06c8-a112-462b-8302-83a41ee9c352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-76c5616d-45c3-446e-8680-29848869344b req-13cafbf0-1bab-44a2-8d1a-a8b5a3f611ad service nova] Lock "18fc06c8-a112-462b-8302-83a41ee9c352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-76c5616d-45c3-446e-8680-29848869344b req-13cafbf0-1bab-44a2-8d1a-a8b5a3f611ad service nova] Lock "18fc06c8-a112-462b-8302-83a41ee9c352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-76c5616d-45c3-446e-8680-29848869344b req-13cafbf0-1bab-44a2-8d1a-a8b5a3f611ad service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] No waiting events found dispatching network-vif-plugged-6de20cf2-f163-4dae-bb89-bc55ce87896e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:53:16 user nova-compute[74692]: WARNING nova.compute.manager [req-76c5616d-45c3-446e-8680-29848869344b req-13cafbf0-1bab-44a2-8d1a-a8b5a3f611ad service nova] [instance: 18fc06c8-a112-462b-8302-83a41ee9c352] Received unexpected event network-vif-plugged-6de20cf2-f163-4dae-bb89-bc55ce87896e for instance with vm_state deleted and task_state None.
Nov 18 18:53:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:25 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:53:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:53:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:53:26 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:53:26 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:53:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8875MB free_disk=25.09914779663086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:53:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance ac108610-6f06-48e0-93fe-14563906178c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:53:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:53:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:53:26 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:53:26 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:53:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:53:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:27 user nova-compute[74692]: DEBUG nova.compute.manager [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:53:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:53:27 user nova-compute[74692]: INFO nova.compute.claims [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Claim successful on node user
Nov 18 18:53:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG nova.network.neutron [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:53:28 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:53:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG nova.policy [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e28b31fb4e1b45fdae81ac6c9d512c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622388d2bbe41a0ba6a5fb42c494a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:53:28 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Creating image(s)
Nov 18 18:53:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "/opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "/opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "/opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk 1073741824" returned: 0 in 0.056s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:53:28 user nova-compute[74692]: DEBUG nova.network.neutron [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Successfully created port: 38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Cannot resize image /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Ensure instance console log exists: /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.network.neutron [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Successfully updated port: 38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquired lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.network.neutron [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-133f2633-c712-4471-b93e-c527c2719fb5 req-b58871a1-904f-457d-8f2e-e0efa945d663 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-changed-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-133f2633-c712-4471-b93e-c527c2719fb5 req-b58871a1-904f-457d-8f2e-e0efa945d663 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Refreshing instance network info cache due to event network-changed-38f70b63-f3b8-41f4-b96a-0c87108ccd85. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-133f2633-c712-4471-b93e-c527c2719fb5 req-b58871a1-904f-457d-8f2e-e0efa945d663 service nova] Acquiring lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.network.neutron [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.network.neutron [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating instance_info_cache with network_info: [{"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Releasing lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.compute.manager [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Instance network_info: |[{"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-133f2633-c712-4471-b93e-c527c2719fb5 req-b58871a1-904f-457d-8f2e-e0efa945d663 service nova] Acquired lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.network.neutron [req-133f2633-c712-4471-b93e-c527c2719fb5 req-b58871a1-904f-457d-8f2e-e0efa945d663 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Refreshing network info cache for port 38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Start _get_guest_xml network_info=[{"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:53:29 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:53:29 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:53:29 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-675233857',display_name='tempest-ServerActionsTestOtherB-server-675233857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-675233857',id=37,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ44427Z/m0lH604ZCZCT3wxxkPLCJECR2dRCAhCy9jp32w/HG5k9bXDcxq0dLrD4N0NbsbYxgMfyC4dHsM3g1rzNAEweUIJRjnGxWc9qXCJAk0Y2gFT55F56wQDpzJ2w==',key_name='tempest-keypair-1851665456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e622388d2bbe41a0ba6a5fb42c494a96',ramdisk_id='',reservation_id='r-y4r329pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-461353456',owner_user_name='tempest-ServerActionsTestOtherB-461353456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:53:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e28b31fb4e1b45fdae81ac6c9d512c95',uuid=5946a617-f567-4ab6-a2db-29c2c86544a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converting VIF {"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG nova.objects.instance [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lazy-loading 'pci_devices' on Instance uuid 5946a617-f567-4ab6-a2db-29c2c86544a6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:53:30 user nova-compute[74692]:   <uuid>5946a617-f567-4ab6-a2db-29c2c86544a6</uuid>
Nov 18 18:53:30 user nova-compute[74692]:   <name>instance-00000025</name>
Nov 18 18:53:30 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:53:30 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:53:30 user nova-compute[74692]:   <metadata>
Nov 18 18:53:30 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:53:30 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:53:30 user nova-compute[74692]:       <nova:name>tempest-ServerActionsTestOtherB-server-675233857</nova:name>
Nov 18 18:53:30 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:53:29</nova:creationTime>
Nov 18 18:53:30 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:53:30 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:53:30 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:53:30 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:53:30 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:53:30 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:53:30 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:53:30 user nova-compute[74692]:       <nova:owner>
Nov 18 18:53:30 user nova-compute[74692]:         <nova:user uuid="e28b31fb4e1b45fdae81ac6c9d512c95">tempest-ServerActionsTestOtherB-461353456-project-member</nova:user>
Nov 18 18:53:30 user nova-compute[74692]:         <nova:project uuid="e622388d2bbe41a0ba6a5fb42c494a96">tempest-ServerActionsTestOtherB-461353456</nova:project>
Nov 18 18:53:30 user nova-compute[74692]:       </nova:owner>
Nov 18 18:53:30 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:53:30 user nova-compute[74692]:       <nova:ports>
Nov 18 18:53:30 user nova-compute[74692]:         <nova:port uuid="38f70b63-f3b8-41f4-b96a-0c87108ccd85">
Nov 18 18:53:30 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 18:53:30 user nova-compute[74692]:         </nova:port>
Nov 18 18:53:30 user nova-compute[74692]:       </nova:ports>
Nov 18 18:53:30 user nova-compute[74692]:     </nova:instance>
Nov 18 18:53:30 user nova-compute[74692]:   </metadata>
Nov 18 18:53:30 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:53:30 user nova-compute[74692]:     <system>
Nov 18 18:53:30 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:53:30 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:53:30 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:53:30 user nova-compute[74692]:       <entry name="serial">5946a617-f567-4ab6-a2db-29c2c86544a6</entry>
Nov 18 18:53:30 user nova-compute[74692]:       <entry name="uuid">5946a617-f567-4ab6-a2db-29c2c86544a6</entry>
Nov 18 18:53:30 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:53:30 user nova-compute[74692]:     </system>
Nov 18 18:53:30 user nova-compute[74692]:   </sysinfo>
Nov 18 18:53:30 user nova-compute[74692]:   <os>
Nov 18 18:53:30 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:53:30 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:53:30 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:53:30 user nova-compute[74692]:   </os>
Nov 18 18:53:30 user nova-compute[74692]:   <features>
Nov 18 18:53:30 user nova-compute[74692]:     <acpi/>
Nov 18 18:53:30 user nova-compute[74692]:     <apic/>
Nov 18 18:53:30 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:53:30 user nova-compute[74692]:   </features>
Nov 18 18:53:30 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:53:30 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:53:30 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:53:30 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:53:30 user nova-compute[74692]:   </clock>
Nov 18 18:53:30 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:53:30 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:53:30 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:53:30 user nova-compute[74692]:   </cpu>
Nov 18 18:53:30 user nova-compute[74692]:   <devices>
Nov 18 18:53:30 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:53:30 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:53:30 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk"/>
Nov 18 18:53:30 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:53:30 user nova-compute[74692]:     </disk>
Nov 18 18:53:30 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:53:30 user nova-compute[74692]:       <mac address="fa:16:3e:44:c1:a3"/>
Nov 18 18:53:30 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:53:30 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:53:30 user nova-compute[74692]:       <target dev="tap38f70b63-f3"/>
Nov 18 18:53:30 user nova-compute[74692]:     </interface>
Nov 18 18:53:30 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:53:30 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/console.log" append="off"/>
Nov 18 18:53:30 user nova-compute[74692]:     </serial>
Nov 18 18:53:30 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:53:30 user nova-compute[74692]:     <video>
Nov 18 18:53:30 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:53:30 user nova-compute[74692]:     </video>
Nov 18 18:53:30 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:53:30 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:53:30 user nova-compute[74692]:     </rng>
Nov 18 18:53:30 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:53:30 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:53:30 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:53:30 user nova-compute[74692]:     </memballoon>
Nov 18 18:53:30 user nova-compute[74692]:   </devices>
Nov 18 18:53:30 user nova-compute[74692]: </domain>
Nov 18 18:53:30 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-675233857',display_name='tempest-ServerActionsTestOtherB-server-675233857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-675233857',id=37,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ44427Z/m0lH604ZCZCT3wxxkPLCJECR2dRCAhCy9jp32w/HG5k9bXDcxq0dLrD4N0NbsbYxgMfyC4dHsM3g1rzNAEweUIJRjnGxWc9qXCJAk0Y2gFT55F56wQDpzJ2w==',key_name='tempest-keypair-1851665456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e622388d2bbe41a0ba6a5fb42c494a96',ramdisk_id='',reservation_id='r-y4r329pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-461353456',owner_user_name='tempest-ServerActionsTestOtherB-461353456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:53:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e28b31fb4e1b45fdae81ac6c9d512c95',uuid=5946a617-f567-4ab6-a2db-29c2c86544a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converting VIF {"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG os_vif [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ba9151d-437d-52bb-a4f7-0c1c72e5c2ff', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38f70b63-f3, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38f70b63-f3, col_values=(('qos', UUID('7b82c9e4-032b-45ad-8f8e-387bd4c6490d')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38f70b63-f3, col_values=(('external_ids', {'iface-id': '38f70b63-f3b8-41f4-b96a-0c87108ccd85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:c1:a3', 'vm-uuid': '5946a617-f567-4ab6-a2db-29c2c86544a6'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:30 user nova-compute[74692]: INFO os_vif [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3')
Nov 18 18:53:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] No VIF found with MAC fa:16:3e:44:c1:a3, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG nova.network.neutron [req-133f2633-c712-4471-b93e-c527c2719fb5 req-b58871a1-904f-457d-8f2e-e0efa945d663 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updated VIF entry in instance network info cache for port 38f70b63-f3b8-41f4-b96a-0c87108ccd85. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG nova.network.neutron [req-133f2633-c712-4471-b93e-c527c2719fb5 req-b58871a1-904f-457d-8f2e-e0efa945d663 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating instance_info_cache with network_info: [{"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-133f2633-c712-4471-b93e-c527c2719fb5 req-b58871a1-904f-457d-8f2e-e0efa945d663 service nova] Releasing lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:53:30 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:53:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-f6b6f38b-37f5-4d63-898d-07cce20e1f7e req-3367ed18-64c7-4f0d-9e16-248a159caea6 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:53:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f6b6f38b-37f5-4d63-898d-07cce20e1f7e req-3367ed18-64c7-4f0d-9e16-248a159caea6 service nova] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f6b6f38b-37f5-4d63-898d-07cce20e1f7e req-3367ed18-64c7-4f0d-9e16-248a159caea6 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f6b6f38b-37f5-4d63-898d-07cce20e1f7e req-3367ed18-64c7-4f0d-9e16-248a159caea6 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-f6b6f38b-37f5-4d63-898d-07cce20e1f7e req-3367ed18-64c7-4f0d-9e16-248a159caea6 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] No waiting events found dispatching network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:53:31 user nova-compute[74692]: WARNING nova.compute.manager [req-f6b6f38b-37f5-4d63-898d-07cce20e1f7e req-3367ed18-64c7-4f0d-9e16-248a159caea6 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received unexpected event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 for instance with vm_state building and task_state spawning.
Nov 18 18:53:31 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:53:31 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:53:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:33 user nova-compute[74692]: DEBUG nova.compute.manager [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:53:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:53:33 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Instance spawned successfully.
Nov 18 18:53:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:53:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:53:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:53:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:53:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:53:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:53:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:53:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-3d1c2bd7-65bc-4ebb-b429-af3585747ed1 req-b7c9b37e-b06a-4849-b715-4f5dd6249387 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:53:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3d1c2bd7-65bc-4ebb-b429-af3585747ed1 req-b7c9b37e-b06a-4849-b715-4f5dd6249387 service nova] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3d1c2bd7-65bc-4ebb-b429-af3585747ed1 req-b7c9b37e-b06a-4849-b715-4f5dd6249387 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3d1c2bd7-65bc-4ebb-b429-af3585747ed1 req-b7c9b37e-b06a-4849-b715-4f5dd6249387 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-3d1c2bd7-65bc-4ebb-b429-af3585747ed1 req-b7c9b37e-b06a-4849-b715-4f5dd6249387 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] No waiting events found dispatching network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:53:33 user nova-compute[74692]: WARNING nova.compute.manager [req-3d1c2bd7-65bc-4ebb-b429-af3585747ed1 req-b7c9b37e-b06a-4849-b715-4f5dd6249387 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received unexpected event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 for instance with vm_state building and task_state spawning.
Nov 18 18:53:33 user nova-compute[74692]: INFO nova.compute.manager [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 18 18:53:33 user nova-compute[74692]: DEBUG nova.compute.manager [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:53:34 user nova-compute[74692]: INFO nova.compute.manager [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Took 6.14 seconds to build instance.
Nov 18 18:53:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21758429-2eb2-4e8c-bc5c-d33a1906b715 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.237s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:53:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:53:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:53:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 18:53:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:53:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:53:35 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: ac108610-6f06-48e0-93fe-14563906178c] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:53:35 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid ac108610-6f06-48e0-93fe-14563906178c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:53:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:35 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updating instance_info_cache with network_info: [{"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:53:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:53:35 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:53:35 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:53:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:53:53 user nova-compute[74692]: INFO nova.compute.claims [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Claim successful on node user
Nov 18 18:53:53 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG nova.network.neutron [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:53:53 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:53:53 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG nova.policy [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'def7f7c9ff4f4a29a840ace22d509755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7475e741034a4302b0ab193f1b6c67d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:53:53 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Creating image(s)
Nov 18 18:53:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "/opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "/opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk 1073741824" returned: 0 in 0.057s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG nova.network.neutron [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Successfully created port: b7b109d8-a218-4b24-8da2-e3a4c5087fdd {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Cannot resize image /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Ensure instance console log exists: /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG nova.network.neutron [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Successfully updated port: b7b109d8-a218-4b24-8da2-e3a4c5087fdd {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "refresh_cache-5d266a05-1f0a-4ac3-85ce-7321cdcef63b" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquired lock "refresh_cache-5d266a05-1f0a-4ac3-85ce-7321cdcef63b" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG nova.network.neutron [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG nova.compute.manager [req-33bb3ef9-1aca-48b4-a37a-481e3f8ddf70 req-6d4f551a-6f14-4999-bb31-dd62232b7f07 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Received event network-changed-b7b109d8-a218-4b24-8da2-e3a4c5087fdd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG nova.compute.manager [req-33bb3ef9-1aca-48b4-a37a-481e3f8ddf70 req-6d4f551a-6f14-4999-bb31-dd62232b7f07 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Refreshing instance network info cache due to event network-changed-b7b109d8-a218-4b24-8da2-e3a4c5087fdd. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-33bb3ef9-1aca-48b4-a37a-481e3f8ddf70 req-6d4f551a-6f14-4999-bb31-dd62232b7f07 service nova] Acquiring lock "refresh_cache-5d266a05-1f0a-4ac3-85ce-7321cdcef63b" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:53:54 user nova-compute[74692]: DEBUG nova.network.neutron [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.network.neutron [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Updating instance_info_cache with network_info: [{"id": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "address": "fa:16:3e:87:5b:a6", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b109d8-a2", "ovs_interfaceid": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Releasing lock "refresh_cache-5d266a05-1f0a-4ac3-85ce-7321cdcef63b" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Instance network_info: |[{"id": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "address": "fa:16:3e:87:5b:a6", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b109d8-a2", "ovs_interfaceid": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-33bb3ef9-1aca-48b4-a37a-481e3f8ddf70 req-6d4f551a-6f14-4999-bb31-dd62232b7f07 service nova] Acquired lock "refresh_cache-5d266a05-1f0a-4ac3-85ce-7321cdcef63b" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.network.neutron [req-33bb3ef9-1aca-48b4-a37a-481e3f8ddf70 req-6d4f551a-6f14-4999-bb31-dd62232b7f07 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Refreshing network info cache for port b7b109d8-a218-4b24-8da2-e3a4c5087fdd {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Start _get_guest_xml network_info=[{"id": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "address": "fa:16:3e:87:5b:a6", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b109d8-a2", "ovs_interfaceid": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:53:55 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:53:55 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:53:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-9562692',display_name='tempest-AttachVolumeNegativeTest-server-9562692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-9562692',id=38,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj4Lo6H4+2vDbsJyX/PVU5rGTywv4FiaeBYvQkEAPkqP91rqDweXfHwqso6yJxeB43N8DpQVfdbLqCPAKTlAT35itw1hacMoY2H3q0zigqFiV2zLyv42jToPwbG0QkhNw==',key_name='tempest-keypair-470326151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7475e741034a4302b0ab193f1b6c67d2',ramdisk_id='',reservation_id='r-0cabsgk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-542263902',owner_user_name='tempest-AttachVolumeNegativeTest-542263902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='def7f7c9ff4f4a29a840ace22d509755',uuid=5d266a05-1f0a-4ac3-85ce-7321cdcef63b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "address": "fa:16:3e:87:5b:a6", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b109d8-a2", "ovs_interfaceid": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converting VIF {"id": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "address": "fa:16:3e:87:5b:a6", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b109d8-a2", "ovs_interfaceid": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=b7b109d8-a218-4b24-8da2-e3a4c5087fdd,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b109d8-a2') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.objects.instance [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d266a05-1f0a-4ac3-85ce-7321cdcef63b {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:53:55 user nova-compute[74692]:   <uuid>5d266a05-1f0a-4ac3-85ce-7321cdcef63b</uuid>
Nov 18 18:53:55 user nova-compute[74692]:   <name>instance-00000026</name>
Nov 18 18:53:55 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:53:55 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:53:55 user nova-compute[74692]:   <metadata>
Nov 18 18:53:55 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:53:55 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:53:55 user nova-compute[74692]:       <nova:name>tempest-AttachVolumeNegativeTest-server-9562692</nova:name>
Nov 18 18:53:55 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:53:55</nova:creationTime>
Nov 18 18:53:55 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:53:55 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:53:55 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:53:55 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:53:55 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:53:55 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:53:55 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:53:55 user nova-compute[74692]:       <nova:owner>
Nov 18 18:53:55 user nova-compute[74692]:         <nova:user uuid="def7f7c9ff4f4a29a840ace22d509755">tempest-AttachVolumeNegativeTest-542263902-project-member</nova:user>
Nov 18 18:53:55 user nova-compute[74692]:         <nova:project uuid="7475e741034a4302b0ab193f1b6c67d2">tempest-AttachVolumeNegativeTest-542263902</nova:project>
Nov 18 18:53:55 user nova-compute[74692]:       </nova:owner>
Nov 18 18:53:55 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:53:55 user nova-compute[74692]:       <nova:ports>
Nov 18 18:53:55 user nova-compute[74692]:         <nova:port uuid="b7b109d8-a218-4b24-8da2-e3a4c5087fdd">
Nov 18 18:53:55 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 18:53:55 user nova-compute[74692]:         </nova:port>
Nov 18 18:53:55 user nova-compute[74692]:       </nova:ports>
Nov 18 18:53:55 user nova-compute[74692]:     </nova:instance>
Nov 18 18:53:55 user nova-compute[74692]:   </metadata>
Nov 18 18:53:55 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:53:55 user nova-compute[74692]:     <system>
Nov 18 18:53:55 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:53:55 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:53:55 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:53:55 user nova-compute[74692]:       <entry name="serial">5d266a05-1f0a-4ac3-85ce-7321cdcef63b</entry>
Nov 18 18:53:55 user nova-compute[74692]:       <entry name="uuid">5d266a05-1f0a-4ac3-85ce-7321cdcef63b</entry>
Nov 18 18:53:55 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:53:55 user nova-compute[74692]:     </system>
Nov 18 18:53:55 user nova-compute[74692]:   </sysinfo>
Nov 18 18:53:55 user nova-compute[74692]:   <os>
Nov 18 18:53:55 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:53:55 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:53:55 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:53:55 user nova-compute[74692]:   </os>
Nov 18 18:53:55 user nova-compute[74692]:   <features>
Nov 18 18:53:55 user nova-compute[74692]:     <acpi/>
Nov 18 18:53:55 user nova-compute[74692]:     <apic/>
Nov 18 18:53:55 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:53:55 user nova-compute[74692]:   </features>
Nov 18 18:53:55 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:53:55 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:53:55 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:53:55 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:53:55 user nova-compute[74692]:   </clock>
Nov 18 18:53:55 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:53:55 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:53:55 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:53:55 user nova-compute[74692]:   </cpu>
Nov 18 18:53:55 user nova-compute[74692]:   <devices>
Nov 18 18:53:55 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:53:55 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:53:55 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk"/>
Nov 18 18:53:55 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:53:55 user nova-compute[74692]:     </disk>
Nov 18 18:53:55 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:53:55 user nova-compute[74692]:       <mac address="fa:16:3e:87:5b:a6"/>
Nov 18 18:53:55 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:53:55 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:53:55 user nova-compute[74692]:       <target dev="tapb7b109d8-a2"/>
Nov 18 18:53:55 user nova-compute[74692]:     </interface>
Nov 18 18:53:55 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:53:55 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/console.log" append="off"/>
Nov 18 18:53:55 user nova-compute[74692]:     </serial>
Nov 18 18:53:55 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:53:55 user nova-compute[74692]:     <video>
Nov 18 18:53:55 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:53:55 user nova-compute[74692]:     </video>
Nov 18 18:53:55 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:53:55 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:53:55 user nova-compute[74692]:     </rng>
Nov 18 18:53:55 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:53:55 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:53:55 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:53:55 user nova-compute[74692]:     </memballoon>
Nov 18 18:53:55 user nova-compute[74692]:   </devices>
Nov 18 18:53:55 user nova-compute[74692]: </domain>
Nov 18 18:53:55 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:53:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-9562692',display_name='tempest-AttachVolumeNegativeTest-server-9562692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-9562692',id=38,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj4Lo6H4+2vDbsJyX/PVU5rGTywv4FiaeBYvQkEAPkqP91rqDweXfHwqso6yJxeB43N8DpQVfdbLqCPAKTlAT35itw1hacMoY2H3q0zigqFiV2zLyv42jToPwbG0QkhNw==',key_name='tempest-keypair-470326151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7475e741034a4302b0ab193f1b6c67d2',ramdisk_id='',reservation_id='r-0cabsgk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-542263902',owner_user_name='tempest-AttachVolumeNegativeTest-542263902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='def7f7c9ff4f4a29a840ace22d509755',uuid=5d266a05-1f0a-4ac3-85ce-7321cdcef63b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "address": "fa:16:3e:87:5b:a6", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b109d8-a2", "ovs_interfaceid": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converting VIF {"id": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "address": "fa:16:3e:87:5b:a6", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b109d8-a2", "ovs_interfaceid": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=b7b109d8-a218-4b24-8da2-e3a4c5087fdd,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b109d8-a2') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG os_vif [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=b7b109d8-a218-4b24-8da2-e3a4c5087fdd,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b109d8-a2') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b399fd54-6daf-5094-b374-9306f5de71f8', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7b109d8-a2, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7b109d8-a2, col_values=(('qos', UUID('6035dc54-69fd-432a-8d8d-7254b464cfd7')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7b109d8-a2, col_values=(('external_ids', {'iface-id': 'b7b109d8-a218-4b24-8da2-e3a4c5087fdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:5b:a6', 'vm-uuid': '5d266a05-1f0a-4ac3-85ce-7321cdcef63b'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:55 user nova-compute[74692]: INFO os_vif [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=b7b109d8-a218-4b24-8da2-e3a4c5087fdd,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b109d8-a2')
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No VIF found with MAC fa:16:3e:87:5b:a6, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.network.neutron [req-33bb3ef9-1aca-48b4-a37a-481e3f8ddf70 req-6d4f551a-6f14-4999-bb31-dd62232b7f07 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Updated VIF entry in instance network info cache for port b7b109d8-a218-4b24-8da2-e3a4c5087fdd. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG nova.network.neutron [req-33bb3ef9-1aca-48b4-a37a-481e3f8ddf70 req-6d4f551a-6f14-4999-bb31-dd62232b7f07 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Updating instance_info_cache with network_info: [{"id": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "address": "fa:16:3e:87:5b:a6", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b109d8-a2", "ovs_interfaceid": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:53:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-33bb3ef9-1aca-48b4-a37a-481e3f8ddf70 req-6d4f551a-6f14-4999-bb31-dd62232b7f07 service nova] Releasing lock "refresh_cache-5d266a05-1f0a-4ac3-85ce-7321cdcef63b" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:53:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:57 user nova-compute[74692]: DEBUG nova.compute.manager [req-f5058366-5bff-402a-8713-dc9cfa7953a5 req-54abc0e8-7bdb-4c7d-b77c-7db34c71f549 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Received event network-vif-plugged-b7b109d8-a218-4b24-8da2-e3a4c5087fdd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:53:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f5058366-5bff-402a-8713-dc9cfa7953a5 req-54abc0e8-7bdb-4c7d-b77c-7db34c71f549 service nova] Acquiring lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f5058366-5bff-402a-8713-dc9cfa7953a5 req-54abc0e8-7bdb-4c7d-b77c-7db34c71f549 service nova] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f5058366-5bff-402a-8713-dc9cfa7953a5 req-54abc0e8-7bdb-4c7d-b77c-7db34c71f549 service nova] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:57 user nova-compute[74692]: DEBUG nova.compute.manager [req-f5058366-5bff-402a-8713-dc9cfa7953a5 req-54abc0e8-7bdb-4c7d-b77c-7db34c71f549 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] No waiting events found dispatching network-vif-plugged-b7b109d8-a218-4b24-8da2-e3a4c5087fdd {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:53:57 user nova-compute[74692]: WARNING nova.compute.manager [req-f5058366-5bff-402a-8713-dc9cfa7953a5 req-54abc0e8-7bdb-4c7d-b77c-7db34c71f549 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Received unexpected event network-vif-plugged-b7b109d8-a218-4b24-8da2-e3a4c5087fdd for instance with vm_state building and task_state spawning.
Nov 18 18:53:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:57 user nova-compute[74692]: DEBUG nova.compute.manager [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:53:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:57 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:53:57 user nova-compute[74692]: INFO nova.compute.claims [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Claim successful on node user
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.network.neutron [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:53:58 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.policy [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bbd290cbd4e49b59aab5217f553c6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb3bc45280424122aa275a118909d6f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:53:58 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Creating image(s)
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "/opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "/opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk 1073741824" returned: 0 in 0.056s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.network.neutron [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Successfully created port: e8a09162-8112-475b-a2b2-e42ea0da8b38 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:53:58 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Instance spawned successfully.
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:53:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:53:59 user nova-compute[74692]: INFO nova.compute.manager [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Cannot resize image /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Ensure instance console log exists: /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-1f314e43-7808-4faa-936b-141747cbbb3f req-b3ce9993-fd81-42b1-95aa-2e871b0eb1a1 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Received event network-vif-plugged-b7b109d8-a218-4b24-8da2-e3a4c5087fdd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1f314e43-7808-4faa-936b-141747cbbb3f req-b3ce9993-fd81-42b1-95aa-2e871b0eb1a1 service nova] Acquiring lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1f314e43-7808-4faa-936b-141747cbbb3f req-b3ce9993-fd81-42b1-95aa-2e871b0eb1a1 service nova] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1f314e43-7808-4faa-936b-141747cbbb3f req-b3ce9993-fd81-42b1-95aa-2e871b0eb1a1 service nova] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-1f314e43-7808-4faa-936b-141747cbbb3f req-b3ce9993-fd81-42b1-95aa-2e871b0eb1a1 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] No waiting events found dispatching network-vif-plugged-b7b109d8-a218-4b24-8da2-e3a4c5087fdd {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:53:59 user nova-compute[74692]: WARNING nova.compute.manager [req-1f314e43-7808-4faa-936b-141747cbbb3f req-b3ce9993-fd81-42b1-95aa-2e871b0eb1a1 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Received unexpected event network-vif-plugged-b7b109d8-a218-4b24-8da2-e3a4c5087fdd for instance with vm_state building and task_state spawning.
Nov 18 18:53:59 user nova-compute[74692]: INFO nova.compute.manager [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Took 6.09 seconds to build instance.
Nov 18 18:53:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-2ddcc965-443d-4c13-ba15-2642a88dc6f6 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.184s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Successfully updated port: e8a09162-8112-475b-a2b2-e42ea0da8b38 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "refresh_cache-2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquired lock "refresh_cache-2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Updating instance_info_cache with network_info: [{"id": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "address": "fa:16:3e:da:80:10", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a09162-81", "ovs_interfaceid": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Releasing lock "refresh_cache-2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Instance network_info: |[{"id": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "address": "fa:16:3e:da:80:10", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a09162-81", "ovs_interfaceid": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Start _get_guest_xml network_info=[{"id": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "address": "fa:16:3e:da:80:10", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a09162-81", "ovs_interfaceid": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:53:59 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:53:59 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-829322390',display_name='tempest-VolumesSnapshotTestJSON-instance-829322390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-829322390',id=39,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERGdVYVNjV0Bv2KhQXmTL5EVeTapoJQo35w5KWf5mEE1s8ta7uv4AE3cqHeMxsR/TqtdABU0jVq7uneBNzzASGzASvhyAq2lc84DbqirNNklZYSNSaetyhv7bQtr9f5Cw==',key_name='tempest-keypair-1750477459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb3bc45280424122aa275a118909d6f4',ramdisk_id='',reservation_id='r-30n1c5lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1571543916',owner_user_name='tempest-VolumesSnapshotTestJSON-1571543916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bbd290cbd4e49b59aab5217f553c6f0',uuid=2f4a4be6-4596-4f6c-8ad8-a98470b95c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "address": "fa:16:3e:da:80:10", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a09162-81", "ovs_interfaceid": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Converting VIF {"id": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "address": "fa:16:3e:da:80:10", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a09162-81", "ovs_interfaceid": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:80:10,bridge_name='br-int',has_traffic_filtering=True,id=e8a09162-8112-475b-a2b2-e42ea0da8b38,network=Network(70fdfeca-f8bb-4437-95bb-8479471c0733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a09162-81') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.objects.instance [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:53:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:53:59 user nova-compute[74692]:   <uuid>2f4a4be6-4596-4f6c-8ad8-a98470b95c7f</uuid>
Nov 18 18:53:59 user nova-compute[74692]:   <name>instance-00000027</name>
Nov 18 18:53:59 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:53:59 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:53:59 user nova-compute[74692]:   <metadata>
Nov 18 18:53:59 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:53:59 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:53:59 user nova-compute[74692]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-829322390</nova:name>
Nov 18 18:53:59 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:53:59</nova:creationTime>
Nov 18 18:53:59 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:53:59 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:53:59 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:53:59 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:53:59 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:53:59 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:53:59 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:53:59 user nova-compute[74692]:       <nova:owner>
Nov 18 18:53:59 user nova-compute[74692]:         <nova:user uuid="8bbd290cbd4e49b59aab5217f553c6f0">tempest-VolumesSnapshotTestJSON-1571543916-project-member</nova:user>
Nov 18 18:53:59 user nova-compute[74692]:         <nova:project uuid="fb3bc45280424122aa275a118909d6f4">tempest-VolumesSnapshotTestJSON-1571543916</nova:project>
Nov 18 18:53:59 user nova-compute[74692]:       </nova:owner>
Nov 18 18:53:59 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:53:59 user nova-compute[74692]:       <nova:ports>
Nov 18 18:53:59 user nova-compute[74692]:         <nova:port uuid="e8a09162-8112-475b-a2b2-e42ea0da8b38">
Nov 18 18:53:59 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 18 18:53:59 user nova-compute[74692]:         </nova:port>
Nov 18 18:53:59 user nova-compute[74692]:       </nova:ports>
Nov 18 18:53:59 user nova-compute[74692]:     </nova:instance>
Nov 18 18:53:59 user nova-compute[74692]:   </metadata>
Nov 18 18:53:59 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:53:59 user nova-compute[74692]:     <system>
Nov 18 18:53:59 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:53:59 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:53:59 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:53:59 user nova-compute[74692]:       <entry name="serial">2f4a4be6-4596-4f6c-8ad8-a98470b95c7f</entry>
Nov 18 18:53:59 user nova-compute[74692]:       <entry name="uuid">2f4a4be6-4596-4f6c-8ad8-a98470b95c7f</entry>
Nov 18 18:53:59 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:53:59 user nova-compute[74692]:     </system>
Nov 18 18:53:59 user nova-compute[74692]:   </sysinfo>
Nov 18 18:53:59 user nova-compute[74692]:   <os>
Nov 18 18:53:59 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:53:59 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:53:59 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:53:59 user nova-compute[74692]:   </os>
Nov 18 18:53:59 user nova-compute[74692]:   <features>
Nov 18 18:53:59 user nova-compute[74692]:     <acpi/>
Nov 18 18:53:59 user nova-compute[74692]:     <apic/>
Nov 18 18:53:59 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:53:59 user nova-compute[74692]:   </features>
Nov 18 18:53:59 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:53:59 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:53:59 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:53:59 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:53:59 user nova-compute[74692]:   </clock>
Nov 18 18:53:59 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:53:59 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:53:59 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:53:59 user nova-compute[74692]:   </cpu>
Nov 18 18:53:59 user nova-compute[74692]:   <devices>
Nov 18 18:53:59 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:53:59 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:53:59 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk"/>
Nov 18 18:53:59 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:53:59 user nova-compute[74692]:     </disk>
Nov 18 18:53:59 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:53:59 user nova-compute[74692]:       <mac address="fa:16:3e:da:80:10"/>
Nov 18 18:53:59 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:53:59 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:53:59 user nova-compute[74692]:       <target dev="tape8a09162-81"/>
Nov 18 18:53:59 user nova-compute[74692]:     </interface>
Nov 18 18:53:59 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:53:59 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/console.log" append="off"/>
Nov 18 18:53:59 user nova-compute[74692]:     </serial>
Nov 18 18:53:59 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:53:59 user nova-compute[74692]:     <video>
Nov 18 18:53:59 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:53:59 user nova-compute[74692]:     </video>
Nov 18 18:53:59 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:53:59 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:53:59 user nova-compute[74692]:     </rng>
Nov 18 18:53:59 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:53:59 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:53:59 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:53:59 user nova-compute[74692]:     </memballoon>
Nov 18 18:53:59 user nova-compute[74692]:   </devices>
Nov 18 18:53:59 user nova-compute[74692]: </domain>
Nov 18 18:53:59 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-829322390',display_name='tempest-VolumesSnapshotTestJSON-instance-829322390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-829322390',id=39,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERGdVYVNjV0Bv2KhQXmTL5EVeTapoJQo35w5KWf5mEE1s8ta7uv4AE3cqHeMxsR/TqtdABU0jVq7uneBNzzASGzASvhyAq2lc84DbqirNNklZYSNSaetyhv7bQtr9f5Cw==',key_name='tempest-keypair-1750477459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb3bc45280424122aa275a118909d6f4',ramdisk_id='',reservation_id='r-30n1c5lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1571543916',owner_user_name='tempest-VolumesSnapshotTestJSON-1571543916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bbd290cbd4e49b59aab5217f553c6f0',uuid=2f4a4be6-4596-4f6c-8ad8-a98470b95c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "address": "fa:16:3e:da:80:10", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a09162-81", "ovs_interfaceid": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Converting VIF {"id": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "address": "fa:16:3e:da:80:10", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a09162-81", "ovs_interfaceid": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:80:10,bridge_name='br-int',has_traffic_filtering=True,id=e8a09162-8112-475b-a2b2-e42ea0da8b38,network=Network(70fdfeca-f8bb-4437-95bb-8479471c0733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a09162-81') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG os_vif [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:80:10,bridge_name='br-int',has_traffic_filtering=True,id=e8a09162-8112-475b-a2b2-e42ea0da8b38,network=Network(70fdfeca-f8bb-4437-95bb-8479471c0733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a09162-81') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43cdb852-e752-5d67-94fb-a1271b379193', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8a09162-81, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8a09162-81, col_values=(('qos', UUID('61165f3e-433c-4271-ac47-2b746c9c6244')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8a09162-81, col_values=(('external_ids', {'iface-id': 'e8a09162-8112-475b-a2b2-e42ea0da8b38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:80:10', 'vm-uuid': '2f4a4be6-4596-4f6c-8ad8-a98470b95c7f'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:00 user nova-compute[74692]: INFO os_vif [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:80:10,bridge_name='br-int',has_traffic_filtering=True,id=e8a09162-8112-475b-a2b2-e42ea0da8b38,network=Network(70fdfeca-f8bb-4437-95bb-8479471c0733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a09162-81')
Nov 18 18:54:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:54:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] No VIF found with MAC fa:16:3e:da:80:10, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-1dec9545-4fd6-402e-81b2-83fad47b15c1 req-c67d7789-a0e9-4570-a3ff-c16e7e02d363 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-changed-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-1dec9545-4fd6-402e-81b2-83fad47b15c1 req-c67d7789-a0e9-4570-a3ff-c16e7e02d363 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Refreshing instance network info cache due to event network-changed-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1dec9545-4fd6-402e-81b2-83fad47b15c1 req-c67d7789-a0e9-4570-a3ff-c16e7e02d363 service nova] Acquiring lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1dec9545-4fd6-402e-81b2-83fad47b15c1 req-c67d7789-a0e9-4570-a3ff-c16e7e02d363 service nova] Acquired lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.network.neutron [req-1dec9545-4fd6-402e-81b2-83fad47b15c1 req-c67d7789-a0e9-4570-a3ff-c16e7e02d363 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Refreshing network info cache for port 2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Received event network-changed-e8a09162-8112-475b-a2b2-e42ea0da8b38 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Refreshing instance network info cache due to event network-changed-e8a09162-8112-475b-a2b2-e42ea0da8b38. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] Acquiring lock "refresh_cache-2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] Acquired lock "refresh_cache-2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.network.neutron [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Refreshing network info cache for port e8a09162-8112-475b-a2b2-e42ea0da8b38 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "ac108610-6f06-48e0-93fe-14563906178c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:01 user nova-compute[74692]: INFO nova.compute.manager [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Detaching volume 6be70347-3504-4271-bc4b-97420f1ac1b8
Nov 18 18:54:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:01 user nova-compute[74692]: INFO nova.virt.block_device [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Attempting to driver detach volume 6be70347-3504-4271-bc4b-97420f1ac1b8 from mountpoint /dev/vdb
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.network.neutron [req-1dec9545-4fd6-402e-81b2-83fad47b15c1 req-c67d7789-a0e9-4570-a3ff-c16e7e02d363 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updated VIF entry in instance network info cache for port 2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.network.neutron [req-1dec9545-4fd6-402e-81b2-83fad47b15c1 req-c67d7789-a0e9-4570-a3ff-c16e7e02d363 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updating instance_info_cache with network_info: [{"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Attempting to detach device vdb from instance ac108610-6f06-48e0-93fe-14563906178c from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:54:01 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:54:01 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 18:54:01 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:54:01 user nova-compute[74692]:   <serial>6be70347-3504-4271-bc4b-97420f1ac1b8</serial>
Nov 18 18:54:01 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 18:54:01 user nova-compute[74692]: </disk>
Nov 18 18:54:01 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1dec9545-4fd6-402e-81b2-83fad47b15c1 req-c67d7789-a0e9-4570-a3ff-c16e7e02d363 service nova] Releasing lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:54:01 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Successfully detached device vdb from instance ac108610-6f06-48e0-93fe-14563906178c from the persistent domain config.
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ac108610-6f06-48e0-93fe-14563906178c from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:54:01 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:54:01 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 18:54:01 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:54:01 user nova-compute[74692]:   <serial>6be70347-3504-4271-bc4b-97420f1ac1b8</serial>
Nov 18 18:54:01 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 18:54:01 user nova-compute[74692]: </disk>
Nov 18 18:54:01 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-bebd3da5-77fb-434d-956c-3ec7f39a96c7 req-e298cad0-d320-491f-a41c-c06adbd1dcc8 service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Received event network-vif-plugged-e8a09162-8112-475b-a2b2-e42ea0da8b38 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-bebd3da5-77fb-434d-956c-3ec7f39a96c7 req-e298cad0-d320-491f-a41c-c06adbd1dcc8 service nova] Acquiring lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-bebd3da5-77fb-434d-956c-3ec7f39a96c7 req-e298cad0-d320-491f-a41c-c06adbd1dcc8 service nova] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-bebd3da5-77fb-434d-956c-3ec7f39a96c7 req-e298cad0-d320-491f-a41c-c06adbd1dcc8 service nova] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-bebd3da5-77fb-434d-956c-3ec7f39a96c7 req-e298cad0-d320-491f-a41c-c06adbd1dcc8 service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] No waiting events found dispatching network-vif-plugged-e8a09162-8112-475b-a2b2-e42ea0da8b38 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:54:01 user nova-compute[74692]: WARNING nova.compute.manager [req-bebd3da5-77fb-434d-956c-3ec7f39a96c7 req-e298cad0-d320-491f-a41c-c06adbd1dcc8 service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Received unexpected event network-vif-plugged-e8a09162-8112-475b-a2b2-e42ea0da8b38 for instance with vm_state building and task_state spawning.
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.network.neutron [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Updated VIF entry in instance network info cache for port e8a09162-8112-475b-a2b2-e42ea0da8b38. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.network.neutron [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Updating instance_info_cache with network_info: [{"id": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "address": "fa:16:3e:da:80:10", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a09162-81", "ovs_interfaceid": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] Releasing lock "refresh_cache-2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-changed-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Refreshing instance network info cache due to event network-changed-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] Acquiring lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] Acquired lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:54:01 user nova-compute[74692]: DEBUG nova.network.neutron [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Refreshing network info cache for port 2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:54:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ac108610-6f06-48e0-93fe-14563906178c {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:54:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:02 user nova-compute[74692]: DEBUG nova.network.neutron [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updated VIF entry in instance network info cache for port 2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:54:02 user nova-compute[74692]: DEBUG nova.network.neutron [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updating instance_info_cache with network_info: [{"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:54:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0455118e-86d0-4468-9d7c-39485062bca1 req-c6908a1b-7978-4083-90e0-fc9e55b9f07b service nova] Releasing lock "refresh_cache-ac108610-6f06-48e0-93fe-14563906178c" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:54:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-7c4589ff-1c8b-4009-b29e-65c022dfef22 req-fdd352be-3e99-4a0e-84bf-f05f10c1899d service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Received event network-vif-plugged-e8a09162-8112-475b-a2b2-e42ea0da8b38 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:54:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7c4589ff-1c8b-4009-b29e-65c022dfef22 req-fdd352be-3e99-4a0e-84bf-f05f10c1899d service nova] Acquiring lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7c4589ff-1c8b-4009-b29e-65c022dfef22 req-fdd352be-3e99-4a0e-84bf-f05f10c1899d service nova] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7c4589ff-1c8b-4009-b29e-65c022dfef22 req-fdd352be-3e99-4a0e-84bf-f05f10c1899d service nova] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-7c4589ff-1c8b-4009-b29e-65c022dfef22 req-fdd352be-3e99-4a0e-84bf-f05f10c1899d service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] No waiting events found dispatching network-vif-plugged-e8a09162-8112-475b-a2b2-e42ea0da8b38 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:54:03 user nova-compute[74692]: WARNING nova.compute.manager [req-7c4589ff-1c8b-4009-b29e-65c022dfef22 req-fdd352be-3e99-4a0e-84bf-f05f10c1899d service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Received unexpected event network-vif-plugged-e8a09162-8112-475b-a2b2-e42ea0da8b38 for instance with vm_state building and task_state spawning.
Nov 18 18:54:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:54:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:54:03 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Instance spawned successfully.
Nov 18 18:54:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:54:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:54:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:54:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:54:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:54:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:54:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:54:04 user nova-compute[74692]: INFO nova.compute.manager [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 18 18:54:04 user nova-compute[74692]: DEBUG nova.compute.manager [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:54:04 user nova-compute[74692]: INFO nova.compute.manager [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Took 6.31 seconds to build instance.
Nov 18 18:54:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a20ee8a9-f189-4e50-8d13-3b12308e6069 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.398s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:22 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ac108610-6f06-48e0-93fe-14563906178c is timed out.
Nov 18 18:54:22 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Successfully detached device vdb from instance ac108610-6f06-48e0-93fe-14563906178c from the live domain config.
Nov 18 18:54:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLvaUhPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:54:22 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[98845f5d-b122-4c2b-8ba1-6ce09972957d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:54:22 user nova-compute[74692]: No targets found.
Nov 18 18:54:22 user nova-compute[74692]: iSNS:
Nov 18 18:54:22 user nova-compute[74692]: No targets found.
Nov 18 18:54:22 user nova-compute[74692]: STATIC:
Nov 18 18:54:22 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8
Nov 18 18:54:22 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:54:22 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:54:22 user nova-compute[74692]: FIRMWARE:
Nov 18 18:54:22 user nova-compute[74692]: No targets found.
Nov 18 18:54:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:54:22 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:54:22 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f98e14-c58b-45e3-a9a2-6470fe476ec2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd661350-8d99-4ae3-9428-57d3e0633f9a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:54:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 (non-flash)
Nov 18 18:54:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c4671fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[398d17e5-e54c-408d-a728-12e1f223baad]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe0583d-2e96-40ec-a216-e3bd95a62d24]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[77172c67-2942-47bc-b9e7-48cf99a1c30d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d35417-7c0f-4af4-87c2-b1edf1a0c523]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[462b351c-1fe2-4137-bb81-9cbdd1983b04]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc62ec7-2437-49ee-9689-52d5e23af562]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260]
Nov 18 18:54:22 user nova-compute[74692]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8, portal: 172.16.0.220,3260] successful.
Nov 18 18:54:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6be70347-3504-4271-bc4b-97420f1ac1b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d262779-e7ee-46be-b332-f2da2193ff90]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] <== disconnect_volume: return (290ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:54:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:54:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:23 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lazy-loading 'flavor' on Instance uuid ac108610-6f06-48e0-93fe-14563906178c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:54:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3d29599d-29a4-4550-a25d-c8dded1aaafe tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "ac108610-6f06-48e0-93fe-14563906178c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.878s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:54:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:25 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:54:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:25 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:54:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:54:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:54:27 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:54:27 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:54:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8417MB free_disk=25.004154205322266GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:54:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance ac108610-6f06-48e0-93fe-14563906178c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:54:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5946a617-f567-4ab6-a2db-29c2c86544a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:54:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5d266a05-1f0a-4ac3-85ce-7321cdcef63b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:54:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:54:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:54:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:54:28 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:54:28 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:54:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:54:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:54:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 18:54:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:54:30 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:54:31 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:54:31 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:54:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:54:32 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:54:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:33 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:54:33 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:54:33 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 18:54:33 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] There are 0 instances to clean {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 18:54:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:54:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:35 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:54:36 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:54:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:54:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:54:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:54:37 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:54:37 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating instance_info_cache with network_info: [{"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:54:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:54:37 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:54:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:54:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:42 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:54:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid ac108610-6f06-48e0-93fe-14563906178c {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:54:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 5946a617-f567-4ab6-a2db-29c2c86544a6 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:54:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 5d266a05-1f0a-4ac3-85ce-7321cdcef63b {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:54:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 18:54:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "ac108610-6f06-48e0-93fe-14563906178c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "ac108610-6f06-48e0-93fe-14563906178c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "ac108610-6f06-48e0-93fe-14563906178c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:54 user nova-compute[74692]: INFO nova.compute.manager [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Terminating instance
Nov 18 18:54:54 user nova-compute[74692]: DEBUG nova.compute.manager [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG nova.compute.manager [req-cbb3a5b7-4e37-4e33-82bd-7b0bce637617 req-ca81ed41-08f1-4f0e-861b-a85632e164d3 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-vif-unplugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-cbb3a5b7-4e37-4e33-82bd-7b0bce637617 req-ca81ed41-08f1-4f0e-861b-a85632e164d3 service nova] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-cbb3a5b7-4e37-4e33-82bd-7b0bce637617 req-ca81ed41-08f1-4f0e-861b-a85632e164d3 service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-cbb3a5b7-4e37-4e33-82bd-7b0bce637617 req-ca81ed41-08f1-4f0e-861b-a85632e164d3 service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG nova.compute.manager [req-cbb3a5b7-4e37-4e33-82bd-7b0bce637617 req-ca81ed41-08f1-4f0e-861b-a85632e164d3 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] No waiting events found dispatching network-vif-unplugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG nova.compute.manager [req-cbb3a5b7-4e37-4e33-82bd-7b0bce637617 req-ca81ed41-08f1-4f0e-861b-a85632e164d3 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-vif-unplugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:54 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: ac108610-6f06-48e0-93fe-14563906178c] Instance destroyed successfully.
Nov 18 18:54:54 user nova-compute[74692]: DEBUG nova.objects.instance [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lazy-loading 'resources' on Instance uuid ac108610-6f06-48e0-93fe-14563906178c {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-393233064',display_name='tempest-TestMinimumBasicScenario-server-393233064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-393233064',id=35,image_ref='180cb580-e4b8-404f-9bc6-d48f84e37d71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNA4KvlxqrTIIKDvhSKfJ3XU3ntHC/3i/+xwD/BIw+RSHdiP8VwGhtxhDQjwPdH4a0qcX71w/dHEHyruK0pUhAiQzvFhCoAz0JtAhfXvdzxPBo36TRfUwQwTRuz8StN8g==',key_name='tempest-TestMinimumBasicScenario-812410050',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:50:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eff44b3a1f5486296f293bcaa879f04',ramdisk_id='',reservation_id='r-2te0wbel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='180cb580-e4b8-404f-9bc6-d48f84e37d71',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1654716799',owner_user_name='tempest-TestMinimumBasicScenario-1654716799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:52:16Z,user_data=None,user_id='81e4fbd0fddf4c0d8051c4020165681a',uuid=ac108610-6f06-48e0-93fe-14563906178c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converting VIF {"id": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "address": "fa:16:3e:2e:f7:c5", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7a0ee4-6a", "ovs_interfaceid": "2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7a0ee4-6a') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG os_vif [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7a0ee4-6a') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e7a0ee4-6a, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfd25ec4-8024-4e77-bd31-d949e37dc56f) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:54:55 user nova-compute[74692]: INFO os_vif [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7a0ee4-6a')
Nov 18 18:54:55 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Deleting instance files /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c_del
Nov 18 18:54:55 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Deletion of /opt/stack/data/nova/instances/ac108610-6f06-48e0-93fe-14563906178c_del complete
Nov 18 18:54:55 user nova-compute[74692]: INFO nova.compute.manager [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: ac108610-6f06-48e0-93fe-14563906178c] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 18 18:54:55 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: ac108610-6f06-48e0-93fe-14563906178c] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: ac108610-6f06-48e0-93fe-14563906178c] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: ac108610-6f06-48e0-93fe-14563906178c] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:54:55 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: ac108610-6f06-48e0-93fe-14563906178c] Took 0.68 seconds to deallocate network for instance.
Nov 18 18:54:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:56 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Deleted allocations for instance ac108610-6f06-48e0-93fe-14563906178c
Nov 18 18:54:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-e22997b4-4c28-4916-b4d2-c105ee8c7cb9 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "ac108610-6f06-48e0-93fe-14563906178c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.972s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG nova.compute.manager [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG nova.compute.manager [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] No waiting events found dispatching network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:54:56 user nova-compute[74692]: WARNING nova.compute.manager [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received unexpected event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 for instance with vm_state deleted and task_state None.
Nov 18 18:54:56 user nova-compute[74692]: DEBUG nova.compute.manager [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG nova.compute.manager [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] No waiting events found dispatching network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:54:56 user nova-compute[74692]: WARNING nova.compute.manager [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received unexpected event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 for instance with vm_state deleted and task_state None.
Nov 18 18:54:56 user nova-compute[74692]: DEBUG nova.compute.manager [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG nova.compute.manager [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] No waiting events found dispatching network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:54:56 user nova-compute[74692]: WARNING nova.compute.manager [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received unexpected event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 for instance with vm_state deleted and task_state None.
Nov 18 18:54:56 user nova-compute[74692]: DEBUG nova.compute.manager [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] Acquiring lock "ac108610-6f06-48e0-93fe-14563906178c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] Lock "ac108610-6f06-48e0-93fe-14563906178c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:54:56 user nova-compute[74692]: DEBUG nova.compute.manager [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] No waiting events found dispatching network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:54:56 user nova-compute[74692]: WARNING nova.compute.manager [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received unexpected event network-vif-plugged-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 for instance with vm_state deleted and task_state None.
Nov 18 18:54:56 user nova-compute[74692]: DEBUG nova.compute.manager [req-8292f3f2-2c2d-43ff-8ede-3af9e90005f8 req-523d1bd1-8331-4b27-8d29-0ba61419bc07 service nova] [instance: ac108610-6f06-48e0-93fe-14563906178c] Received event network-vif-deleted-2e7a0ee4-6aac-4f89-8e7a-2ef7a8c148c5 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:55:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:55:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:55:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:55:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 18:55:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:55:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:55:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-b22d71a7-1135-45b6-8457-41fce6906bb1 req-9dc61597-cff8-4f37-80b8-3608d8db6cc5 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-changed-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:55:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-b22d71a7-1135-45b6-8457-41fce6906bb1 req-9dc61597-cff8-4f37-80b8-3608d8db6cc5 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Refreshing instance network info cache due to event network-changed-38f70b63-f3b8-41f4-b96a-0c87108ccd85. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:55:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b22d71a7-1135-45b6-8457-41fce6906bb1 req-9dc61597-cff8-4f37-80b8-3608d8db6cc5 service nova] Acquiring lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:55:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b22d71a7-1135-45b6-8457-41fce6906bb1 req-9dc61597-cff8-4f37-80b8-3608d8db6cc5 service nova] Acquired lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:55:18 user nova-compute[74692]: DEBUG nova.network.neutron [req-b22d71a7-1135-45b6-8457-41fce6906bb1 req-9dc61597-cff8-4f37-80b8-3608d8db6cc5 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Refreshing network info cache for port 38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:55:19 user nova-compute[74692]: DEBUG nova.network.neutron [req-b22d71a7-1135-45b6-8457-41fce6906bb1 req-9dc61597-cff8-4f37-80b8-3608d8db6cc5 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updated VIF entry in instance network info cache for port 38f70b63-f3b8-41f4-b96a-0c87108ccd85. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:55:19 user nova-compute[74692]: DEBUG nova.network.neutron [req-b22d71a7-1135-45b6-8457-41fce6906bb1 req-9dc61597-cff8-4f37-80b8-3608d8db6cc5 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating instance_info_cache with network_info: [{"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:55:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b22d71a7-1135-45b6-8457-41fce6906bb1 req-9dc61597-cff8-4f37-80b8-3608d8db6cc5 service nova] Releasing lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:55:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:55:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:26 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:55:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:55:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:28 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:55:28 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:55:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8660MB free_disk=25.029605865478516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5946a617-f567-4ab6-a2db-29c2c86544a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5d266a05-1f0a-4ac3-85ce-7321cdcef63b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing inventories for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating ProviderTree inventory for provider 582be55c-ee9f-496e-b354-5900b8401d2c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating inventory in ProviderTree for provider 582be55c-ee9f-496e-b354-5900b8401d2c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing aggregate associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, aggregates: None {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing trait associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:55:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:31 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:55:31 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:55:32 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:55:32 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:55:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:55:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:55:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 18:55:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:55:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:55:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:35 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:55:36 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:55:36 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:55:37 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:55:37 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:55:37 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 18:55:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:55:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:55:38 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:55:38 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid 5946a617-f567-4ab6-a2db-29c2c86544a6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:55:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:38 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating instance_info_cache with network_info: [{"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:55:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:55:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:55:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-02029a24-e101-43fa-a239-dfcc531f0f93 req-d077b00b-5d80-4c47-a983-fbb47e3c367c service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Received event network-changed-b7b109d8-a218-4b24-8da2-e3a4c5087fdd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:55:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-02029a24-e101-43fa-a239-dfcc531f0f93 req-d077b00b-5d80-4c47-a983-fbb47e3c367c service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Refreshing instance network info cache due to event network-changed-b7b109d8-a218-4b24-8da2-e3a4c5087fdd. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:55:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-02029a24-e101-43fa-a239-dfcc531f0f93 req-d077b00b-5d80-4c47-a983-fbb47e3c367c service nova] Acquiring lock "refresh_cache-5d266a05-1f0a-4ac3-85ce-7321cdcef63b" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:55:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-02029a24-e101-43fa-a239-dfcc531f0f93 req-d077b00b-5d80-4c47-a983-fbb47e3c367c service nova] Acquired lock "refresh_cache-5d266a05-1f0a-4ac3-85ce-7321cdcef63b" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:55:44 user nova-compute[74692]: DEBUG nova.network.neutron [req-02029a24-e101-43fa-a239-dfcc531f0f93 req-d077b00b-5d80-4c47-a983-fbb47e3c367c service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Refreshing network info cache for port b7b109d8-a218-4b24-8da2-e3a4c5087fdd {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:55:44 user nova-compute[74692]: DEBUG nova.network.neutron [req-02029a24-e101-43fa-a239-dfcc531f0f93 req-d077b00b-5d80-4c47-a983-fbb47e3c367c service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Updated VIF entry in instance network info cache for port b7b109d8-a218-4b24-8da2-e3a4c5087fdd. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:55:44 user nova-compute[74692]: DEBUG nova.network.neutron [req-02029a24-e101-43fa-a239-dfcc531f0f93 req-d077b00b-5d80-4c47-a983-fbb47e3c367c service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Updating instance_info_cache with network_info: [{"id": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "address": "fa:16:3e:87:5b:a6", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b109d8-a2", "ovs_interfaceid": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:55:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-02029a24-e101-43fa-a239-dfcc531f0f93 req-d077b00b-5d80-4c47-a983-fbb47e3c367c service nova] Releasing lock "refresh_cache-5d266a05-1f0a-4ac3-85ce-7321cdcef63b" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:55:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG nova.objects.instance [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'flavor' on Instance uuid 5d266a05-1f0a-4ac3-85ce-7321cdcef63b {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG nova.compute.manager [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:55:48 user nova-compute[74692]: INFO nova.compute.claims [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Claim successful on node user
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:48 user nova-compute[74692]: INFO nova.compute.manager [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Attaching volume 5ed966a5-6ecb-4c60-a496-532d8184e33c to /dev/vdb
Nov 18 18:55:48 user nova-compute[74692]: DEBUG os_brick.utils [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[04df7f82-877a-4fe9-92bc-7c85be595f1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[732f7542-7eb6-45eb-865a-b98298e6d2e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[641d248b-8a41-41bd-9ab8-3e6ae15c0024]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a27faca-255b-452a-b492-3405fd05f87b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:55:48 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da858a8-1ff2-40d0-a20a-1e6eecb19f57]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG os_brick.utils [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Updating existing volume attachment record: 153f51ca-47dd-4de4-9cd5-09f935469df8 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG nova.compute.manager [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG nova.compute.manager [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG nova.network.neutron [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:55:48 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:55:48 user nova-compute[74692]: DEBUG nova.compute.manager [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG nova.compute.manager [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:55:48 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Creating image(s)
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "/opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "/opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "/opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "bd086d4fcfe8c2d9c492684aad1981db24a52a39" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "bd086d4fcfe8c2d9c492684aad1981db24a52a39" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39.part --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG nova.policy [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81e4fbd0fddf4c0d8051c4020165681a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eff44b3a1f5486296f293bcaa879f04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG nova.compute.manager [req-1a7ce560-d299-4d68-a3fd-fb430aaf9d15 req-25b2e637-6b62-4e63-9657-7b5f0ed8d840 service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Received event network-changed-e8a09162-8112-475b-a2b2-e42ea0da8b38 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG nova.compute.manager [req-1a7ce560-d299-4d68-a3fd-fb430aaf9d15 req-25b2e637-6b62-4e63-9657-7b5f0ed8d840 service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Refreshing instance network info cache due to event network-changed-e8a09162-8112-475b-a2b2-e42ea0da8b38. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1a7ce560-d299-4d68-a3fd-fb430aaf9d15 req-25b2e637-6b62-4e63-9657-7b5f0ed8d840 service nova] Acquiring lock "refresh_cache-2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1a7ce560-d299-4d68-a3fd-fb430aaf9d15 req-25b2e637-6b62-4e63-9657-7b5f0ed8d840 service nova] Acquired lock "refresh_cache-2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG nova.network.neutron [req-1a7ce560-d299-4d68-a3fd-fb430aaf9d15 req-25b2e637-6b62-4e63-9657-7b5f0ed8d840 service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Refreshing network info cache for port e8a09162-8112-475b-a2b2-e42ea0da8b38 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39.part --force-share --output=json" returned: 0 in 0.201s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG nova.virt.images [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] 883af0bb-115a-4a16-89e9-fd1ac21f0dd1 was qcow2, converting to raw {{(pid=74692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG nova.privsep.utils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39.part /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39.converted {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG nova.objects.instance [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lazy-loading 'flavor' on Instance uuid 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:55:49 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Ignoring supplied device name: /dev/vdb
Nov 18 18:55:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.148s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39.part /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39.converted" returned: 0 in 0.426s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:49 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39.converted --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:50 user nova-compute[74692]: INFO nova.compute.manager [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Attaching volume af7d048f-5bee-4741-bc32-8d05737a0928 to /dev/vdb
Nov 18 18:55:50 user nova-compute[74692]: DEBUG nova.network.neutron [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Successfully created port: 23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG os_brick.utils [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42491b7-fdf5-4f0b-8087-68fc59be6b8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[241a8fad-6238-4d28-a21a-7d86bd4eb94d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39.converted --force-share --output=json" returned: 0 in 0.282s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "bd086d4fcfe8c2d9c492684aad1981db24a52a39" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.461s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG nova.network.neutron [req-1a7ce560-d299-4d68-a3fd-fb430aaf9d15 req-25b2e637-6b62-4e63-9657-7b5f0ed8d840 service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Updated VIF entry in instance network info cache for port e8a09162-8112-475b-a2b2-e42ea0da8b38. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG nova.network.neutron [req-1a7ce560-d299-4d68-a3fd-fb430aaf9d15 req-25b2e637-6b62-4e63-9657-7b5f0ed8d840 service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Updating instance_info_cache with network_info: [{"id": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "address": "fa:16:3e:da:80:10", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a09162-81", "ovs_interfaceid": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[41049c87-b9ac-4a6e-b735-2e3c04dbd479]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c67b5c-c892-4e9d-98cf-ad9d128985a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1a7ce560-d299-4d68-a3fd-fb430aaf9d15 req-25b2e637-6b62-4e63-9657-7b5f0ed8d840 service nova] Releasing lock "refresh_cache-2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:55:50 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[97633807-219a-47e2-8252-f27c770c52fd]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG os_brick.utils [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Updating existing volume attachment record: e739da19-5708-4a44-8968-7bd24ceaaac2 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39 --force-share --output=json" returned: 0 in 0.194s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "bd086d4fcfe8c2d9c492684aad1981db24a52a39" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "bd086d4fcfe8c2d9c492684aad1981db24a52a39" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39 --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39,backing_fmt=raw /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39,backing_fmt=raw /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk 1073741824" returned: 0 in 0.079s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "bd086d4fcfe8c2d9c492684aad1981db24a52a39" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG nova.network.neutron [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Successfully updated port: 23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquired lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG nova.network.neutron [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG nova.network.neutron [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39 --force-share --output=json" returned: 0 in 0.185s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:55:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Cannot resize image /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Ensure instance console log exists: /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.network.neutron [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updating instance_info_cache with network_info: [{"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Releasing lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.compute.manager [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Instance network_info: |[{"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Start _get_guest_xml network_info=[{"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:55:46Z,direct_url=<?>,disk_format='qcow2',id=883af0bb-115a-4a16-89e9-fd1ac21f0dd1,min_disk=0,min_ram=0,name='tempest-scenario-img--1668753887',owner='7eff44b3a1f5486296f293bcaa879f04',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '883af0bb-115a-4a16-89e9-fd1ac21f0dd1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:55:51 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:55:51 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:55:46Z,direct_url=<?>,disk_format='qcow2',id=883af0bb-115a-4a16-89e9-fd1ac21f0dd1,min_disk=0,min_ram=0,name='tempest-scenario-img--1668753887',owner='7eff44b3a1f5486296f293bcaa879f04',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-626063356',display_name='tempest-TestMinimumBasicScenario-server-626063356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-626063356',id=40,image_ref='883af0bb-115a-4a16-89e9-fd1ac21f0dd1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGRaCjlWarzPlGYrhEobPHdGmzYZEzyoJ51FegKOsQXVZjfvPUvPKqM/7QgdJ9259I5kZxACf7OHEKK8WR40naSAOupJ04y3VhwRELicYPW0nPPeF4r1CL1aqqq7Bo1Ug==',key_name='tempest-TestMinimumBasicScenario-1991359170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eff44b3a1f5486296f293bcaa879f04',ramdisk_id='',reservation_id='r-gpitjpu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='883af0bb-115a-4a16-89e9-fd1ac21f0dd1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1654716799',owner_user_name='tempest-TestMinimumBasicScenario-1654716799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:55:49Z,user_data=None,user_id='81e4fbd0fddf4c0d8051c4020165681a',uuid=65e6ca14-de51-49e0-a417-87a72ee1fe42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converting VIF {"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:51:1b,bridge_name='br-int',has_traffic_filtering=True,id=23428c32-45a0-44bb-bf79-3ea64636d40f,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23428c32-45') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.objects.instance [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lazy-loading 'pci_devices' on Instance uuid 65e6ca14-de51-49e0-a417-87a72ee1fe42 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:55:51 user nova-compute[74692]:   <uuid>65e6ca14-de51-49e0-a417-87a72ee1fe42</uuid>
Nov 18 18:55:51 user nova-compute[74692]:   <name>instance-00000028</name>
Nov 18 18:55:51 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:55:51 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:55:51 user nova-compute[74692]:   <metadata>
Nov 18 18:55:51 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:55:51 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:55:51 user nova-compute[74692]:       <nova:name>tempest-TestMinimumBasicScenario-server-626063356</nova:name>
Nov 18 18:55:51 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:55:51</nova:creationTime>
Nov 18 18:55:51 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:55:51 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:55:51 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:55:51 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:55:51 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:55:51 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:55:51 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:55:51 user nova-compute[74692]:       <nova:owner>
Nov 18 18:55:51 user nova-compute[74692]:         <nova:user uuid="81e4fbd0fddf4c0d8051c4020165681a">tempest-TestMinimumBasicScenario-1654716799-project-member</nova:user>
Nov 18 18:55:51 user nova-compute[74692]:         <nova:project uuid="7eff44b3a1f5486296f293bcaa879f04">tempest-TestMinimumBasicScenario-1654716799</nova:project>
Nov 18 18:55:51 user nova-compute[74692]:       </nova:owner>
Nov 18 18:55:51 user nova-compute[74692]:       <nova:root type="image" uuid="883af0bb-115a-4a16-89e9-fd1ac21f0dd1"/>
Nov 18 18:55:51 user nova-compute[74692]:       <nova:ports>
Nov 18 18:55:51 user nova-compute[74692]:         <nova:port uuid="23428c32-45a0-44bb-bf79-3ea64636d40f">
Nov 18 18:55:51 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 18 18:55:51 user nova-compute[74692]:         </nova:port>
Nov 18 18:55:51 user nova-compute[74692]:       </nova:ports>
Nov 18 18:55:51 user nova-compute[74692]:     </nova:instance>
Nov 18 18:55:51 user nova-compute[74692]:   </metadata>
Nov 18 18:55:51 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:55:51 user nova-compute[74692]:     <system>
Nov 18 18:55:51 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:55:51 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:55:51 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:55:51 user nova-compute[74692]:       <entry name="serial">65e6ca14-de51-49e0-a417-87a72ee1fe42</entry>
Nov 18 18:55:51 user nova-compute[74692]:       <entry name="uuid">65e6ca14-de51-49e0-a417-87a72ee1fe42</entry>
Nov 18 18:55:51 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:55:51 user nova-compute[74692]:     </system>
Nov 18 18:55:51 user nova-compute[74692]:   </sysinfo>
Nov 18 18:55:51 user nova-compute[74692]:   <os>
Nov 18 18:55:51 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:55:51 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:55:51 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:55:51 user nova-compute[74692]:   </os>
Nov 18 18:55:51 user nova-compute[74692]:   <features>
Nov 18 18:55:51 user nova-compute[74692]:     <acpi/>
Nov 18 18:55:51 user nova-compute[74692]:     <apic/>
Nov 18 18:55:51 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:55:51 user nova-compute[74692]:   </features>
Nov 18 18:55:51 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:55:51 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:55:51 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:55:51 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:55:51 user nova-compute[74692]:   </clock>
Nov 18 18:55:51 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:55:51 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:55:51 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:55:51 user nova-compute[74692]:   </cpu>
Nov 18 18:55:51 user nova-compute[74692]:   <devices>
Nov 18 18:55:51 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:55:51 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:55:51 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk"/>
Nov 18 18:55:51 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:55:51 user nova-compute[74692]:     </disk>
Nov 18 18:55:51 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:55:51 user nova-compute[74692]:       <mac address="fa:16:3e:b0:51:1b"/>
Nov 18 18:55:51 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:55:51 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:55:51 user nova-compute[74692]:       <target dev="tap23428c32-45"/>
Nov 18 18:55:51 user nova-compute[74692]:     </interface>
Nov 18 18:55:51 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:55:51 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/console.log" append="off"/>
Nov 18 18:55:51 user nova-compute[74692]:     </serial>
Nov 18 18:55:51 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:55:51 user nova-compute[74692]:     <video>
Nov 18 18:55:51 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:55:51 user nova-compute[74692]:     </video>
Nov 18 18:55:51 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:55:51 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:55:51 user nova-compute[74692]:     </rng>
Nov 18 18:55:51 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:55:51 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:55:51 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:55:51 user nova-compute[74692]:     </memballoon>
Nov 18 18:55:51 user nova-compute[74692]:   </devices>
Nov 18 18:55:51 user nova-compute[74692]: </domain>
Nov 18 18:55:51 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-626063356',display_name='tempest-TestMinimumBasicScenario-server-626063356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-626063356',id=40,image_ref='883af0bb-115a-4a16-89e9-fd1ac21f0dd1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGRaCjlWarzPlGYrhEobPHdGmzYZEzyoJ51FegKOsQXVZjfvPUvPKqM/7QgdJ9259I5kZxACf7OHEKK8WR40naSAOupJ04y3VhwRELicYPW0nPPeF4r1CL1aqqq7Bo1Ug==',key_name='tempest-TestMinimumBasicScenario-1991359170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eff44b3a1f5486296f293bcaa879f04',ramdisk_id='',reservation_id='r-gpitjpu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='883af0bb-115a-4a16-89e9-fd1ac21f0dd1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1654716799',owner_user_name='tempest-TestMinimumBasicScenario-1654716799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:55:49Z,user_data=None,user_id='81e4fbd0fddf4c0d8051c4020165681a',uuid=65e6ca14-de51-49e0-a417-87a72ee1fe42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converting VIF {"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:51:1b,bridge_name='br-int',has_traffic_filtering=True,id=23428c32-45a0-44bb-bf79-3ea64636d40f,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23428c32-45') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG os_vif [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:51:1b,bridge_name='br-int',has_traffic_filtering=True,id=23428c32-45a0-44bb-bf79-3ea64636d40f,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23428c32-45') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c7302c3-8b19-526f-b595-c5781f32be9d', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23428c32-45, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23428c32-45, col_values=(('qos', UUID('f9e72027-be55-4684-9987-284b20377e44')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23428c32-45, col_values=(('external_ids', {'iface-id': '23428c32-45a0-44bb-bf79-3ea64636d40f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:51:1b', 'vm-uuid': '65e6ca14-de51-49e0-a417-87a72ee1fe42'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:51 user nova-compute[74692]: INFO os_vif [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:51:1b,bridge_name='br-int',has_traffic_filtering=True,id=23428c32-45a0-44bb-bf79-3ea64636d40f,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23428c32-45')
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] No VIF found with MAC fa:16:3e:b0:51:1b, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-205f1910-6e58-4fc8-a0ac-3fbcdafa39c9 req-ac2ad0f2-b061-41e9-b67c-14abeeb9d6da service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received event network-changed-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-205f1910-6e58-4fc8-a0ac-3fbcdafa39c9 req-ac2ad0f2-b061-41e9-b67c-14abeeb9d6da service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Refreshing instance network info cache due to event network-changed-23428c32-45a0-44bb-bf79-3ea64636d40f. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-205f1910-6e58-4fc8-a0ac-3fbcdafa39c9 req-ac2ad0f2-b061-41e9-b67c-14abeeb9d6da service nova] Acquiring lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-205f1910-6e58-4fc8-a0ac-3fbcdafa39c9 req-ac2ad0f2-b061-41e9-b67c-14abeeb9d6da service nova] Acquired lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.network.neutron [req-205f1910-6e58-4fc8-a0ac-3fbcdafa39c9 req-ac2ad0f2-b061-41e9-b67c-14abeeb9d6da service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Refreshing network info cache for port 23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.network.neutron [req-205f1910-6e58-4fc8-a0ac-3fbcdafa39c9 req-ac2ad0f2-b061-41e9-b67c-14abeeb9d6da service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updated VIF entry in instance network info cache for port 23428c32-45a0-44bb-bf79-3ea64636d40f. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG nova.network.neutron [req-205f1910-6e58-4fc8-a0ac-3fbcdafa39c9 req-ac2ad0f2-b061-41e9-b67c-14abeeb9d6da service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updating instance_info_cache with network_info: [{"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:55:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-205f1910-6e58-4fc8-a0ac-3fbcdafa39c9 req-ac2ad0f2-b061-41e9-b67c-14abeeb9d6da service nova] Releasing lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:55:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG nova.compute.manager [req-c9c1d158-02f8-4958-abf3-7d522a3f7f2f req-9c919b4b-ac36-44d7-bc39-f19ad65ad8f8 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received event network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c9c1d158-02f8-4958-abf3-7d522a3f7f2f req-9c919b4b-ac36-44d7-bc39-f19ad65ad8f8 service nova] Acquiring lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c9c1d158-02f8-4958-abf3-7d522a3f7f2f req-9c919b4b-ac36-44d7-bc39-f19ad65ad8f8 service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c9c1d158-02f8-4958-abf3-7d522a3f7f2f req-9c919b4b-ac36-44d7-bc39-f19ad65ad8f8 service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG nova.compute.manager [req-c9c1d158-02f8-4958-abf3-7d522a3f7f2f req-9c919b4b-ac36-44d7-bc39-f19ad65ad8f8 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] No waiting events found dispatching network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:55:53 user nova-compute[74692]: WARNING nova.compute.manager [req-c9c1d158-02f8-4958-abf3-7d522a3f7f2f req-9c919b4b-ac36-44d7-bc39-f19ad65ad8f8 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received unexpected event network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f for instance with vm_state building and task_state spawning.
Nov 18 18:55:53 user nova-compute[74692]: DEBUG nova.compute.manager [req-c9c1d158-02f8-4958-abf3-7d522a3f7f2f req-9c919b4b-ac36-44d7-bc39-f19ad65ad8f8 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received event network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c9c1d158-02f8-4958-abf3-7d522a3f7f2f req-9c919b4b-ac36-44d7-bc39-f19ad65ad8f8 service nova] Acquiring lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c9c1d158-02f8-4958-abf3-7d522a3f7f2f req-9c919b4b-ac36-44d7-bc39-f19ad65ad8f8 service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c9c1d158-02f8-4958-abf3-7d522a3f7f2f req-9c919b4b-ac36-44d7-bc39-f19ad65ad8f8 service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG nova.compute.manager [req-c9c1d158-02f8-4958-abf3-7d522a3f7f2f req-9c919b4b-ac36-44d7-bc39-f19ad65ad8f8 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] No waiting events found dispatching network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:55:53 user nova-compute[74692]: WARNING nova.compute.manager [req-c9c1d158-02f8-4958-abf3-7d522a3f7f2f req-9c919b4b-ac36-44d7-bc39-f19ad65ad8f8 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received unexpected event network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f for instance with vm_state building and task_state spawning.
Nov 18 18:55:53 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GOlCPZgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:55:53 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:55:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:55:53 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:55:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:55:53 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca14dacd-53d8-4103-94cc-8b97a6c6478a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:55:53 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9a0951-6bab-446b-8434-022e539c7608]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c] added
Nov 18 18:55:53 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c83f5ed-d985-4675-b3da-60e243fbd817]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd5d633-9470-4fae-ab0b-0c18527ffc29]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GOlCPZgp {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GOlCPZgp" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44d2197-e7ae-4933-bb3e-6c622e361d35]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GOlCPZgp'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[54794a77-53cc-407c-8696-5c2fbc39de92]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c681f83-d256-4638-88a4-23bcd12551c4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 18:55:53 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:55:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 18:55:53 user nova-compute[74692]:  {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:55:53 user nova-compute[74692]: WARNING os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 18:55:53 user nova-compute[74692]: 
Nov 18 18:55:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fa602a-8e49-4758-bd6a-77d8e98c0974]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c, portal: 172.16.0.220,3260]
Nov 18 18:55:54 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c, portal: 172.16.0.220,3260] successful.
Nov 18 18:55:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e4f946-39b6-462e-83b9-2e78b23caff1]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22d121b-3d52-433f-ac9a-8079f13cf6ca]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:55:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:55:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec312c8-4d9d-4aa2-942a-5add78b611b6]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GOlCPZgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG nova.compute.manager [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:55:54 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Instance spawned successfully.
Nov 18 18:55:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:55:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:55:54 user nova-compute[74692]: INFO nova.compute.manager [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 18 18:55:54 user nova-compute[74692]: DEBUG nova.compute.manager [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:55:54 user nova-compute[74692]: INFO nova.compute.manager [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Took 6.71 seconds to build instance.
Nov 18 18:55:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fcde4d89-eb2d-458d-83ed-1073cbecd348 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.816s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23366636238333433', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366636238333433', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG nova.objects.instance [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'flavor' on Instance uuid 5d266a05-1f0a-4ac3-85ce-7321cdcef63b {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:55:55 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:55:55 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 18:55:55 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:55:55 user nova-compute[74692]:   <serial>5ed966a5-6ecb-4c60-a496-532d8184e33c</serial>
Nov 18 18:55:55 user nova-compute[74692]: </disk>
Nov 18 18:55:55 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No VIF found with MAC fa:16:3e:87:5b:a6, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-186e6863-07f1-4a58-a06c-ff538ea4f090 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.542s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKFZsrNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:55:55 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:55:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:55:55 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:55:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:55:55 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7af6eb-f17f-48e3-80cd-40aa87872305]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:55:55 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[832109ba-1835-40f5-b285-8c2fbb38552f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928] added
Nov 18 18:55:55 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6413e7-14cc-45ed-ab32-91c4d3db0139]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4bb1d3-24ea-4be7-ae3a-737e2babbb97]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKFZsrNx {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKFZsrNx" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[631dceeb-5adf-4fa9-9180-f3c74d56a2a8]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LKFZsrNx'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e5c3d7-2d8e-4193-a8c1-cf00e0f8f3c9]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b6f0b5-d232-464a-a393-e86ecdedba92]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:55:55 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:55:55 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:55:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2438e5-04e2-444f-9ed2-686e25cc360e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928, portal: 172.16.0.220,3260]
Nov 18 18:55:56 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928, portal: 172.16.0.220,3260] successful.
Nov 18 18:55:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf69464-3b01-42b9-af57-f379cc36f710]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[04af6046-42e2-4f6d-b256-5918140a46c7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:55:56 user nova-compute[74692]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 (non-flash)
Nov 18 18:55:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:55:56 user nova-compute[74692]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 (non-flash)
Nov 18 18:55:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5005671-ac95-40ee-bfe9-fb706d30c4c5]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKFZsrNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:55:57 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26465353637653862', 'path': '/dev/sdc'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:55:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465353637653862', 'path': '/dev/sdc'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:55:57 user nova-compute[74692]: DEBUG nova.objects.instance [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lazy-loading 'flavor' on Instance uuid 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:55:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:55:57 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:55:57 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:55:57 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:55:57 user nova-compute[74692]:   <serial>af7d048f-5bee-4741-bc32-8d05737a0928</serial>
Nov 18 18:55:57 user nova-compute[74692]: </disk>
Nov 18 18:55:57 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:55:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:55:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:55:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] No VIF found with MAC fa:16:3e:da:80:10, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:55:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-13f279f4-7ea4-4760-8618-8d5bbbd5e9fa tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.778s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:55:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:55:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:55:58 user nova-compute[74692]: INFO nova.compute.claims [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Claim successful on node user
Nov 18 18:55:58 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:55:58 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:55:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:55:59 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:55:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG nova.policy [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'def7f7c9ff4f4a29a840ace22d509755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7475e741034a4302b0ab193f1b6c67d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:55:59 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Creating image(s)
Nov 18 18:55:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "/opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "/opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.200s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk 1073741824" returned: 0 in 0.081s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Successfully created port: 2692ca07-2b27-4c37-b77a-001eb608e76c {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.215s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:55:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Cannot resize image /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Ensure instance console log exists: /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.network.neutron [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Successfully updated port: 2692ca07-2b27-4c37-b77a-001eb608e76c {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "refresh_cache-c6218f0d-b00a-4c3e-aacb-c7b96edfa801" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquired lock "refresh_cache-c6218f0d-b00a-4c3e-aacb-c7b96edfa801" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.network.neutron [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-c97b6a5b-d7e6-489f-b3e4-bbc0e9d27a6e req-2c25af11-df09-4d30-a446-736f0ed15dad service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Received event network-changed-2692ca07-2b27-4c37-b77a-001eb608e76c {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.compute.manager [req-c97b6a5b-d7e6-489f-b3e4-bbc0e9d27a6e req-2c25af11-df09-4d30-a446-736f0ed15dad service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Refreshing instance network info cache due to event network-changed-2692ca07-2b27-4c37-b77a-001eb608e76c. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c97b6a5b-d7e6-489f-b3e4-bbc0e9d27a6e req-2c25af11-df09-4d30-a446-736f0ed15dad service nova] Acquiring lock "refresh_cache-c6218f0d-b00a-4c3e-aacb-c7b96edfa801" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.network.neutron [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.network.neutron [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Updating instance_info_cache with network_info: [{"id": "2692ca07-2b27-4c37-b77a-001eb608e76c", "address": "fa:16:3e:d6:e9:77", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2692ca07-2b", "ovs_interfaceid": "2692ca07-2b27-4c37-b77a-001eb608e76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Releasing lock "refresh_cache-c6218f0d-b00a-4c3e-aacb-c7b96edfa801" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.compute.manager [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Instance network_info: |[{"id": "2692ca07-2b27-4c37-b77a-001eb608e76c", "address": "fa:16:3e:d6:e9:77", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2692ca07-2b", "ovs_interfaceid": "2692ca07-2b27-4c37-b77a-001eb608e76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c97b6a5b-d7e6-489f-b3e4-bbc0e9d27a6e req-2c25af11-df09-4d30-a446-736f0ed15dad service nova] Acquired lock "refresh_cache-c6218f0d-b00a-4c3e-aacb-c7b96edfa801" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.network.neutron [req-c97b6a5b-d7e6-489f-b3e4-bbc0e9d27a6e req-2c25af11-df09-4d30-a446-736f0ed15dad service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Refreshing network info cache for port 2692ca07-2b27-4c37-b77a-001eb608e76c {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Start _get_guest_xml network_info=[{"id": "2692ca07-2b27-4c37-b77a-001eb608e76c", "address": "fa:16:3e:d6:e9:77", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2692ca07-2b", "ovs_interfaceid": "2692ca07-2b27-4c37-b77a-001eb608e76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:56:00 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:56:00 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1391057047',display_name='tempest-AttachVolumeNegativeTest-server-1391057047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1391057047',id=41,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpc3sJMD0EvQTn798yq+AlNsWdIEVW7cH/Y9lcvIhy06W6X9LQqL7ywhBL52lQf6q7GWINkllcjhNCOAOHJr1LQa8KqmUWW2P590sfup4vaE6Ibxv1LGGX/RKy6g0pnqQ==',key_name='tempest-keypair-280583975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7475e741034a4302b0ab193f1b6c67d2',ramdisk_id='',reservation_id='r-atwks5zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-542263902',owner_user_name='tempest-AttachVolumeNegativeTest-542263902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='def7f7c9ff4f4a29a840ace22d509755',uuid=c6218f0d-b00a-4c3e-aacb-c7b96edfa801,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2692ca07-2b27-4c37-b77a-001eb608e76c", "address": "fa:16:3e:d6:e9:77", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2692ca07-2b", "ovs_interfaceid": "2692ca07-2b27-4c37-b77a-001eb608e76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converting VIF {"id": "2692ca07-2b27-4c37-b77a-001eb608e76c", "address": "fa:16:3e:d6:e9:77", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2692ca07-2b", "ovs_interfaceid": "2692ca07-2b27-4c37-b77a-001eb608e76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e9:77,bridge_name='br-int',has_traffic_filtering=True,id=2692ca07-2b27-4c37-b77a-001eb608e76c,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2692ca07-2b') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.objects.instance [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'pci_devices' on Instance uuid c6218f0d-b00a-4c3e-aacb-c7b96edfa801 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:56:00 user nova-compute[74692]:   <uuid>c6218f0d-b00a-4c3e-aacb-c7b96edfa801</uuid>
Nov 18 18:56:00 user nova-compute[74692]:   <name>instance-00000029</name>
Nov 18 18:56:00 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:56:00 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:56:00 user nova-compute[74692]:   <metadata>
Nov 18 18:56:00 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:56:00 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:56:00 user nova-compute[74692]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1391057047</nova:name>
Nov 18 18:56:00 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:56:00</nova:creationTime>
Nov 18 18:56:00 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:56:00 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:56:00 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:56:00 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:56:00 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:56:00 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:56:00 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:56:00 user nova-compute[74692]:       <nova:owner>
Nov 18 18:56:00 user nova-compute[74692]:         <nova:user uuid="def7f7c9ff4f4a29a840ace22d509755">tempest-AttachVolumeNegativeTest-542263902-project-member</nova:user>
Nov 18 18:56:00 user nova-compute[74692]:         <nova:project uuid="7475e741034a4302b0ab193f1b6c67d2">tempest-AttachVolumeNegativeTest-542263902</nova:project>
Nov 18 18:56:00 user nova-compute[74692]:       </nova:owner>
Nov 18 18:56:00 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:56:00 user nova-compute[74692]:       <nova:ports>
Nov 18 18:56:00 user nova-compute[74692]:         <nova:port uuid="2692ca07-2b27-4c37-b77a-001eb608e76c">
Nov 18 18:56:00 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 18 18:56:00 user nova-compute[74692]:         </nova:port>
Nov 18 18:56:00 user nova-compute[74692]:       </nova:ports>
Nov 18 18:56:00 user nova-compute[74692]:     </nova:instance>
Nov 18 18:56:00 user nova-compute[74692]:   </metadata>
Nov 18 18:56:00 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:56:00 user nova-compute[74692]:     <system>
Nov 18 18:56:00 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:56:00 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:56:00 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:56:00 user nova-compute[74692]:       <entry name="serial">c6218f0d-b00a-4c3e-aacb-c7b96edfa801</entry>
Nov 18 18:56:00 user nova-compute[74692]:       <entry name="uuid">c6218f0d-b00a-4c3e-aacb-c7b96edfa801</entry>
Nov 18 18:56:00 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:56:00 user nova-compute[74692]:     </system>
Nov 18 18:56:00 user nova-compute[74692]:   </sysinfo>
Nov 18 18:56:00 user nova-compute[74692]:   <os>
Nov 18 18:56:00 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:56:00 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:56:00 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:56:00 user nova-compute[74692]:   </os>
Nov 18 18:56:00 user nova-compute[74692]:   <features>
Nov 18 18:56:00 user nova-compute[74692]:     <acpi/>
Nov 18 18:56:00 user nova-compute[74692]:     <apic/>
Nov 18 18:56:00 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:56:00 user nova-compute[74692]:   </features>
Nov 18 18:56:00 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:56:00 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:56:00 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:56:00 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:56:00 user nova-compute[74692]:   </clock>
Nov 18 18:56:00 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:56:00 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:56:00 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:56:00 user nova-compute[74692]:   </cpu>
Nov 18 18:56:00 user nova-compute[74692]:   <devices>
Nov 18 18:56:00 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:56:00 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:56:00 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk"/>
Nov 18 18:56:00 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:56:00 user nova-compute[74692]:     </disk>
Nov 18 18:56:00 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:56:00 user nova-compute[74692]:       <mac address="fa:16:3e:d6:e9:77"/>
Nov 18 18:56:00 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:56:00 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:56:00 user nova-compute[74692]:       <target dev="tap2692ca07-2b"/>
Nov 18 18:56:00 user nova-compute[74692]:     </interface>
Nov 18 18:56:00 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:56:00 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/console.log" append="off"/>
Nov 18 18:56:00 user nova-compute[74692]:     </serial>
Nov 18 18:56:00 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:56:00 user nova-compute[74692]:     <video>
Nov 18 18:56:00 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:56:00 user nova-compute[74692]:     </video>
Nov 18 18:56:00 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:56:00 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:56:00 user nova-compute[74692]:     </rng>
Nov 18 18:56:00 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:56:00 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:56:00 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:56:00 user nova-compute[74692]:     </memballoon>
Nov 18 18:56:00 user nova-compute[74692]:   </devices>
Nov 18 18:56:00 user nova-compute[74692]: </domain>
Nov 18 18:56:00 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1391057047',display_name='tempest-AttachVolumeNegativeTest-server-1391057047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1391057047',id=41,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpc3sJMD0EvQTn798yq+AlNsWdIEVW7cH/Y9lcvIhy06W6X9LQqL7ywhBL52lQf6q7GWINkllcjhNCOAOHJr1LQa8KqmUWW2P590sfup4vaE6Ibxv1LGGX/RKy6g0pnqQ==',key_name='tempest-keypair-280583975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7475e741034a4302b0ab193f1b6c67d2',ramdisk_id='',reservation_id='r-atwks5zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-542263902',owner_user_name='tempest-AttachVolumeNegativeTest-542263902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='def7f7c9ff4f4a29a840ace22d509755',uuid=c6218f0d-b00a-4c3e-aacb-c7b96edfa801,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2692ca07-2b27-4c37-b77a-001eb608e76c", "address": "fa:16:3e:d6:e9:77", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2692ca07-2b", "ovs_interfaceid": "2692ca07-2b27-4c37-b77a-001eb608e76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converting VIF {"id": "2692ca07-2b27-4c37-b77a-001eb608e76c", "address": "fa:16:3e:d6:e9:77", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2692ca07-2b", "ovs_interfaceid": "2692ca07-2b27-4c37-b77a-001eb608e76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e9:77,bridge_name='br-int',has_traffic_filtering=True,id=2692ca07-2b27-4c37-b77a-001eb608e76c,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2692ca07-2b') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG os_vif [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e9:77,bridge_name='br-int',has_traffic_filtering=True,id=2692ca07-2b27-4c37-b77a-001eb608e76c,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2692ca07-2b') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21c0ac05-b645-54c5-9f20-5953fd82c5d0', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2692ca07-2b, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2692ca07-2b, col_values=(('qos', UUID('8b639425-f136-4f5d-a536-b348cba48ddc')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2692ca07-2b, col_values=(('external_ids', {'iface-id': '2692ca07-2b27-4c37-b77a-001eb608e76c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:e9:77', 'vm-uuid': 'c6218f0d-b00a-4c3e-aacb-c7b96edfa801'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:00 user nova-compute[74692]: INFO os_vif [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e9:77,bridge_name='br-int',has_traffic_filtering=True,id=2692ca07-2b27-4c37-b77a-001eb608e76c,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2692ca07-2b')
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:56:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No VIF found with MAC fa:16:3e:d6:e9:77, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:56:01 user nova-compute[74692]: DEBUG nova.network.neutron [req-c97b6a5b-d7e6-489f-b3e4-bbc0e9d27a6e req-2c25af11-df09-4d30-a446-736f0ed15dad service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Updated VIF entry in instance network info cache for port 2692ca07-2b27-4c37-b77a-001eb608e76c. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:56:01 user nova-compute[74692]: DEBUG nova.network.neutron [req-c97b6a5b-d7e6-489f-b3e4-bbc0e9d27a6e req-2c25af11-df09-4d30-a446-736f0ed15dad service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Updating instance_info_cache with network_info: [{"id": "2692ca07-2b27-4c37-b77a-001eb608e76c", "address": "fa:16:3e:d6:e9:77", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2692ca07-2b", "ovs_interfaceid": "2692ca07-2b27-4c37-b77a-001eb608e76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:56:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c97b6a5b-d7e6-489f-b3e4-bbc0e9d27a6e req-2c25af11-df09-4d30-a446-736f0ed15dad service nova] Releasing lock "refresh_cache-c6218f0d-b00a-4c3e-aacb-c7b96edfa801" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:56:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-a317f4ff-d1aa-4df5-b2b5-d54b8747fbc1 req-25a5441a-6538-4942-8f86-b26a99a4cdb1 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Received event network-vif-plugged-2692ca07-2b27-4c37-b77a-001eb608e76c {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:56:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a317f4ff-d1aa-4df5-b2b5-d54b8747fbc1 req-25a5441a-6538-4942-8f86-b26a99a4cdb1 service nova] Acquiring lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:56:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a317f4ff-d1aa-4df5-b2b5-d54b8747fbc1 req-25a5441a-6538-4942-8f86-b26a99a4cdb1 service nova] Lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:56:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a317f4ff-d1aa-4df5-b2b5-d54b8747fbc1 req-25a5441a-6538-4942-8f86-b26a99a4cdb1 service nova] Lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:56:02 user nova-compute[74692]: DEBUG nova.compute.manager [req-a317f4ff-d1aa-4df5-b2b5-d54b8747fbc1 req-25a5441a-6538-4942-8f86-b26a99a4cdb1 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] No waiting events found dispatching network-vif-plugged-2692ca07-2b27-4c37-b77a-001eb608e76c {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:56:02 user nova-compute[74692]: WARNING nova.compute.manager [req-a317f4ff-d1aa-4df5-b2b5-d54b8747fbc1 req-25a5441a-6538-4942-8f86-b26a99a4cdb1 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Received unexpected event network-vif-plugged-2692ca07-2b27-4c37-b77a-001eb608e76c for instance with vm_state building and task_state spawning.
Nov 18 18:56:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:04 user nova-compute[74692]: DEBUG nova.compute.manager [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:56:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:56:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Instance spawned successfully.
Nov 18 18:56:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:56:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:56:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:56:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:56:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:56:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:56:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:56:04 user nova-compute[74692]: INFO nova.compute.manager [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 18 18:56:04 user nova-compute[74692]: DEBUG nova.compute.manager [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:56:04 user nova-compute[74692]: INFO nova.compute.manager [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Took 6.02 seconds to build instance.
Nov 18 18:56:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-25cae52a-67b3-40b1-bc68-030dcc502572 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.123s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:56:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-16bf20b8-6b2d-4731-bce5-1f214f7b2789 req-dfae8e2a-cbe0-4abf-939b-4724966c69b8 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Received event network-vif-plugged-2692ca07-2b27-4c37-b77a-001eb608e76c {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:56:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-16bf20b8-6b2d-4731-bce5-1f214f7b2789 req-dfae8e2a-cbe0-4abf-939b-4724966c69b8 service nova] Acquiring lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:56:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-16bf20b8-6b2d-4731-bce5-1f214f7b2789 req-dfae8e2a-cbe0-4abf-939b-4724966c69b8 service nova] Lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:56:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-16bf20b8-6b2d-4731-bce5-1f214f7b2789 req-dfae8e2a-cbe0-4abf-939b-4724966c69b8 service nova] Lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:56:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-16bf20b8-6b2d-4731-bce5-1f214f7b2789 req-dfae8e2a-cbe0-4abf-939b-4724966c69b8 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] No waiting events found dispatching network-vif-plugged-2692ca07-2b27-4c37-b77a-001eb608e76c {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:56:04 user nova-compute[74692]: WARNING nova.compute.manager [req-16bf20b8-6b2d-4731-bce5-1f214f7b2789 req-dfae8e2a-cbe0-4abf-939b-4724966c69b8 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Received unexpected event network-vif-plugged-2692ca07-2b27-4c37-b77a-001eb608e76c for instance with vm_state active and task_state None.
Nov 18 18:56:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:56:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:56:09 user nova-compute[74692]: INFO nova.compute.manager [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Detaching volume af7d048f-5bee-4741-bc32-8d05737a0928
Nov 18 18:56:09 user nova-compute[74692]: INFO nova.virt.block_device [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Attempting to driver detach volume af7d048f-5bee-4741-bc32-8d05737a0928 from mountpoint /dev/vdb
Nov 18 18:56:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Attempting to detach device vdb from instance 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:56:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:56:10 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:56:10 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:56:10 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:56:10 user nova-compute[74692]:   <serial>af7d048f-5bee-4741-bc32-8d05737a0928</serial>
Nov 18 18:56:10 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:56:10 user nova-compute[74692]: </disk>
Nov 18 18:56:10 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:56:10 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Successfully detached device vdb from instance 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f from the persistent domain config.
Nov 18 18:56:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:56:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:56:10 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:56:10 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:56:10 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:56:10 user nova-compute[74692]:   <serial>af7d048f-5bee-4741-bc32-8d05737a0928</serial>
Nov 18 18:56:10 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:56:10 user nova-compute[74692]: </disk>
Nov 18 18:56:10 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:56:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:56:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:56:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:26 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:56:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:56:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:56:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:56:26 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:56:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:56:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:28 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:29 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:56:29 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:56:29 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8406MB free_disk=24.950634002685547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:56:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:56:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:56:29 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5946a617-f567-4ab6-a2db-29c2c86544a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:56:29 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5d266a05-1f0a-4ac3-85ce-7321cdcef63b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:56:29 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:56:29 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 65e6ca14-de51-49e0-a417-87a72ee1fe42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:56:29 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance c6218f0d-b00a-4c3e-aacb-c7b96edfa801 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:56:29 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:56:29 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:56:29 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:56:29 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:56:29 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:56:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:56:30 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f is timed out.
Nov 18 18:56:30 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Successfully detached device vdb from instance 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f from the live domain config.
Nov 18 18:56:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKFZsrNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:56:30 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3122c9-9945-4644-9805-4236102fdf59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:56:30 user nova-compute[74692]: No targets found.
Nov 18 18:56:30 user nova-compute[74692]: iSNS:
Nov 18 18:56:30 user nova-compute[74692]: No targets found.
Nov 18 18:56:30 user nova-compute[74692]: STATIC:
Nov 18 18:56:30 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c
Nov 18 18:56:30 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:56:30 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:56:30 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928
Nov 18 18:56:30 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:56:30 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:56:30 user nova-compute[74692]: FIRMWARE:
Nov 18 18:56:30 user nova-compute[74692]: No targets found.
Nov 18 18:56:30 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:56:30 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:56:30 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e00cb7c-b27d-4ff2-bb2f-2713c9e597a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[016c9a1f-0d44-4988-8624-aafd1648343a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:56:30 user nova-compute[74692]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 (non-flash)
Nov 18 18:56:30 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:56:30 user nova-compute[74692]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 (non-flash)
Nov 18 18:56:30 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a46ad3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928'): ({'sdc'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Removing single pathed devices sdc {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[51baa007-c94e-403a-9438-1069636d4983]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0296338d-f5bc-4ea1-b078-638a2b23b325]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Flushing IO for device /dev/sdc {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63480d6-9a13-44ff-96b7-6b61e3214799]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[314f1d03-14e9-4930-bf85-1e502484fbed]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5a7d6a-c7ac-497d-a646-7cf1011ac5ac]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a10d6d-7997-42b4-ab0c-c72d6191266e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928, portal: 172.16.0.220,3260]
Nov 18 18:56:30 user nova-compute[74692]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928, portal: 172.16.0.220,3260] successful.
Nov 18 18:56:30 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa6059c-4a37-4f64-9267-cbaf02d0c594]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] <== disconnect_volume: return (306ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:56:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG nova.objects.instance [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lazy-loading 'flavor' on Instance uuid 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fd71e27c-bdbd-4487-9818-a4314a52f7ee tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.731s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.550s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:56:31 user nova-compute[74692]: INFO nova.compute.manager [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Terminating instance
Nov 18 18:56:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-ca35a1ea-146e-4ce7-a22a-1dface10b400 req-84db534f-bd80-4835-b5c0-7ac8c521bf50 service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Received event network-vif-unplugged-e8a09162-8112-475b-a2b2-e42ea0da8b38 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ca35a1ea-146e-4ce7-a22a-1dface10b400 req-84db534f-bd80-4835-b5c0-7ac8c521bf50 service nova] Acquiring lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ca35a1ea-146e-4ce7-a22a-1dface10b400 req-84db534f-bd80-4835-b5c0-7ac8c521bf50 service nova] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ca35a1ea-146e-4ce7-a22a-1dface10b400 req-84db534f-bd80-4835-b5c0-7ac8c521bf50 service nova] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-ca35a1ea-146e-4ce7-a22a-1dface10b400 req-84db534f-bd80-4835-b5c0-7ac8c521bf50 service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] No waiting events found dispatching network-vif-unplugged-e8a09162-8112-475b-a2b2-e42ea0da8b38 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-ca35a1ea-146e-4ce7-a22a-1dface10b400 req-84db534f-bd80-4835-b5c0-7ac8c521bf50 service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Received event network-vif-unplugged-e8a09162-8112-475b-a2b2-e42ea0da8b38 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:56:31 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Instance destroyed successfully.
Nov 18 18:56:32 user nova-compute[74692]: DEBUG nova.objects.instance [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lazy-loading 'resources' on Instance uuid 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-829322390',display_name='tempest-VolumesSnapshotTestJSON-instance-829322390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-829322390',id=39,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERGdVYVNjV0Bv2KhQXmTL5EVeTapoJQo35w5KWf5mEE1s8ta7uv4AE3cqHeMxsR/TqtdABU0jVq7uneBNzzASGzASvhyAq2lc84DbqirNNklZYSNSaetyhv7bQtr9f5Cw==',key_name='tempest-keypair-1750477459',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:54:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb3bc45280424122aa275a118909d6f4',ramdisk_id='',reservation_id='r-30n1c5lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1571543916',owner_user_name='tempest-VolumesSnapshotTestJSON-1571543916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:54:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bbd290cbd4e49b59aab5217f553c6f0',uuid=2f4a4be6-4596-4f6c-8ad8-a98470b95c7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "address": "fa:16:3e:da:80:10", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a09162-81", "ovs_interfaceid": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Converting VIF {"id": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "address": "fa:16:3e:da:80:10", "network": {"id": "70fdfeca-f8bb-4437-95bb-8479471c0733", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1754232302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3bc45280424122aa275a118909d6f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a09162-81", "ovs_interfaceid": "e8a09162-8112-475b-a2b2-e42ea0da8b38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:80:10,bridge_name='br-int',has_traffic_filtering=True,id=e8a09162-8112-475b-a2b2-e42ea0da8b38,network=Network(70fdfeca-f8bb-4437-95bb-8479471c0733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a09162-81') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG os_vif [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:80:10,bridge_name='br-int',has_traffic_filtering=True,id=e8a09162-8112-475b-a2b2-e42ea0da8b38,network=Network(70fdfeca-f8bb-4437-95bb-8479471c0733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a09162-81') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8a09162-81, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61165f3e-433c-4271-ac47-2b746c9c6244) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:56:32 user nova-compute[74692]: INFO os_vif [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:80:10,bridge_name='br-int',has_traffic_filtering=True,id=e8a09162-8112-475b-a2b2-e42ea0da8b38,network=Network(70fdfeca-f8bb-4437-95bb-8479471c0733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a09162-81')
Nov 18 18:56:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKFZsrNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:56:32 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:56:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[77760003-405e-44f6-90ff-3a3691404d46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:56:32 user nova-compute[74692]: No targets found.
Nov 18 18:56:32 user nova-compute[74692]: iSNS:
Nov 18 18:56:32 user nova-compute[74692]: No targets found.
Nov 18 18:56:32 user nova-compute[74692]: STATIC:
Nov 18 18:56:32 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c
Nov 18 18:56:32 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:56:32 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:56:32 user nova-compute[74692]: FIRMWARE:
Nov 18 18:56:32 user nova-compute[74692]: No targets found.
Nov 18 18:56:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:56:32 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:56:32 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af7d048f-5bee-4741-bc32-8d05737a0928', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5eb8cc-2214-4a5f-865d-6880ba68c94d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4edca5-b174-465f-8eb1-e619da4dd4cb]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:56:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:56:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a45e7ac0>, {}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Disconnecting from: [] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] <== disconnect_volume: return (64ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:56:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Deleting instance files /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f_del
Nov 18 18:56:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Deletion of /opt/stack/data/nova/instances/2f4a4be6-4596-4f6c-8ad8-a98470b95c7f_del complete
Nov 18 18:56:32 user nova-compute[74692]: INFO nova.compute.manager [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 18 18:56:32 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:56:32 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:56:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:33 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:56:33 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Took 0.77 seconds to deallocate network for instance.
Nov 18 18:56:33 user nova-compute[74692]: WARNING nova.volume.cinder [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Attachment e739da19-5708-4a44-8968-7bd24ceaaac2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e739da19-5708-4a44-8968-7bd24ceaaac2. (HTTP 404) (Request-ID: req-17d55019-88ad-48bc-9ef5-587800a7b47b)
Nov 18 18:56:33 user nova-compute[74692]: INFO nova.compute.manager [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Took 0.02 seconds to detach 1 volumes for instance.
Nov 18 18:56:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-8fa1b7de-aa87-4f46-bf8b-e943e033c92e req-e3430d2a-a3e7-48ac-9f99-1d67e9770bc4 service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Received event network-vif-deleted-e8a09162-8112-475b-a2b2-e42ea0da8b38 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:56:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:56:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:56:33 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:56:33 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:56:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:56:33 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Deleted allocations for instance 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f
Nov 18 18:56:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05df6f12-3f1b-4ce1-bf17-1fa5369f2001 tempest-VolumesSnapshotTestJSON-1571543916 tempest-VolumesSnapshotTestJSON-1571543916-project-member] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.173s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:56:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-1b9adfea-8fd3-418c-b17f-967136ec8d5d req-71f01b64-2a04-450b-84ef-883e67f35e32 service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Received event network-vif-plugged-e8a09162-8112-475b-a2b2-e42ea0da8b38 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:56:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1b9adfea-8fd3-418c-b17f-967136ec8d5d req-71f01b64-2a04-450b-84ef-883e67f35e32 service nova] Acquiring lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:56:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1b9adfea-8fd3-418c-b17f-967136ec8d5d req-71f01b64-2a04-450b-84ef-883e67f35e32 service nova] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:56:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-1b9adfea-8fd3-418c-b17f-967136ec8d5d req-71f01b64-2a04-450b-84ef-883e67f35e32 service nova] Lock "2f4a4be6-4596-4f6c-8ad8-a98470b95c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:56:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-1b9adfea-8fd3-418c-b17f-967136ec8d5d req-71f01b64-2a04-450b-84ef-883e67f35e32 service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] No waiting events found dispatching network-vif-plugged-e8a09162-8112-475b-a2b2-e42ea0da8b38 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:56:33 user nova-compute[74692]: WARNING nova.compute.manager [req-1b9adfea-8fd3-418c-b17f-967136ec8d5d req-71f01b64-2a04-450b-84ef-883e67f35e32 service nova] [instance: 2f4a4be6-4596-4f6c-8ad8-a98470b95c7f] Received unexpected event network-vif-plugged-e8a09162-8112-475b-a2b2-e42ea0da8b38 for instance with vm_state deleted and task_state None.
Nov 18 18:56:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:56:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:56:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:56:35 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:56:36 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:56:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:38 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:56:38 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:56:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:56:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-5d266a05-1f0a-4ac3-85ce-7321cdcef63b" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:56:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-5d266a05-1f0a-4ac3-85ce-7321cdcef63b" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:56:39 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:56:39 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Updating instance_info_cache with network_info: [{"id": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "address": "fa:16:3e:87:5b:a6", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b109d8-a2", "ovs_interfaceid": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:56:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-5d266a05-1f0a-4ac3-85ce-7321cdcef63b" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:56:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:56:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:56:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 18:56:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:56:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 18:56:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:56:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:57:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:57:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:12 user nova-compute[74692]: DEBUG nova.objects.instance [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lazy-loading 'flavor' on Instance uuid 5946a617-f567-4ab6-a2db-29c2c86544a6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:57:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:13 user nova-compute[74692]: INFO nova.compute.manager [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Attaching volume d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 to /dev/vdb
Nov 18 18:57:13 user nova-compute[74692]: DEBUG os_brick.utils [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[083d163e-b793-4d7b-b8da-9fa6f9aefb8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[334ba299-982c-4488-ab4d-7fd1fb5ae424]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5366a8-1a73-458e-9175-8feca9b83720]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdbbd74-b493-4a66-bfbb-c6a7ab55d92d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:57:13 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:57:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cf6a53-b90d-4c8e-b04e-337dfcb76eca]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG os_brick.utils [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:57:13 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating existing volume attachment record: 35f9b854-7d29-46c5-acb8-749641b84837 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:57:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGlOzbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:57:18 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:57:18 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:57:18 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3339e61-b552-49ce-9cc6-1312404f9167]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:57:18 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe37e0e7-7e6c-43fe-9132-ad929d6176ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823] added
Nov 18 18:57:18 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.049s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbf1145-e0e4-4acd-98b4-38bc20a9cfac]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[040084da-a9b4-4cb9-866f-d2f7c149dd8a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGlOzbLd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGlOzbLd" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b88539-ca02-4e05-9cc9-878c1c722cf9]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oGlOzbLd'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cede7543-b1c5-4673-8fbd-9d4c6b8feb45]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1b3499-e2fa-4f17-8366-a1344d91de66]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:57:18 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:57:18 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[12daafba-30a3-4237-9384-e51debd73728]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260]
Nov 18 18:57:18 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260] successful.
Nov 18 18:57:18 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e70928f-47c3-4ea4-9bff-aa9e0d65ccb0]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13159eb-c53e-4935-a3ae-600e8ce8d5a2]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:57:18 user nova-compute[74692]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:57:18 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:57:18 user nova-compute[74692]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:57:18 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fd2728-1aa8-4e76-bd5d-5e1fa6b654ad]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:57:18 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGlOzbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:57:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:57:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26230343935623263', 'path': '/dev/sdc'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:57:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230343935623263', 'path': '/dev/sdc'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:57:19 user nova-compute[74692]: DEBUG nova.objects.instance [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lazy-loading 'flavor' on Instance uuid 5946a617-f567-4ab6-a2db-29c2c86544a6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:57:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:57:19 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:57:19 user nova-compute[74692]:   <source dev="/dev/sdc"/>
Nov 18 18:57:19 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:57:19 user nova-compute[74692]:   <serial>d6e9e32f-0bbb-4b9f-9850-cedc8bd47823</serial>
Nov 18 18:57:19 user nova-compute[74692]: </disk>
Nov 18 18:57:19 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:57:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:57:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:57:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] No VIF found with MAC fa:16:3e:44:c1:a3, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:57:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0967b329-8ef9-4675-af38-aa2c3269faf4 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.385s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:21 user nova-compute[74692]: DEBUG nova.compute.manager [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Stashing vm_state: active {{(pid=74692) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 18 18:57:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:57:22 user nova-compute[74692]: INFO nova.compute.claims [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Claim successful on node user
Nov 18 18:57:22 user nova-compute[74692]: INFO nova.compute.resource_tracker [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating resource usage from migration 13d93431-8763-4a16-ba33-1925640be89e
Nov 18 18:57:22 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:57:22 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:57:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.286s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:22 user nova-compute[74692]: INFO nova.compute.manager [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Migrating
Nov 18 18:57:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:57:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquired lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:57:22 user nova-compute[74692]: DEBUG nova.network.neutron [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:57:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:57:22 user nova-compute[74692]: DEBUG nova.network.neutron [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating instance_info_cache with network_info: [{"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:57:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Releasing lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:57:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Starting migrate_disk_and_power_off {{(pid=74692) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG nova.compute.manager [req-8e3308a1-953c-409e-80d3-d350a4aeb6b1 req-06aecd9b-35d3-4e49-aeeb-63d56f9178d9 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-vif-unplugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8e3308a1-953c-409e-80d3-d350a4aeb6b1 req-06aecd9b-35d3-4e49-aeeb-63d56f9178d9 service nova] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8e3308a1-953c-409e-80d3-d350a4aeb6b1 req-06aecd9b-35d3-4e49-aeeb-63d56f9178d9 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8e3308a1-953c-409e-80d3-d350a4aeb6b1 req-06aecd9b-35d3-4e49-aeeb-63d56f9178d9 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG nova.compute.manager [req-8e3308a1-953c-409e-80d3-d350a4aeb6b1 req-06aecd9b-35d3-4e49-aeeb-63d56f9178d9 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] No waiting events found dispatching network-vif-unplugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:57:23 user nova-compute[74692]: WARNING nova.compute.manager [req-8e3308a1-953c-409e-80d3-d350a4aeb6b1 req-06aecd9b-35d3-4e49-aeeb-63d56f9178d9 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received unexpected event network-vif-unplugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 for instance with vm_state active and task_state resize_migrating.
Nov 18 18:57:23 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Instance destroyed successfully.
Nov 18 18:57:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-675233857',display_name='tempest-ServerActionsTestOtherB-server-675233857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-675233857',id=37,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ44427Z/m0lH604ZCZCT3wxxkPLCJECR2dRCAhCy9jp32w/HG5k9bXDcxq0dLrD4N0NbsbYxgMfyC4dHsM3g1rzNAEweUIJRjnGxWc9qXCJAk0Y2gFT55F56wQDpzJ2w==',key_name='tempest-keypair-1851665456',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:53:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e622388d2bbe41a0ba6a5fb42c494a96',ramdisk_id='',reservation_id='r-y4r329pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-461353456',owner_user_name='tempest-ServerActionsTestOtherB-461353456-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:57:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e28b31fb4e1b45fdae81ac6c9d512c95',uuid=5946a617-f567-4ab6-a2db-29c2c86544a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2140056775-network", "vif_mac": "fa:16:3e:44:c1:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converting VIF {"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2140056775-network", "vif_mac": "fa:16:3e:44:c1:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_vif [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38f70b63-f3, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b82c9e4-032b-45ad-8f8e-387bd4c6490d) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:57:23 user nova-compute[74692]: INFO os_vif [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3')
Nov 18 18:57:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGlOzbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:57:23 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf252fb-dbb8-4341-ab30-c0ebb185b9f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:57:23 user nova-compute[74692]: No targets found.
Nov 18 18:57:23 user nova-compute[74692]: iSNS:
Nov 18 18:57:23 user nova-compute[74692]: No targets found.
Nov 18 18:57:23 user nova-compute[74692]: STATIC:
Nov 18 18:57:23 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c
Nov 18 18:57:23 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:57:23 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:57:23 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823
Nov 18 18:57:23 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:57:23 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:57:23 user nova-compute[74692]: FIRMWARE:
Nov 18 18:57:23 user nova-compute[74692]: No targets found.
Nov 18 18:57:23 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:57:23 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:57:23 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[146f04ad-37f9-4a59-a7f1-8b37245d75a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f5775b-e290-4d66-979e-c54bc4675f9c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:57:23 user nova-compute[74692]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:57:23 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:57:23 user nova-compute[74692]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:57:23 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a45589d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823'): ({'sdc'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Removing single pathed devices sdc {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b746101-69e7-43ab-9436-eb76be58da42]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0fe214-5fa8-4dfd-9ff6-45ebeb9a731f]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Flushing IO for device /dev/sdc {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e61123-b9c2-40ee-964a-5ca7781b092a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8d4dca-7513-4465-aab3-9b38c56d0195]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea83c65-ddb2-4c88-aa4b-4cbd3bf000ce]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c3f468-27d6-4193-adcc-11227624db1d]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260]
Nov 18 18:57:24 user nova-compute[74692]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260] successful.
Nov 18 18:57:24 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[44057d98-b963-4f66-b782-68ca2b6e7ec3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] <== disconnect_volume: return (308ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6_resize/disk /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CMD "cp -r /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6_resize/disk /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk" returned: 0 in 0.389s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6_resize/disk.info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk.info {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CMD "cp -r /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6_resize/disk.info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk.info" returned: 0 in 0.034s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-25278495-c30f-4dcb-8bbe-4dc5e40153e4 req-12f40dea-483b-4fe9-8808-e934035bb117 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:57:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-25278495-c30f-4dcb-8bbe-4dc5e40153e4 req-12f40dea-483b-4fe9-8808-e934035bb117 service nova] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-25278495-c30f-4dcb-8bbe-4dc5e40153e4 req-12f40dea-483b-4fe9-8808-e934035bb117 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-25278495-c30f-4dcb-8bbe-4dc5e40153e4 req-12f40dea-483b-4fe9-8808-e934035bb117 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-25278495-c30f-4dcb-8bbe-4dc5e40153e4 req-12f40dea-483b-4fe9-8808-e934035bb117 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] No waiting events found dispatching network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:57:25 user nova-compute[74692]: WARNING nova.compute.manager [req-25278495-c30f-4dcb-8bbe-4dc5e40153e4 req-12f40dea-483b-4fe9-8808-e934035bb117 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received unexpected event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 for instance with vm_state active and task_state resize_migrating.
Nov 18 18:57:25 user nova-compute[74692]: DEBUG nova.network.neutron [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Port 38f70b63-f3b8-41f4-b96a-0c87108ccd85 binding to destination host user is already ACTIVE {{(pid=74692) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 18 18:57:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquired lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG nova.network.neutron [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG nova.network.neutron [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating instance_info_cache with network_info: [{"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Releasing lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG os_brick.utils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1553a5-d292-4eb8-8a51-b789e92e0d5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9d1044-51ab-4951-a16e-a2379c2b381d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cff1210-9b85-40f9-81a2-c8d258ca9d24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a015ede9-2d5b-457c-8e77-5b82eb97895d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:57:26 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:57:26 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0014d901-e331-4031-8e27-f6445fb32c7b]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:57:26 user nova-compute[74692]: DEBUG os_brick.utils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:57:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:57:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:28 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:57:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:57:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:57:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:31 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:57:31 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:57:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8684MB free_disk=24.939064025878906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:57:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Applying migration context for instance 5946a617-f567-4ab6-a2db-29c2c86544a6 as it has an incoming, in-progress migration 13d93431-8763-4a16-ba33-1925640be89e. Migration status is post-migrating {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 18 18:57:31 user nova-compute[74692]: INFO nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating resource usage from migration 13d93431-8763-4a16-ba33-1925640be89e
Nov 18 18:57:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5d266a05-1f0a-4ac3-85ce-7321cdcef63b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:57:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 65e6ca14-de51-49e0-a417-87a72ee1fe42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:57:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance c6218f0d-b00a-4c3e-aacb-c7b96edfa801 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:57:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Migration 13d93431-8763-4a16-ba33-1925640be89e is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 18 18:57:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5946a617-f567-4ab6-a2db-29c2c86544a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:57:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:57:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=24GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:57:31 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:57:31 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:57:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:57:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.396s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Starting finish_migration {{(pid=74692) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Instance directory exists: not creating {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 18:57:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Creating image(s)
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk. size=21474836480 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk 21474836480 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk 21474836480" returned: 0 in 0.144s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Ensure instance console log exists: /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Start _get_guest_xml network_info=[{"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2140056775-network", "vif_mac": "fa:16:3e:44:c1:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGlOzbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5946a617-f567-4ab6-a2db-29c2c86544a6', 'attached_at': '2023-11-18T18:57:32.000000', 'detached_at': '', 'volume_id': 'd6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 'serial': 'd6e9e32f-0bbb-4b9f-9850-cedc8bd47823'}, 'attachment_id': '82af6a0e-0ad8-417c-b749-cb13a11740dd', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:57:32 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:57:32 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGlOzbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:57:32 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:57:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:57:32 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:57:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:57:32 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[327db953-6bdb-4881-9ab9-9bda33ee6d87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:57:32 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[01860676-72b0-47d3-8d05-f3f869744b6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823] added
Nov 18 18:57:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea6b88f-283a-4741-b17c-254c6db9a1b8]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d670a01-4e7a-4cec-8eeb-0f37be8e183b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGlOzbLd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGlOzbLd" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d26a07-83f0-47e0-9593-350ec6c7c2b8]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oGlOzbLd'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8993f1b-a0a5-4496-a1ab-1cdaf22ddd5b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbdccdc-9655-4cf8-8ee6-b978c7881285]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:57:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:57:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:57:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f624c24e-97d4-46bd-96ef-179ec1de1358]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260]
Nov 18 18:57:33 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260] successful.
Nov 18 18:57:33 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd959e78-c742-4e6c-9767-d2def66a839a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e493011-d6ec-4dcb-bdf6-4b6cf4326b04]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:57:33 user nova-compute[74692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:57:33 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:57:33 user nova-compute[74692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:57:33 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e44c01-8560-428f-b24f-77ce33275ce2]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGlOzbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:57:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26230343935623263', 'path': '/dev/sdc'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230343935623263', 'path': '/dev/sdc'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-675233857',display_name='tempest-ServerActionsTestOtherB-server-675233857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-675233857',id=37,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ44427Z/m0lH604ZCZCT3wxxkPLCJECR2dRCAhCy9jp32w/HG5k9bXDcxq0dLrD4N0NbsbYxgMfyC4dHsM3g1rzNAEweUIJRjnGxWc9qXCJAk0Y2gFT55F56wQDpzJ2w==',key_name='tempest-keypair-1851665456',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:53:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e622388d2bbe41a0ba6a5fb42c494a96',ramdisk_id='',reservation_id='r-y4r329pm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-461353456',owner_user_name='tempest-ServerActionsTestOtherB-461353456-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e28b31fb4e1b45fdae81ac6c9d512c95',uuid=5946a617-f567-4ab6-a2db-29c2c86544a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2140056775-network", "vif_mac": "fa:16:3e:44:c1:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converting VIF {"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2140056775-network", "vif_mac": "fa:16:3e:44:c1:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:57:34 user nova-compute[74692]:   <uuid>5946a617-f567-4ab6-a2db-29c2c86544a6</uuid>
Nov 18 18:57:34 user nova-compute[74692]:   <name>instance-00000025</name>
Nov 18 18:57:34 user nova-compute[74692]:   <memory>2097152</memory>
Nov 18 18:57:34 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:57:34 user nova-compute[74692]:   <metadata>
Nov 18 18:57:34 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:57:34 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:57:34 user nova-compute[74692]:       <nova:name>tempest-ServerActionsTestOtherB-server-675233857</nova:name>
Nov 18 18:57:34 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:57:32</nova:creationTime>
Nov 18 18:57:34 user nova-compute[74692]:       <nova:flavor name="m1.small">
Nov 18 18:57:34 user nova-compute[74692]:         <nova:memory>2048</nova:memory>
Nov 18 18:57:34 user nova-compute[74692]:         <nova:disk>20</nova:disk>
Nov 18 18:57:34 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:57:34 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:57:34 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:57:34 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:57:34 user nova-compute[74692]:       <nova:owner>
Nov 18 18:57:34 user nova-compute[74692]:         <nova:user uuid="e28b31fb4e1b45fdae81ac6c9d512c95">tempest-ServerActionsTestOtherB-461353456-project-member</nova:user>
Nov 18 18:57:34 user nova-compute[74692]:         <nova:project uuid="e622388d2bbe41a0ba6a5fb42c494a96">tempest-ServerActionsTestOtherB-461353456</nova:project>
Nov 18 18:57:34 user nova-compute[74692]:       </nova:owner>
Nov 18 18:57:34 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:57:34 user nova-compute[74692]:       <nova:ports>
Nov 18 18:57:34 user nova-compute[74692]:         <nova:port uuid="38f70b63-f3b8-41f4-b96a-0c87108ccd85">
Nov 18 18:57:34 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 18:57:34 user nova-compute[74692]:         </nova:port>
Nov 18 18:57:34 user nova-compute[74692]:       </nova:ports>
Nov 18 18:57:34 user nova-compute[74692]:     </nova:instance>
Nov 18 18:57:34 user nova-compute[74692]:   </metadata>
Nov 18 18:57:34 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:57:34 user nova-compute[74692]:     <system>
Nov 18 18:57:34 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:57:34 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:57:34 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:57:34 user nova-compute[74692]:       <entry name="serial">5946a617-f567-4ab6-a2db-29c2c86544a6</entry>
Nov 18 18:57:34 user nova-compute[74692]:       <entry name="uuid">5946a617-f567-4ab6-a2db-29c2c86544a6</entry>
Nov 18 18:57:34 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:57:34 user nova-compute[74692]:     </system>
Nov 18 18:57:34 user nova-compute[74692]:   </sysinfo>
Nov 18 18:57:34 user nova-compute[74692]:   <os>
Nov 18 18:57:34 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:57:34 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:57:34 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:57:34 user nova-compute[74692]:   </os>
Nov 18 18:57:34 user nova-compute[74692]:   <features>
Nov 18 18:57:34 user nova-compute[74692]:     <acpi/>
Nov 18 18:57:34 user nova-compute[74692]:     <apic/>
Nov 18 18:57:34 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:57:34 user nova-compute[74692]:   </features>
Nov 18 18:57:34 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:57:34 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:57:34 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:57:34 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:57:34 user nova-compute[74692]:   </clock>
Nov 18 18:57:34 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:57:34 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:57:34 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:57:34 user nova-compute[74692]:   </cpu>
Nov 18 18:57:34 user nova-compute[74692]:   <devices>
Nov 18 18:57:34 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:57:34 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:57:34 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk"/>
Nov 18 18:57:34 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:57:34 user nova-compute[74692]:     </disk>
Nov 18 18:57:34 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:57:34 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:57:34 user nova-compute[74692]:       <source dev="/dev/sdc"/>
Nov 18 18:57:34 user nova-compute[74692]:       <target dev="vdb" bus="virtio"/>
Nov 18 18:57:34 user nova-compute[74692]:       <serial>d6e9e32f-0bbb-4b9f-9850-cedc8bd47823</serial>
Nov 18 18:57:34 user nova-compute[74692]:     </disk>
Nov 18 18:57:34 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:57:34 user nova-compute[74692]:       <mac address="fa:16:3e:44:c1:a3"/>
Nov 18 18:57:34 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:57:34 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:57:34 user nova-compute[74692]:       <target dev="tap38f70b63-f3"/>
Nov 18 18:57:34 user nova-compute[74692]:     </interface>
Nov 18 18:57:34 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:57:34 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/console.log" append="off"/>
Nov 18 18:57:34 user nova-compute[74692]:     </serial>
Nov 18 18:57:34 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:57:34 user nova-compute[74692]:     <video>
Nov 18 18:57:34 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:57:34 user nova-compute[74692]:     </video>
Nov 18 18:57:34 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:57:34 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:57:34 user nova-compute[74692]:     </rng>
Nov 18 18:57:34 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:57:34 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:57:34 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:57:34 user nova-compute[74692]:     </memballoon>
Nov 18 18:57:34 user nova-compute[74692]:   </devices>
Nov 18 18:57:34 user nova-compute[74692]: </domain>
Nov 18 18:57:34 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-675233857',display_name='tempest-ServerActionsTestOtherB-server-675233857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-675233857',id=37,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ44427Z/m0lH604ZCZCT3wxxkPLCJECR2dRCAhCy9jp32w/HG5k9bXDcxq0dLrD4N0NbsbYxgMfyC4dHsM3g1rzNAEweUIJRjnGxWc9qXCJAk0Y2gFT55F56wQDpzJ2w==',key_name='tempest-keypair-1851665456',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:53:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e622388d2bbe41a0ba6a5fb42c494a96',ramdisk_id='',reservation_id='r-y4r329pm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-461353456',owner_user_name='tempest-ServerActionsTestOtherB-461353456-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e28b31fb4e1b45fdae81ac6c9d512c95',uuid=5946a617-f567-4ab6-a2db-29c2c86544a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2140056775-network", "vif_mac": "fa:16:3e:44:c1:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converting VIF {"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2140056775-network", "vif_mac": "fa:16:3e:44:c1:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG os_vif [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ba9151d-437d-52bb-a4f7-0c1c72e5c2ff', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38f70b63-f3, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38f70b63-f3, col_values=(('qos', UUID('7900b61e-ff91-4da6-b0c0-165b9ac0194d')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38f70b63-f3, col_values=(('external_ids', {'iface-id': '38f70b63-f3b8-41f4-b96a-0c87108ccd85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:c1:a3', 'vm-uuid': '5946a617-f567-4ab6-a2db-29c2c86544a6'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:34 user nova-compute[74692]: INFO os_vif [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3')
Nov 18 18:57:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] No VIF found with MAC fa:16:3e:44:c1:a3, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:57:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:35 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:57:35 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:57:35 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:57:35 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:57:35 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:57:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-231487fa-8c8d-473e-9e74-0fbe10464817 req-1a35d7d7-4b6c-4e90-922c-21c73c9eff9b service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:57:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-231487fa-8c8d-473e-9e74-0fbe10464817 req-1a35d7d7-4b6c-4e90-922c-21c73c9eff9b service nova] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-231487fa-8c8d-473e-9e74-0fbe10464817 req-1a35d7d7-4b6c-4e90-922c-21c73c9eff9b service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-231487fa-8c8d-473e-9e74-0fbe10464817 req-1a35d7d7-4b6c-4e90-922c-21c73c9eff9b service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-231487fa-8c8d-473e-9e74-0fbe10464817 req-1a35d7d7-4b6c-4e90-922c-21c73c9eff9b service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] No waiting events found dispatching network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:57:35 user nova-compute[74692]: WARNING nova.compute.manager [req-231487fa-8c8d-473e-9e74-0fbe10464817 req-1a35d7d7-4b6c-4e90-922c-21c73c9eff9b service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received unexpected event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 for instance with vm_state active and task_state resize_finish.
Nov 18 18:57:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:36 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:57:37 user nova-compute[74692]: DEBUG nova.compute.manager [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:57:37 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Instance running successfully.
Nov 18 18:57:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Failed to set time: agent not configured {{(pid=74692) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 18 18:57:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-20d84b64-60b8-47d8-a7da-2f0cadb95e07 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] finish_migration finished successfully. {{(pid=74692) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 18 18:57:37 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:57:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-69f187e1-2fb5-4cf7-892d-1b1dc826d464 req-e02177b0-c0e5-4544-a46f-9c0166e40a51 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:57:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-69f187e1-2fb5-4cf7-892d-1b1dc826d464 req-e02177b0-c0e5-4544-a46f-9c0166e40a51 service nova] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-69f187e1-2fb5-4cf7-892d-1b1dc826d464 req-e02177b0-c0e5-4544-a46f-9c0166e40a51 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-69f187e1-2fb5-4cf7-892d-1b1dc826d464 req-e02177b0-c0e5-4544-a46f-9c0166e40a51 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:38 user nova-compute[74692]: DEBUG nova.compute.manager [req-69f187e1-2fb5-4cf7-892d-1b1dc826d464 req-e02177b0-c0e5-4544-a46f-9c0166e40a51 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] No waiting events found dispatching network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:57:38 user nova-compute[74692]: WARNING nova.compute.manager [req-69f187e1-2fb5-4cf7-892d-1b1dc826d464 req-e02177b0-c0e5-4544-a46f-9c0166e40a51 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received unexpected event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 for instance with vm_state resized and task_state None.
Nov 18 18:57:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:38 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:57:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:57:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Didn't find any instances for network info cache update. {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 18:57:40 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:57:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:41 user nova-compute[74692]: DEBUG nova.objects.instance [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lazy-loading 'flavor' on Instance uuid 65e6ca14-de51-49e0-a417-87a72ee1fe42 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:57:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:41 user nova-compute[74692]: INFO nova.compute.manager [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Attaching volume dfbf873d-b3ad-4b49-9966-cc0bb55ae755 to /dev/vdb
Nov 18 18:57:41 user nova-compute[74692]: DEBUG os_brick.utils [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:57:41 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:41 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:41 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[241ad993-db24-4129-a9f7-048c7832dbe2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:41 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98ad73a-7723-4988-b720-faacb4caecd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdfa2c2-b19a-4ab8-ab21-98420cc924c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa7dc25-6b98-4b94-bbe7-889ba4fab869]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:57:42 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:57:42 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b471b8a6-cd04-4b0a-98aa-a04a82dc03fa]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG os_brick.utils [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:57:42 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updating existing volume attachment record: 11df4512-e8f4-48bb-b04d-a76810928cc6 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:57:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fVSWaUjn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:57:47 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:57:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:57:47 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:57:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:57:47 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:57:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23068d5-d408-4c76-8f65-540cda78ca79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:57:47 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[662ca86d-80b7-46e6-b2ac-753b3c4cc6f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755] added
Nov 18 18:57:47 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97afe2d-3de9-4759-8690-918705ace68b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1ef26f-6c9e-458a-9b48-747e30f028dd]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fVSWaUjn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fVSWaUjn" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f35f5ef-e124-4b1e-b67f-154e4c3822ff]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fVSWaUjn'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f4cdb9-4223-445d-b851-104414d0eff8]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c796d106-b09c-40d0-ab31-a7ad57d06f8a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:57:48 user nova-compute[74692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:57:48 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:57:48 user nova-compute[74692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:57:48 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a171cda2-a3ce-4e83-878b-171e164422b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755, portal: 172.16.0.220,3260]
Nov 18 18:57:48 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755, portal: 172.16.0.220,3260] successful.
Nov 18 18:57:48 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bd4bfc-39b9-4ea3-8f5b-afa5853aa809]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b0ffa3-8dab-448a-ae4d-a0eb45724162]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:57:48 user nova-compute[74692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:57:48 user nova-compute[74692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:57:48 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:57:48 user nova-compute[74692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:57:48 user nova-compute[74692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:57:48 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[056ab610-f056-4d07-ae0b-dff612365ea7]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:57:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fVSWaUjn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23730353564636138', 'path': '/dev/sdd'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730353564636138', 'path': '/dev/sdd'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG nova.objects.instance [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lazy-loading 'flavor' on Instance uuid 65e6ca14-de51-49e0-a417-87a72ee1fe42 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 18:57:49 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:57:49 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:57:49 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:57:49 user nova-compute[74692]:   <serial>dfbf873d-b3ad-4b49-9966-cc0bb55ae755</serial>
Nov 18 18:57:49 user nova-compute[74692]: </disk>
Nov 18 18:57:49 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG nova.compute.manager [req-8c450f5a-9d64-4b82-8901-e69700f43aa8 req-bdec2294-deef-4619-af4e-f99a2e021293 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Received event network-changed-2692ca07-2b27-4c37-b77a-001eb608e76c {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG nova.compute.manager [req-8c450f5a-9d64-4b82-8901-e69700f43aa8 req-bdec2294-deef-4619-af4e-f99a2e021293 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Refreshing instance network info cache due to event network-changed-2692ca07-2b27-4c37-b77a-001eb608e76c. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8c450f5a-9d64-4b82-8901-e69700f43aa8 req-bdec2294-deef-4619-af4e-f99a2e021293 service nova] Acquiring lock "refresh_cache-c6218f0d-b00a-4c3e-aacb-c7b96edfa801" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8c450f5a-9d64-4b82-8901-e69700f43aa8 req-bdec2294-deef-4619-af4e-f99a2e021293 service nova] Acquired lock "refresh_cache-c6218f0d-b00a-4c3e-aacb-c7b96edfa801" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG nova.network.neutron [req-8c450f5a-9d64-4b82-8901-e69700f43aa8 req-bdec2294-deef-4619-af4e-f99a2e021293 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Refreshing network info cache for port 2692ca07-2b27-4c37-b77a-001eb608e76c {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] No VIF found with MAC fa:16:3e:b0:51:1b, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:57:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-21740df6-9d76-4d8c-845c-e2c3c69b0b8c tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.963s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:50 user nova-compute[74692]: INFO nova.compute.manager [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Terminating instance
Nov 18 18:57:50 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG nova.network.neutron [req-8c450f5a-9d64-4b82-8901-e69700f43aa8 req-bdec2294-deef-4619-af4e-f99a2e021293 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Updated VIF entry in instance network info cache for port 2692ca07-2b27-4c37-b77a-001eb608e76c. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG nova.network.neutron [req-8c450f5a-9d64-4b82-8901-e69700f43aa8 req-bdec2294-deef-4619-af4e-f99a2e021293 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Updating instance_info_cache with network_info: [{"id": "2692ca07-2b27-4c37-b77a-001eb608e76c", "address": "fa:16:3e:d6:e9:77", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2692ca07-2b", "ovs_interfaceid": "2692ca07-2b27-4c37-b77a-001eb608e76c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8c450f5a-9d64-4b82-8901-e69700f43aa8 req-bdec2294-deef-4619-af4e-f99a2e021293 service nova] Releasing lock "refresh_cache-c6218f0d-b00a-4c3e-aacb-c7b96edfa801" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-d71b4673-dd72-4db0-b105-2eedf5b073eb req-6ea0f9e5-cc64-405d-aac5-5f773cd35d35 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Received event network-vif-unplugged-2692ca07-2b27-4c37-b77a-001eb608e76c {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d71b4673-dd72-4db0-b105-2eedf5b073eb req-6ea0f9e5-cc64-405d-aac5-5f773cd35d35 service nova] Acquiring lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d71b4673-dd72-4db0-b105-2eedf5b073eb req-6ea0f9e5-cc64-405d-aac5-5f773cd35d35 service nova] Lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d71b4673-dd72-4db0-b105-2eedf5b073eb req-6ea0f9e5-cc64-405d-aac5-5f773cd35d35 service nova] Lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-d71b4673-dd72-4db0-b105-2eedf5b073eb req-6ea0f9e5-cc64-405d-aac5-5f773cd35d35 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] No waiting events found dispatching network-vif-unplugged-2692ca07-2b27-4c37-b77a-001eb608e76c {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-d71b4673-dd72-4db0-b105-2eedf5b073eb req-6ea0f9e5-cc64-405d-aac5-5f773cd35d35 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Received event network-vif-unplugged-2692ca07-2b27-4c37-b77a-001eb608e76c for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Instance destroyed successfully.
Nov 18 18:57:50 user nova-compute[74692]: DEBUG nova.objects.instance [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'resources' on Instance uuid c6218f0d-b00a-4c3e-aacb-c7b96edfa801 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1391057047',display_name='tempest-AttachVolumeNegativeTest-server-1391057047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1391057047',id=41,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpc3sJMD0EvQTn798yq+AlNsWdIEVW7cH/Y9lcvIhy06W6X9LQqL7ywhBL52lQf6q7GWINkllcjhNCOAOHJr1LQa8KqmUWW2P590sfup4vaE6Ibxv1LGGX/RKy6g0pnqQ==',key_name='tempest-keypair-280583975',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:56:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7475e741034a4302b0ab193f1b6c67d2',ramdisk_id='',reservation_id='r-atwks5zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-542263902',owner_user_name='tempest-AttachVolumeNegativeTest-542263902-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:56:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='def7f7c9ff4f4a29a840ace22d509755',uuid=c6218f0d-b00a-4c3e-aacb-c7b96edfa801,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2692ca07-2b27-4c37-b77a-001eb608e76c", "address": "fa:16:3e:d6:e9:77", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2692ca07-2b", "ovs_interfaceid": "2692ca07-2b27-4c37-b77a-001eb608e76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converting VIF {"id": "2692ca07-2b27-4c37-b77a-001eb608e76c", "address": "fa:16:3e:d6:e9:77", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2692ca07-2b", "ovs_interfaceid": "2692ca07-2b27-4c37-b77a-001eb608e76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e9:77,bridge_name='br-int',has_traffic_filtering=True,id=2692ca07-2b27-4c37-b77a-001eb608e76c,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2692ca07-2b') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG os_vif [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e9:77,bridge_name='br-int',has_traffic_filtering=True,id=2692ca07-2b27-4c37-b77a-001eb608e76c,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2692ca07-2b') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2692ca07-2b, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b639425-f136-4f5d-a536-b348cba48ddc) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:50 user nova-compute[74692]: INFO os_vif [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e9:77,bridge_name='br-int',has_traffic_filtering=True,id=2692ca07-2b27-4c37-b77a-001eb608e76c,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2692ca07-2b')
Nov 18 18:57:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Deleting instance files /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801_del
Nov 18 18:57:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Deletion of /opt/stack/data/nova/instances/c6218f0d-b00a-4c3e-aacb-c7b96edfa801_del complete
Nov 18 18:57:50 user nova-compute[74692]: INFO nova.compute.manager [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 18 18:57:50 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:57:50 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:57:51 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:57:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-0d8a658c-ca78-4c3b-a1d0-ef2c40dd827c req-a4de0fb2-70eb-4525-a481-4e5fe29e531f service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Received event network-vif-deleted-2692ca07-2b27-4c37-b77a-001eb608e76c {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:57:51 user nova-compute[74692]: INFO nova.compute.manager [req-0d8a658c-ca78-4c3b-a1d0-ef2c40dd827c req-a4de0fb2-70eb-4525-a481-4e5fe29e531f service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Neutron deleted interface 2692ca07-2b27-4c37-b77a-001eb608e76c; detaching it from the instance and deleting it from the info cache
Nov 18 18:57:51 user nova-compute[74692]: DEBUG nova.network.neutron [req-0d8a658c-ca78-4c3b-a1d0-ef2c40dd827c req-a4de0fb2-70eb-4525-a481-4e5fe29e531f service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:57:51 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Took 0.76 seconds to deallocate network for instance.
Nov 18 18:57:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-0d8a658c-ca78-4c3b-a1d0-ef2c40dd827c req-a4de0fb2-70eb-4525-a481-4e5fe29e531f service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Detach interface failed, port_id=2692ca07-2b27-4c37-b77a-001eb608e76c, reason: Instance c6218f0d-b00a-4c3e-aacb-c7b96edfa801 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:57:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:51 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:57:52 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:57:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:52 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Deleted allocations for instance c6218f0d-b00a-4c3e-aacb-c7b96edfa801
Nov 18 18:57:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0d319701-9227-4a06-9be7-01ba2118884c tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.176s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-60d6fc81-38d8-4c83-93ed-cd5f3cd801af req-91408823-4eef-40bc-b127-9e23f2bd1c54 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Received event network-vif-plugged-2692ca07-2b27-4c37-b77a-001eb608e76c {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:57:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-60d6fc81-38d8-4c83-93ed-cd5f3cd801af req-91408823-4eef-40bc-b127-9e23f2bd1c54 service nova] Acquiring lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-60d6fc81-38d8-4c83-93ed-cd5f3cd801af req-91408823-4eef-40bc-b127-9e23f2bd1c54 service nova] Lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-60d6fc81-38d8-4c83-93ed-cd5f3cd801af req-91408823-4eef-40bc-b127-9e23f2bd1c54 service nova] Lock "c6218f0d-b00a-4c3e-aacb-c7b96edfa801-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-60d6fc81-38d8-4c83-93ed-cd5f3cd801af req-91408823-4eef-40bc-b127-9e23f2bd1c54 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] No waiting events found dispatching network-vif-plugged-2692ca07-2b27-4c37-b77a-001eb608e76c {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:57:52 user nova-compute[74692]: WARNING nova.compute.manager [req-60d6fc81-38d8-4c83-93ed-cd5f3cd801af req-91408823-4eef-40bc-b127-9e23f2bd1c54 service nova] [instance: c6218f0d-b00a-4c3e-aacb-c7b96edfa801] Received unexpected event network-vif-plugged-2692ca07-2b27-4c37-b77a-001eb608e76c for instance with vm_state deleted and task_state None.
Nov 18 18:57:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:54 user nova-compute[74692]: DEBUG nova.compute.manager [req-eb3ddf91-1f3b-405e-a965-5de42f6aa508 req-11394f24-97eb-46bc-bbe1-090fab1f57ab service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received event network-changed-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:57:54 user nova-compute[74692]: DEBUG nova.compute.manager [req-eb3ddf91-1f3b-405e-a965-5de42f6aa508 req-11394f24-97eb-46bc-bbe1-090fab1f57ab service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Refreshing instance network info cache due to event network-changed-23428c32-45a0-44bb-bf79-3ea64636d40f. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:57:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eb3ddf91-1f3b-405e-a965-5de42f6aa508 req-11394f24-97eb-46bc-bbe1-090fab1f57ab service nova] Acquiring lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:57:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eb3ddf91-1f3b-405e-a965-5de42f6aa508 req-11394f24-97eb-46bc-bbe1-090fab1f57ab service nova] Acquired lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:57:54 user nova-compute[74692]: DEBUG nova.network.neutron [req-eb3ddf91-1f3b-405e-a965-5de42f6aa508 req-11394f24-97eb-46bc-bbe1-090fab1f57ab service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Refreshing network info cache for port 23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:57:55 user nova-compute[74692]: DEBUG nova.network.neutron [req-eb3ddf91-1f3b-405e-a965-5de42f6aa508 req-11394f24-97eb-46bc-bbe1-090fab1f57ab service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updated VIF entry in instance network info cache for port 23428c32-45a0-44bb-bf79-3ea64636d40f. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:57:55 user nova-compute[74692]: DEBUG nova.network.neutron [req-eb3ddf91-1f3b-405e-a965-5de42f6aa508 req-11394f24-97eb-46bc-bbe1-090fab1f57ab service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updating instance_info_cache with network_info: [{"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:57:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eb3ddf91-1f3b-405e-a965-5de42f6aa508 req-11394f24-97eb-46bc-bbe1-090fab1f57ab service nova] Releasing lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:57:55 user nova-compute[74692]: DEBUG nova.compute.manager [req-c6d32fb3-ee75-4430-99cf-81369dbc24c5 req-570a431a-8d4e-489b-964c-af73ba112327 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received event network-changed-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:57:55 user nova-compute[74692]: DEBUG nova.compute.manager [req-c6d32fb3-ee75-4430-99cf-81369dbc24c5 req-570a431a-8d4e-489b-964c-af73ba112327 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Refreshing instance network info cache due to event network-changed-23428c32-45a0-44bb-bf79-3ea64636d40f. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:57:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c6d32fb3-ee75-4430-99cf-81369dbc24c5 req-570a431a-8d4e-489b-964c-af73ba112327 service nova] Acquiring lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:57:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c6d32fb3-ee75-4430-99cf-81369dbc24c5 req-570a431a-8d4e-489b-964c-af73ba112327 service nova] Acquired lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:57:55 user nova-compute[74692]: DEBUG nova.network.neutron [req-c6d32fb3-ee75-4430-99cf-81369dbc24c5 req-570a431a-8d4e-489b-964c-af73ba112327 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Refreshing network info cache for port 23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:57:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1942f9-ceb4-400e-9d55-516796a6c8c7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1942f9-ceb4-400e-9d55-516796a6c8c7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:55 user nova-compute[74692]: INFO nova.compute.manager [None req-6f1942f9-ceb4-400e-9d55-516796a6c8c7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Rebooting instance
Nov 18 18:57:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1942f9-ceb4-400e-9d55-516796a6c8c7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:57:56 user nova-compute[74692]: DEBUG nova.network.neutron [req-c6d32fb3-ee75-4430-99cf-81369dbc24c5 req-570a431a-8d4e-489b-964c-af73ba112327 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updated VIF entry in instance network info cache for port 23428c32-45a0-44bb-bf79-3ea64636d40f. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:57:56 user nova-compute[74692]: DEBUG nova.network.neutron [req-c6d32fb3-ee75-4430-99cf-81369dbc24c5 req-570a431a-8d4e-489b-964c-af73ba112327 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updating instance_info_cache with network_info: [{"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:57:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c6d32fb3-ee75-4430-99cf-81369dbc24c5 req-570a431a-8d4e-489b-964c-af73ba112327 service nova] Releasing lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:57:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1942f9-ceb4-400e-9d55-516796a6c8c7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquired lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:57:56 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6f1942f9-ceb4-400e-9d55-516796a6c8c7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:57:56 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6f1942f9-ceb4-400e-9d55-516796a6c8c7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updating instance_info_cache with network_info: [{"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:57:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1942f9-ceb4-400e-9d55-516796a6c8c7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Releasing lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:57:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6f1942f9-ceb4-400e-9d55-516796a6c8c7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:57:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "0443297c-0d68-4dc8-b7d6-221a14475f07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "0443297c-0d68-4dc8-b7d6-221a14475f07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 18:57:59 user nova-compute[74692]: INFO nova.compute.claims [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Claim successful on node user
Nov 18 18:57:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-900970f4-c934-4892-83f3-3fce2251d355 req-3aad6147-d585-456f-83d5-e756c92aae45 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received event network-vif-unplugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-900970f4-c934-4892-83f3-3fce2251d355 req-3aad6147-d585-456f-83d5-e756c92aae45 service nova] Acquiring lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-900970f4-c934-4892-83f3-3fce2251d355 req-3aad6147-d585-456f-83d5-e756c92aae45 service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-900970f4-c934-4892-83f3-3fce2251d355 req-3aad6147-d585-456f-83d5-e756c92aae45 service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-900970f4-c934-4892-83f3-3fce2251d355 req-3aad6147-d585-456f-83d5-e756c92aae45 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] No waiting events found dispatching network-vif-unplugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:57:59 user nova-compute[74692]: WARNING nova.compute.manager [req-900970f4-c934-4892-83f3-3fce2251d355 req-3aad6147-d585-456f-83d5-e756c92aae45 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received unexpected event network-vif-unplugged-23428c32-45a0-44bb-bf79-3ea64636d40f for instance with vm_state active and task_state reboot_started.
Nov 18 18:57:59 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 18:57:59 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 18:57:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 18:57:59 user nova-compute[74692]: DEBUG nova.policy [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f58b7c308c3b4fa7bb4f576048ef7619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a60e439a714bdd8fca1ec43e2a3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 18:57:59 user nova-compute[74692]: INFO nova.virt.block_device [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Booting with volume snapshot 8b1ae394-df1a-49c7-86b8-120d658f46ef at /dev/vda
Nov 18 18:57:59 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-6f1942f9-ceb4-400e-9d55-516796a6c8c7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Instance shutdown successfully.
Nov 18 18:58:00 user nova-compute[74692]: DEBUG nova.network.neutron [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Successfully created port: 910a623c-c4dd-401e-ab7d-9b13dcca2433 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 18:58:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:00 user nova-compute[74692]: DEBUG nova.network.neutron [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Successfully updated port: 910a623c-c4dd-401e-ab7d-9b13dcca2433 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "refresh_cache-0443297c-0d68-4dc8-b7d6-221a14475f07" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquired lock "refresh_cache-0443297c-0d68-4dc8-b7d6-221a14475f07" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG nova.network.neutron [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG nova.network.neutron [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-081352a3-a0c8-4cff-88a4-47a6523f6bc3 req-f20df7c0-1a0b-4e99-8d54-6944b6bfcdca service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received event network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-081352a3-a0c8-4cff-88a4-47a6523f6bc3 req-f20df7c0-1a0b-4e99-8d54-6944b6bfcdca service nova] Acquiring lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-081352a3-a0c8-4cff-88a4-47a6523f6bc3 req-f20df7c0-1a0b-4e99-8d54-6944b6bfcdca service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-081352a3-a0c8-4cff-88a4-47a6523f6bc3 req-f20df7c0-1a0b-4e99-8d54-6944b6bfcdca service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-081352a3-a0c8-4cff-88a4-47a6523f6bc3 req-f20df7c0-1a0b-4e99-8d54-6944b6bfcdca service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] No waiting events found dispatching network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:58:01 user nova-compute[74692]: WARNING nova.compute.manager [req-081352a3-a0c8-4cff-88a4-47a6523f6bc3 req-f20df7c0-1a0b-4e99-8d54-6944b6bfcdca service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received unexpected event network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f for instance with vm_state active and task_state reboot_started.
Nov 18 18:58:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-081352a3-a0c8-4cff-88a4-47a6523f6bc3 req-f20df7c0-1a0b-4e99-8d54-6944b6bfcdca service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Received event network-changed-910a623c-c4dd-401e-ab7d-9b13dcca2433 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-081352a3-a0c8-4cff-88a4-47a6523f6bc3 req-f20df7c0-1a0b-4e99-8d54-6944b6bfcdca service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Refreshing instance network info cache due to event network-changed-910a623c-c4dd-401e-ab7d-9b13dcca2433. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-081352a3-a0c8-4cff-88a4-47a6523f6bc3 req-f20df7c0-1a0b-4e99-8d54-6944b6bfcdca service nova] Acquiring lock "refresh_cache-0443297c-0d68-4dc8-b7d6-221a14475f07" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG nova.network.neutron [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Updating instance_info_cache with network_info: [{"id": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "address": "fa:16:3e:8a:6d:92", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910a623c-c4", "ovs_interfaceid": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Releasing lock "refresh_cache-0443297c-0d68-4dc8-b7d6-221a14475f07" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Instance network_info: |[{"id": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "address": "fa:16:3e:8a:6d:92", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910a623c-c4", "ovs_interfaceid": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-081352a3-a0c8-4cff-88a4-47a6523f6bc3 req-f20df7c0-1a0b-4e99-8d54-6944b6bfcdca service nova] Acquired lock "refresh_cache-0443297c-0d68-4dc8-b7d6-221a14475f07" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG nova.network.neutron [req-081352a3-a0c8-4cff-88a4-47a6523f6bc3 req-f20df7c0-1a0b-4e99-8d54-6944b6bfcdca service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Refreshing network info cache for port 910a623c-c4dd-401e-ab7d-9b13dcca2433 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG nova.network.neutron [req-081352a3-a0c8-4cff-88a4-47a6523f6bc3 req-f20df7c0-1a0b-4e99-8d54-6944b6bfcdca service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Updated VIF entry in instance network info cache for port 910a623c-c4dd-401e-ab7d-9b13dcca2433. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG nova.network.neutron [req-081352a3-a0c8-4cff-88a4-47a6523f6bc3 req-f20df7c0-1a0b-4e99-8d54-6944b6bfcdca service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Updating instance_info_cache with network_info: [{"id": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "address": "fa:16:3e:8a:6d:92", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910a623c-c4", "ovs_interfaceid": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:58:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-081352a3-a0c8-4cff-88a4-47a6523f6bc3 req-f20df7c0-1a0b-4e99-8d54-6944b6bfcdca service nova] Releasing lock "refresh_cache-0443297c-0d68-4dc8-b7d6-221a14475f07" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:58:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:03 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Instance running successfully.
Nov 18 18:58:03 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-6f1942f9-ceb4-400e-9d55-516796a6c8c7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Instance soft rebooted successfully.
Nov 18 18:58:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6f1942f9-ceb4-400e-9d55-516796a6c8c7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:58:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ee846d6-9235-4741-8f6b-1fa0f7f625c3 req-63187325-356c-4d9d-9010-8930604f273e service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received event network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:58:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ee846d6-9235-4741-8f6b-1fa0f7f625c3 req-63187325-356c-4d9d-9010-8930604f273e service nova] Acquiring lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:58:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ee846d6-9235-4741-8f6b-1fa0f7f625c3 req-63187325-356c-4d9d-9010-8930604f273e service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:58:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ee846d6-9235-4741-8f6b-1fa0f7f625c3 req-63187325-356c-4d9d-9010-8930604f273e service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:58:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ee846d6-9235-4741-8f6b-1fa0f7f625c3 req-63187325-356c-4d9d-9010-8930604f273e service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] No waiting events found dispatching network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:58:03 user nova-compute[74692]: WARNING nova.compute.manager [req-7ee846d6-9235-4741-8f6b-1fa0f7f625c3 req-63187325-356c-4d9d-9010-8930604f273e service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received unexpected event network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f for instance with vm_state active and task_state reboot_started.
Nov 18 18:58:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ee846d6-9235-4741-8f6b-1fa0f7f625c3 req-63187325-356c-4d9d-9010-8930604f273e service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received event network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:58:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ee846d6-9235-4741-8f6b-1fa0f7f625c3 req-63187325-356c-4d9d-9010-8930604f273e service nova] Acquiring lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:58:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ee846d6-9235-4741-8f6b-1fa0f7f625c3 req-63187325-356c-4d9d-9010-8930604f273e service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:58:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ee846d6-9235-4741-8f6b-1fa0f7f625c3 req-63187325-356c-4d9d-9010-8930604f273e service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:58:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ee846d6-9235-4741-8f6b-1fa0f7f625c3 req-63187325-356c-4d9d-9010-8930604f273e service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] No waiting events found dispatching network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:58:03 user nova-compute[74692]: WARNING nova.compute.manager [req-7ee846d6-9235-4741-8f6b-1fa0f7f625c3 req-63187325-356c-4d9d-9010-8930604f273e service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received unexpected event network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f for instance with vm_state active and task_state reboot_started.
Nov 18 18:58:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1942f9-ceb4-400e-9d55-516796a6c8c7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.675s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG os_brick.utils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dbeeec-f2ad-4e43-87c5-13fc0f223f20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8034c0-8404-4364-a119-803a8c3959de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[91385c51-7cf9-4bcd-8ec3-be2499214901]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f71554-d24f-4d27-a524-3eb203e43ebe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:58:05 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:58:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce9b62a-678f-4818-9d44-b65edace2ef9]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG os_brick.utils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Updating existing volume attachment record: 444ea4b1-47db-4cab-afda-0a1ef2847d9f {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 18:58:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.compute.manager [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 18:58:11 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Creating image(s)
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Ensure instance console log exists: /opt/stack/data/nova/instances/0443297c-0d68-4dc8-b7d6-221a14475f07/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Start _get_guest_xml network_info=[{"id": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "address": "fa:16:3e:8a:6d:92", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910a623c-c4", "ovs_interfaceid": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eptaYUPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0443297c-0d68-4dc8-b7d6-221a14475f07', 'attached_at': '', 'detached_at': '', 'volume_id': 'e82c2598-301b-4c9b-9634-ee51bc406da2', 'serial': 'e82c2598-301b-4c9b-9634-ee51bc406da2'}, 'attachment_id': '444ea4b1-47db-4cab-afda-0a1ef2847d9f', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:58:11 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:58:11 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eptaYUPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:58:11 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:58:11 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:58:11 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb662a9-275d-4828-a0ab-37aba6fc7504]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:58:11 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f69390-8f73-46e0-a92a-3f9578d1fc38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2] added
Nov 18 18:58:11 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8da8aa-b99a-4b32-b2b0-1aa56c0d8140]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc79c05b-9245-4559-ae25-13ea03791f20]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eptaYUPG {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eptaYUPG" returned: 0 in 0.034s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4138628-9589-41ed-a14e-56549b7440f1]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eptaYUPG'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[573e0fff-b401-4806-9670-23ed2e98cb85]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de5c279-048e-41cb-bce1-b7275d9e1430]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:58:11 user nova-compute[74692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:58:11 user nova-compute[74692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:58:11 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:58:11 user nova-compute[74692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:58:11 user nova-compute[74692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:58:11 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c612d29-8b38-47d8-a5ef-bc4b66cfefff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2, portal: 172.16.0.220,3260]
Nov 18 18:58:11 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2, portal: 172.16.0.220,3260] successful.
Nov 18 18:58:11 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1755ed8b-ff97-43ab-8a9b-8bbc5adff63c]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e671d64-ae36-48c6-bf0a-ee4ce361b71b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:58:11 user nova-compute[74692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:58:11 user nova-compute[74692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:58:11 user nova-compute[74692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)
Nov 18 18:58:11 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:58:11 user nova-compute[74692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:58:11 user nova-compute[74692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:58:11 user nova-compute[74692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)
Nov 18 18:58:11 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] HCTL ('36', '-', '-', 0) found on session 52 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3923431f-4fa0-4463-b3b4-79972ce4564e]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching for a device in session 52 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:58:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eptaYUPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23932653439346337', 'path': '/dev/sde'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932653439346337', 'path': '/dev/sde'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:57:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1597465599',display_name='tempest-TestVolumeBootPattern-server-1597465599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1597465599',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-rdz7gt6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:58:00Z,user_data=None,user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=0443297c-0d68-4dc8-b7d6-221a14475f07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "address": "fa:16:3e:8a:6d:92", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910a623c-c4", "ovs_interfaceid": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "address": "fa:16:3e:8a:6d:92", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910a623c-c4", "ovs_interfaceid": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:6d:92,bridge_name='br-int',has_traffic_filtering=True,id=910a623c-c4dd-401e-ab7d-9b13dcca2433,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910a623c-c4') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG nova.objects.instance [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lazy-loading 'pci_devices' on Instance uuid 0443297c-0d68-4dc8-b7d6-221a14475f07 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:58:12 user nova-compute[74692]:   <uuid>0443297c-0d68-4dc8-b7d6-221a14475f07</uuid>
Nov 18 18:58:12 user nova-compute[74692]:   <name>instance-0000002a</name>
Nov 18 18:58:12 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:58:12 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:58:12 user nova-compute[74692]:   <metadata>
Nov 18 18:58:12 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:58:12 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:58:12 user nova-compute[74692]:       <nova:name>tempest-TestVolumeBootPattern-server-1597465599</nova:name>
Nov 18 18:58:12 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:58:11</nova:creationTime>
Nov 18 18:58:12 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:58:12 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:58:12 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:58:12 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:58:12 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:58:12 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:58:12 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:58:12 user nova-compute[74692]:       <nova:owner>
Nov 18 18:58:12 user nova-compute[74692]:         <nova:user uuid="f58b7c308c3b4fa7bb4f576048ef7619">tempest-TestVolumeBootPattern-1940625728-project-member</nova:user>
Nov 18 18:58:12 user nova-compute[74692]:         <nova:project uuid="d3a60e439a714bdd8fca1ec43e2a3139">tempest-TestVolumeBootPattern-1940625728</nova:project>
Nov 18 18:58:12 user nova-compute[74692]:       </nova:owner>
Nov 18 18:58:12 user nova-compute[74692]:       <nova:ports>
Nov 18 18:58:12 user nova-compute[74692]:         <nova:port uuid="910a623c-c4dd-401e-ab7d-9b13dcca2433">
Nov 18 18:58:12 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 18 18:58:12 user nova-compute[74692]:         </nova:port>
Nov 18 18:58:12 user nova-compute[74692]:       </nova:ports>
Nov 18 18:58:12 user nova-compute[74692]:     </nova:instance>
Nov 18 18:58:12 user nova-compute[74692]:   </metadata>
Nov 18 18:58:12 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:58:12 user nova-compute[74692]:     <system>
Nov 18 18:58:12 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:58:12 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:58:12 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:58:12 user nova-compute[74692]:       <entry name="serial">0443297c-0d68-4dc8-b7d6-221a14475f07</entry>
Nov 18 18:58:12 user nova-compute[74692]:       <entry name="uuid">0443297c-0d68-4dc8-b7d6-221a14475f07</entry>
Nov 18 18:58:12 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:58:12 user nova-compute[74692]:     </system>
Nov 18 18:58:12 user nova-compute[74692]:   </sysinfo>
Nov 18 18:58:12 user nova-compute[74692]:   <os>
Nov 18 18:58:12 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:58:12 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:58:12 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:58:12 user nova-compute[74692]:   </os>
Nov 18 18:58:12 user nova-compute[74692]:   <features>
Nov 18 18:58:12 user nova-compute[74692]:     <acpi/>
Nov 18 18:58:12 user nova-compute[74692]:     <apic/>
Nov 18 18:58:12 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:58:12 user nova-compute[74692]:   </features>
Nov 18 18:58:12 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:58:12 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:58:12 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:58:12 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:58:12 user nova-compute[74692]:   </clock>
Nov 18 18:58:12 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:58:12 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:58:12 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:58:12 user nova-compute[74692]:   </cpu>
Nov 18 18:58:12 user nova-compute[74692]:   <devices>
Nov 18 18:58:12 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:58:12 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:58:12 user nova-compute[74692]:       <source dev="/dev/sde"/>
Nov 18 18:58:12 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:58:12 user nova-compute[74692]:       <serial>e82c2598-301b-4c9b-9634-ee51bc406da2</serial>
Nov 18 18:58:12 user nova-compute[74692]:     </disk>
Nov 18 18:58:12 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:58:12 user nova-compute[74692]:       <mac address="fa:16:3e:8a:6d:92"/>
Nov 18 18:58:12 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:58:12 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:58:12 user nova-compute[74692]:       <target dev="tap910a623c-c4"/>
Nov 18 18:58:12 user nova-compute[74692]:     </interface>
Nov 18 18:58:12 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:58:12 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/0443297c-0d68-4dc8-b7d6-221a14475f07/console.log" append="off"/>
Nov 18 18:58:12 user nova-compute[74692]:     </serial>
Nov 18 18:58:12 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:58:12 user nova-compute[74692]:     <video>
Nov 18 18:58:12 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:58:12 user nova-compute[74692]:     </video>
Nov 18 18:58:12 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:58:12 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:58:12 user nova-compute[74692]:     </rng>
Nov 18 18:58:12 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:58:12 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:58:12 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:58:12 user nova-compute[74692]:     </memballoon>
Nov 18 18:58:12 user nova-compute[74692]:   </devices>
Nov 18 18:58:12 user nova-compute[74692]: </domain>
Nov 18 18:58:12 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:57:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1597465599',display_name='tempest-TestVolumeBootPattern-server-1597465599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1597465599',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-rdz7gt6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T18:58:00Z,user_data=None,user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=0443297c-0d68-4dc8-b7d6-221a14475f07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "address": "fa:16:3e:8a:6d:92", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910a623c-c4", "ovs_interfaceid": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "address": "fa:16:3e:8a:6d:92", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910a623c-c4", "ovs_interfaceid": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:6d:92,bridge_name='br-int',has_traffic_filtering=True,id=910a623c-c4dd-401e-ab7d-9b13dcca2433,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910a623c-c4') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG os_vif [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:6d:92,bridge_name='br-int',has_traffic_filtering=True,id=910a623c-c4dd-401e-ab7d-9b13dcca2433,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910a623c-c4') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee301266-5192-56ad-98f0-b661f3031ea1', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap910a623c-c4, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap910a623c-c4, col_values=(('qos', UUID('ba456b86-1530-4e1b-9fc6-7470dcbc8ae2')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap910a623c-c4, col_values=(('external_ids', {'iface-id': '910a623c-c4dd-401e-ab7d-9b13dcca2433', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:6d:92', 'vm-uuid': '0443297c-0d68-4dc8-b7d6-221a14475f07'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:12 user nova-compute[74692]: INFO os_vif [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:6d:92,bridge_name='br-int',has_traffic_filtering=True,id=910a623c-c4dd-401e-ab7d-9b13dcca2433,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910a623c-c4')
Nov 18 18:58:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 18:58:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] No VIF found with MAC fa:16:3e:8a:6d:92, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 18:58:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-123fa9a7-52bb-420f-b246-48532136ce9d req-640e99c3-8b34-4783-b8fb-37df9d2c132d service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Received event network-vif-plugged-910a623c-c4dd-401e-ab7d-9b13dcca2433 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:58:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-123fa9a7-52bb-420f-b246-48532136ce9d req-640e99c3-8b34-4783-b8fb-37df9d2c132d service nova] Acquiring lock "0443297c-0d68-4dc8-b7d6-221a14475f07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:58:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-123fa9a7-52bb-420f-b246-48532136ce9d req-640e99c3-8b34-4783-b8fb-37df9d2c132d service nova] Lock "0443297c-0d68-4dc8-b7d6-221a14475f07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:58:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-123fa9a7-52bb-420f-b246-48532136ce9d req-640e99c3-8b34-4783-b8fb-37df9d2c132d service nova] Lock "0443297c-0d68-4dc8-b7d6-221a14475f07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:58:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-123fa9a7-52bb-420f-b246-48532136ce9d req-640e99c3-8b34-4783-b8fb-37df9d2c132d service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] No waiting events found dispatching network-vif-plugged-910a623c-c4dd-401e-ab7d-9b13dcca2433 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:58:14 user nova-compute[74692]: WARNING nova.compute.manager [req-123fa9a7-52bb-420f-b246-48532136ce9d req-640e99c3-8b34-4783-b8fb-37df9d2c132d service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Received unexpected event network-vif-plugged-910a623c-c4dd-401e-ab7d-9b13dcca2433 for instance with vm_state building and task_state spawning.
Nov 18 18:58:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:58:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 18:58:16 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Instance spawned successfully.
Nov 18 18:58:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 18:58:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:58:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:58:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:58:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:58:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:58:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 18:58:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-d4813d2a-e41f-4e09-94d6-028855621c19 req-99173539-4c34-4443-8379-03fd0cda593e service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Received event network-vif-plugged-910a623c-c4dd-401e-ab7d-9b13dcca2433 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:58:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d4813d2a-e41f-4e09-94d6-028855621c19 req-99173539-4c34-4443-8379-03fd0cda593e service nova] Acquiring lock "0443297c-0d68-4dc8-b7d6-221a14475f07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:58:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d4813d2a-e41f-4e09-94d6-028855621c19 req-99173539-4c34-4443-8379-03fd0cda593e service nova] Lock "0443297c-0d68-4dc8-b7d6-221a14475f07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:58:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d4813d2a-e41f-4e09-94d6-028855621c19 req-99173539-4c34-4443-8379-03fd0cda593e service nova] Lock "0443297c-0d68-4dc8-b7d6-221a14475f07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:58:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-d4813d2a-e41f-4e09-94d6-028855621c19 req-99173539-4c34-4443-8379-03fd0cda593e service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] No waiting events found dispatching network-vif-plugged-910a623c-c4dd-401e-ab7d-9b13dcca2433 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:58:16 user nova-compute[74692]: WARNING nova.compute.manager [req-d4813d2a-e41f-4e09-94d6-028855621c19 req-99173539-4c34-4443-8379-03fd0cda593e service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Received unexpected event network-vif-plugged-910a623c-c4dd-401e-ab7d-9b13dcca2433 for instance with vm_state building and task_state spawning.
Nov 18 18:58:16 user nova-compute[74692]: INFO nova.compute.manager [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 18 18:58:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 18:58:16 user nova-compute[74692]: INFO nova.compute.manager [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Took 17.40 seconds to build instance.
Nov 18 18:58:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-04c258eb-b822-405e-b825-2dc78a3aa9a7 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "0443297c-0d68-4dc8-b7d6-221a14475f07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.497s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:58:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:28 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:58:29 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:58:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:58:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:58:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:58:29 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:58:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:58:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:58:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:58:31 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:58:31 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:58:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8350MB free_disk=24.960952758789062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Applying migration context for instance 5946a617-f567-4ab6-a2db-29c2c86544a6 as it has an incoming, in-progress migration 13d93431-8763-4a16-ba33-1925640be89e. Migration status is finished {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 18 18:58:31 user nova-compute[74692]: INFO nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating resource usage from migration 13d93431-8763-4a16-ba33-1925640be89e
Nov 18 18:58:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5d266a05-1f0a-4ac3-85ce-7321cdcef63b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 65e6ca14-de51-49e0-a417-87a72ee1fe42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Migration 13d93431-8763-4a16-ba33-1925640be89e is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5946a617-f567-4ab6-a2db-29c2c86544a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 0443297c-0d68-4dc8-b7d6-221a14475f07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=23GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:58:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:58:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:36 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:58:36 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:58:36 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:58:36 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:58:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:58:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:37 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:58:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:38 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:58:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:58:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 18:58:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:58:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:58:39 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:58:39 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid 5946a617-f567-4ab6-a2db-29c2c86544a6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:58:39 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating instance_info_cache with network_info: [{"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:58:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:58:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:58:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:58:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:58:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:58:41 user nova-compute[74692]: INFO nova.compute.manager [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Detaching volume 5ed966a5-6ecb-4c60-a496-532d8184e33c
Nov 18 18:58:41 user nova-compute[74692]: INFO nova.virt.block_device [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Attempting to driver detach volume 5ed966a5-6ecb-4c60-a496-532d8184e33c from mountpoint /dev/vdb
Nov 18 18:58:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Attempting to detach device vdb from instance 5d266a05-1f0a-4ac3-85ce-7321cdcef63b from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:58:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:58:41 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:58:41 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 18:58:41 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:58:41 user nova-compute[74692]:   <serial>5ed966a5-6ecb-4c60-a496-532d8184e33c</serial>
Nov 18 18:58:41 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:58:41 user nova-compute[74692]: </disk>
Nov 18 18:58:41 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:58:41 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Successfully detached device vdb from instance 5d266a05-1f0a-4ac3-85ce-7321cdcef63b from the persistent domain config.
Nov 18 18:58:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d266a05-1f0a-4ac3-85ce-7321cdcef63b from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:58:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:58:41 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:58:41 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 18:58:41 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:58:41 user nova-compute[74692]:   <serial>5ed966a5-6ecb-4c60-a496-532d8184e33c</serial>
Nov 18 18:58:41 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:58:41 user nova-compute[74692]: </disk>
Nov 18 18:58:41 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:58:41 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:58:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d266a05-1f0a-4ac3-85ce-7321cdcef63b {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:58:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:58:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:02 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5d266a05-1f0a-4ac3-85ce-7321cdcef63b is timed out.
Nov 18 18:59:02 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Successfully detached device vdb from instance 5d266a05-1f0a-4ac3-85ce-7321cdcef63b from the live domain config.
Nov 18 18:59:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GOlCPZgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:59:02 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f89fd1-b424-4175-b3b0-de132ebb7265]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:59:02 user nova-compute[74692]: No targets found.
Nov 18 18:59:02 user nova-compute[74692]: iSNS:
Nov 18 18:59:02 user nova-compute[74692]: No targets found.
Nov 18 18:59:02 user nova-compute[74692]: STATIC:
Nov 18 18:59:02 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755
Nov 18 18:59:02 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:59:02 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:59:02 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c
Nov 18 18:59:02 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:59:02 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:59:02 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2
Nov 18 18:59:02 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:59:02 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:59:02 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823
Nov 18 18:59:02 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:59:02 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:59:02 user nova-compute[74692]: FIRMWARE:
Nov 18 18:59:02 user nova-compute[74692]: No targets found.
Nov 18 18:59:02 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:59:02 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:59:02 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[de96d0c2-cb95-45af-974e-06ed95e6e7e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a2e071-d79a-45d7-8043-5a0906ab0a8b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:59:02 user nova-compute[74692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:59:02 user nova-compute[74692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:59:02 user nova-compute[74692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)
Nov 18 18:59:02 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c (non-flash)
Nov 18 18:59:02 user nova-compute[74692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:59:02 user nova-compute[74692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:59:02 user nova-compute[74692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)
Nov 18 18:59:02 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a45868c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[664cc06a-0524-403e-9750-a8a51fe88e8c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8085fb4-4df8-4633-972d-4565ebedd3ec]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce166e72-bc09-407a-a2e5-f20bb0b8b258]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7627834-e1eb-4133-a766-e7d27bf9a04f]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26d1420-3f83-4377-95f3-8f77b8d5e53b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb070b79-d4b8-4e06-abcc-9a80c2a17be7]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c, portal: 172.16.0.220,3260]
Nov 18 18:59:02 user nova-compute[74692]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c, portal: 172.16.0.220,3260] successful.
Nov 18 18:59:02 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed966a5-6ecb-4c60-a496-532d8184e33c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece7c7bc-884b-4d79-ab88-d13cb498b83c]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] <== disconnect_volume: return (292ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:59:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:03 user nova-compute[74692]: DEBUG nova.objects.instance [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'flavor' on Instance uuid 5d266a05-1f0a-4ac3-85ce-7321cdcef63b {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:59:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-680dc92e-1a7a-4c4b-b891-6e72c9969086 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.730s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:59:12 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Port 38f70b63-f3b8-41f4-b96a-0c87108ccd85 binding to destination host user is already ACTIVE {{(pid=74692) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 18 18:59:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:59:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquired lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:59:12 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:59:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:59:12 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating instance_info_cache with network_info: [{"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:59:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Releasing lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Creating tmpfile /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/tmposi1meq_ to verify with other compute node that the instance is on the same shared storage. {{(pid=74692) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG nova.compute.manager [req-839f128b-a868-47f2-a79d-43ab83da477b req-36cdc5d0-9292-40b8-abba-f716ec291faa service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-vif-unplugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-839f128b-a868-47f2-a79d-43ab83da477b req-36cdc5d0-9292-40b8-abba-f716ec291faa service nova] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-839f128b-a868-47f2-a79d-43ab83da477b req-36cdc5d0-9292-40b8-abba-f716ec291faa service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-839f128b-a868-47f2-a79d-43ab83da477b req-36cdc5d0-9292-40b8-abba-f716ec291faa service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG nova.compute.manager [req-839f128b-a868-47f2-a79d-43ab83da477b req-36cdc5d0-9292-40b8-abba-f716ec291faa service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] No waiting events found dispatching network-vif-unplugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:59:13 user nova-compute[74692]: WARNING nova.compute.manager [req-839f128b-a868-47f2-a79d-43ab83da477b req-36cdc5d0-9292-40b8-abba-f716ec291faa service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received unexpected event network-vif-unplugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 for instance with vm_state resized and task_state resize_reverting.
Nov 18 18:59:13 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Instance destroyed successfully.
Nov 18 18:59:13 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lazy-loading 'resources' on Instance uuid 5946a617-f567-4ab6-a2db-29c2c86544a6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-675233857',display_name='tempest-ServerActionsTestOtherB-server-675233857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-675233857',id=37,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ44427Z/m0lH604ZCZCT3wxxkPLCJECR2dRCAhCy9jp32w/HG5k9bXDcxq0dLrD4N0NbsbYxgMfyC4dHsM3g1rzNAEweUIJRjnGxWc9qXCJAk0Y2gFT55F56wQDpzJ2w==',key_name='tempest-keypair-1851665456',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:57:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e622388d2bbe41a0ba6a5fb42c494a96',ramdisk_id='',reservation_id='r-y4r329pm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-461353456',owner_user_name='tempest-ServerActionsTestOtherB-461353456-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e28b31fb4e1b45fdae81ac6c9d512c95',uuid=5946a617-f567-4ab6-a2db-29c2c86544a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converting VIF {"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_vif [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38f70b63-f3, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7900b61e-ff91-4da6-b0c0-165b9ac0194d) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:59:13 user nova-compute[74692]: INFO os_vif [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3')
Nov 18 18:59:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGlOzbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:59:13 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87c2e4f-e9f5-4fea-ada5-60ef15bb46f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:59:13 user nova-compute[74692]: No targets found.
Nov 18 18:59:13 user nova-compute[74692]: iSNS:
Nov 18 18:59:13 user nova-compute[74692]: No targets found.
Nov 18 18:59:13 user nova-compute[74692]: STATIC:
Nov 18 18:59:13 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755
Nov 18 18:59:13 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:59:13 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:59:13 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2
Nov 18 18:59:13 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:59:13 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:59:13 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823
Nov 18 18:59:13 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:59:13 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:59:13 user nova-compute[74692]: FIRMWARE:
Nov 18 18:59:13 user nova-compute[74692]: No targets found.
Nov 18 18:59:13 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:59:13 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:59:13 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f873da5d-1089-4977-8b6c-4b8e4107d62b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab23216-9dec-449b-9089-3244d296432e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:59:13 user nova-compute[74692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:59:13 user nova-compute[74692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)
Nov 18 18:59:13 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:59:13 user nova-compute[74692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:59:13 user nova-compute[74692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)
Nov 18 18:59:13 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c46236d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823'): ({'sdc'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Removing single pathed devices sdc {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6d5b4e-83ce-47f3-87ab-4d5823082a3d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c901e92-9bd7-43ff-a355-d387ac24b699]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Flushing IO for device /dev/sdc {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2a2af0-47d8-497c-a061-f2c169949d73]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5703319d-fca4-4102-a47f-fbe302479809]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:59:13 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1119cf7-3802-4a1c-9632-7b5367acb4f7]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2dd536-3c72-46a5-ac58-9d84ec0fa3d5]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260]
Nov 18 18:59:14 user nova-compute[74692]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260] successful.
Nov 18 18:59:14 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99d9ac7-5476-4aa5-b1ea-101cfb44b267]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:59:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] <== disconnect_volume: return (294ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:59:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:59:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:15 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lazy-loading 'migration_context' on Instance uuid 5946a617-f567-4ab6-a2db-29c2c86544a6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:59:15 user nova-compute[74692]: DEBUG nova.objects.base [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Object Instance<5946a617-f567-4ab6-a2db-29c2c86544a6> lazy-loaded attributes: resources,migration_context {{(pid=74692) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 18:59:15 user nova-compute[74692]: DEBUG nova.compute.manager [req-4c2c5936-b618-42e0-b3ca-5a538254045d req-ec63cb88-a394-403c-8018-09015d897c88 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:59:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4c2c5936-b618-42e0-b3ca-5a538254045d req-ec63cb88-a394-403c-8018-09015d897c88 service nova] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4c2c5936-b618-42e0-b3ca-5a538254045d req-ec63cb88-a394-403c-8018-09015d897c88 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4c2c5936-b618-42e0-b3ca-5a538254045d req-ec63cb88-a394-403c-8018-09015d897c88 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:15 user nova-compute[74692]: DEBUG nova.compute.manager [req-4c2c5936-b618-42e0-b3ca-5a538254045d req-ec63cb88-a394-403c-8018-09015d897c88 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] No waiting events found dispatching network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:59:15 user nova-compute[74692]: WARNING nova.compute.manager [req-4c2c5936-b618-42e0-b3ca-5a538254045d req-ec63cb88-a394-403c-8018-09015d897c88 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received unexpected event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 for instance with vm_state resized and task_state resize_reverting.
Nov 18 18:59:15 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:59:15 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:59:15 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.392s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:15 user nova-compute[74692]: INFO nova.compute.manager [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Swapping old allocation on dict_keys(['582be55c-ee9f-496e-b354-5900b8401d2c']) held by migration 13d93431-8763-4a16-ba33-1925640be89e for instance
Nov 18 18:59:15 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Overwriting current allocation {'allocations': {'582be55c-ee9f-496e-b354-5900b8401d2c': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 52}}, 'project_id': 'e622388d2bbe41a0ba6a5fb42c494a96', 'user_id': 'e28b31fb4e1b45fdae81ac6c9d512c95', 'consumer_generation': 1} on consumer 5946a617-f567-4ab6-a2db-29c2c86544a6 {{(pid=74692) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquired lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating instance_info_cache with network_info: [{"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Releasing lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG os_brick.utils [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc8aec4-782d-40a8-a569-d87fdbceaee8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e540f318-1bb7-4193-ad10-92efbb138da3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7038c58e-9e80-404f-b282-1711c6ec3e0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73a04ec-9e67-4be2-96e5-0c97d20005fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 18:59:16 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 18:59:16 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bec9d97-ed82-449e-a808-e54dbc6ac04f]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 18:59:16 user nova-compute[74692]: DEBUG os_brick.utils [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:59:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Starting finish_revert_migration {{(pid=74692) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Start _get_guest_xml network_info=[{"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGlOzbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5946a617-f567-4ab6-a2db-29c2c86544a6', 'attached_at': '2023-11-18T18:59:23.000000', 'detached_at': '', 'volume_id': 'd6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 'serial': 'd6e9e32f-0bbb-4b9f-9850-cedc8bd47823'}, 'attachment_id': '32631495-cd09-4ad8-a6ee-bc9f48619676', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 18:59:23 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:59:23 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5946a617-f567-4ab6-a2db-29c2c86544a6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGlOzbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:59:23 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:59:23 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:59:23 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9796f640-8e9f-48ed-ac8b-b2c1c32fc57b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 18:59:23 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85d4c1b-2854-4204-8eb2-15ae97dbc5c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823] added
Nov 18 18:59:23 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e019c6c5-df2a-461d-b289-311374839219]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[427a5055-bc38-4f71-9ccc-5a7293ad495d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGlOzbLd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGlOzbLd" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42c44b4-2e28-4c68-bec4-c4639c386df1]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oGlOzbLd'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e2df95-a65b-4854-8b62-bd5b949d35e6]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced5ba52-85f7-4b6e-9e83-29fade1e9ffb]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:59:23 user nova-compute[74692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)
Nov 18 18:59:23 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:59:23 user nova-compute[74692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)
Nov 18 18:59:23 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1ed416-0239-48ea-a528-099e5d8e5be7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260]
Nov 18 18:59:23 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260] successful.
Nov 18 18:59:23 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d53a5d-0bf3-450c-bf38-8b3468759d67]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ab6560-627b-4c6a-a3b7-badfabc89741]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:59:23 user nova-compute[74692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)
Nov 18 18:59:23 user nova-compute[74692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:59:23 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:59:23 user nova-compute[74692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)
Nov 18 18:59:23 user nova-compute[74692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:59:23 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e15ec3-c4af-427a-a393-08367fc889f2]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:59:23 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGlOzbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26230343935623263', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230343935623263', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-675233857',display_name='tempest-ServerActionsTestOtherB-server-675233857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-675233857',id=37,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ44427Z/m0lH604ZCZCT3wxxkPLCJECR2dRCAhCy9jp32w/HG5k9bXDcxq0dLrD4N0NbsbYxgMfyC4dHsM3g1rzNAEweUIJRjnGxWc9qXCJAk0Y2gFT55F56wQDpzJ2w==',key_name='tempest-keypair-1851665456',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:57:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e622388d2bbe41a0ba6a5fb42c494a96',ramdisk_id='',reservation_id='r-y4r329pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-461353456',owner_user_name='tempest-ServerActionsTestOtherB-461353456-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e28b31fb4e1b45fdae81ac6c9d512c95',uuid=5946a617-f567-4ab6-a2db-29c2c86544a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converting VIF {"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] End _get_guest_xml xml=<domain type="kvm">
Nov 18 18:59:24 user nova-compute[74692]:   <uuid>5946a617-f567-4ab6-a2db-29c2c86544a6</uuid>
Nov 18 18:59:24 user nova-compute[74692]:   <name>instance-00000025</name>
Nov 18 18:59:24 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 18:59:24 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 18:59:24 user nova-compute[74692]:   <metadata>
Nov 18 18:59:24 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 18:59:24 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 18:59:24 user nova-compute[74692]:       <nova:name>tempest-ServerActionsTestOtherB-server-675233857</nova:name>
Nov 18 18:59:24 user nova-compute[74692]:       <nova:creationTime>2023-11-18 18:59:23</nova:creationTime>
Nov 18 18:59:24 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 18:59:24 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 18:59:24 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 18:59:24 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 18:59:24 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 18:59:24 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 18:59:24 user nova-compute[74692]:       </nova:flavor>
Nov 18 18:59:24 user nova-compute[74692]:       <nova:owner>
Nov 18 18:59:24 user nova-compute[74692]:         <nova:user uuid="e28b31fb4e1b45fdae81ac6c9d512c95">tempest-ServerActionsTestOtherB-461353456-project-member</nova:user>
Nov 18 18:59:24 user nova-compute[74692]:         <nova:project uuid="e622388d2bbe41a0ba6a5fb42c494a96">tempest-ServerActionsTestOtherB-461353456</nova:project>
Nov 18 18:59:24 user nova-compute[74692]:       </nova:owner>
Nov 18 18:59:24 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 18:59:24 user nova-compute[74692]:       <nova:ports>
Nov 18 18:59:24 user nova-compute[74692]:         <nova:port uuid="38f70b63-f3b8-41f4-b96a-0c87108ccd85">
Nov 18 18:59:24 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 18:59:24 user nova-compute[74692]:         </nova:port>
Nov 18 18:59:24 user nova-compute[74692]:       </nova:ports>
Nov 18 18:59:24 user nova-compute[74692]:     </nova:instance>
Nov 18 18:59:24 user nova-compute[74692]:   </metadata>
Nov 18 18:59:24 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 18:59:24 user nova-compute[74692]:     <system>
Nov 18 18:59:24 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 18:59:24 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 18:59:24 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 18:59:24 user nova-compute[74692]:       <entry name="serial">5946a617-f567-4ab6-a2db-29c2c86544a6</entry>
Nov 18 18:59:24 user nova-compute[74692]:       <entry name="uuid">5946a617-f567-4ab6-a2db-29c2c86544a6</entry>
Nov 18 18:59:24 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 18:59:24 user nova-compute[74692]:     </system>
Nov 18 18:59:24 user nova-compute[74692]:   </sysinfo>
Nov 18 18:59:24 user nova-compute[74692]:   <os>
Nov 18 18:59:24 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 18:59:24 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 18:59:24 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 18:59:24 user nova-compute[74692]:   </os>
Nov 18 18:59:24 user nova-compute[74692]:   <features>
Nov 18 18:59:24 user nova-compute[74692]:     <acpi/>
Nov 18 18:59:24 user nova-compute[74692]:     <apic/>
Nov 18 18:59:24 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 18:59:24 user nova-compute[74692]:   </features>
Nov 18 18:59:24 user nova-compute[74692]:   <clock offset="utc">
Nov 18 18:59:24 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 18:59:24 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 18:59:24 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 18:59:24 user nova-compute[74692]:   </clock>
Nov 18 18:59:24 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 18:59:24 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 18:59:24 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 18:59:24 user nova-compute[74692]:   </cpu>
Nov 18 18:59:24 user nova-compute[74692]:   <devices>
Nov 18 18:59:24 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 18:59:24 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 18:59:24 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk"/>
Nov 18 18:59:24 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 18:59:24 user nova-compute[74692]:     </disk>
Nov 18 18:59:24 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 18:59:24 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:59:24 user nova-compute[74692]:       <source dev="/dev/sdb"/>
Nov 18 18:59:24 user nova-compute[74692]:       <target dev="vdb" bus="virtio"/>
Nov 18 18:59:24 user nova-compute[74692]:       <serial>d6e9e32f-0bbb-4b9f-9850-cedc8bd47823</serial>
Nov 18 18:59:24 user nova-compute[74692]:     </disk>
Nov 18 18:59:24 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 18:59:24 user nova-compute[74692]:       <mac address="fa:16:3e:44:c1:a3"/>
Nov 18 18:59:24 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:59:24 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 18:59:24 user nova-compute[74692]:       <target dev="tap38f70b63-f3"/>
Nov 18 18:59:24 user nova-compute[74692]:     </interface>
Nov 18 18:59:24 user nova-compute[74692]:     <serial type="pty">
Nov 18 18:59:24 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/console.log" append="off"/>
Nov 18 18:59:24 user nova-compute[74692]:     </serial>
Nov 18 18:59:24 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 18:59:24 user nova-compute[74692]:     <video>
Nov 18 18:59:24 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 18:59:24 user nova-compute[74692]:     </video>
Nov 18 18:59:24 user nova-compute[74692]:     <rng model="virtio">
Nov 18 18:59:24 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 18:59:24 user nova-compute[74692]:     </rng>
Nov 18 18:59:24 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 18:59:24 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 18:59:24 user nova-compute[74692]:       <stats period="10"/>
Nov 18 18:59:24 user nova-compute[74692]:     </memballoon>
Nov 18 18:59:24 user nova-compute[74692]:   </devices>
Nov 18 18:59:24 user nova-compute[74692]: </domain>
Nov 18 18:59:24 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-675233857',display_name='tempest-ServerActionsTestOtherB-server-675233857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-675233857',id=37,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ44427Z/m0lH604ZCZCT3wxxkPLCJECR2dRCAhCy9jp32w/HG5k9bXDcxq0dLrD4N0NbsbYxgMfyC4dHsM3g1rzNAEweUIJRjnGxWc9qXCJAk0Y2gFT55F56wQDpzJ2w==',key_name='tempest-keypair-1851665456',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:57:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e622388d2bbe41a0ba6a5fb42c494a96',ramdisk_id='',reservation_id='r-y4r329pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-461353456',owner_user_name='tempest-ServerActionsTestOtherB-461353456-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e28b31fb4e1b45fdae81ac6c9d512c95',uuid=5946a617-f567-4ab6-a2db-29c2c86544a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converting VIF {"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG os_vif [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ba9151d-437d-52bb-a4f7-0c1c72e5c2ff', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38f70b63-f3, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38f70b63-f3, col_values=(('qos', UUID('058cf07b-0b04-4f8d-8921-1b12be8b3f2e')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38f70b63-f3, col_values=(('external_ids', {'iface-id': '38f70b63-f3b8-41f4-b96a-0c87108ccd85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:c1:a3', 'vm-uuid': '5946a617-f567-4ab6-a2db-29c2c86544a6'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:59:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:24 user nova-compute[74692]: INFO os_vif [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3')
Nov 18 18:59:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:26 user nova-compute[74692]: DEBUG nova.compute.manager [req-29b8f388-cf2f-4fb6-9d31-739ebfab2be9 req-5fd2f68f-2aea-42bb-b3e2-fa01ab12b9de service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:59:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-29b8f388-cf2f-4fb6-9d31-739ebfab2be9 req-5fd2f68f-2aea-42bb-b3e2-fa01ab12b9de service nova] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-29b8f388-cf2f-4fb6-9d31-739ebfab2be9 req-5fd2f68f-2aea-42bb-b3e2-fa01ab12b9de service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-29b8f388-cf2f-4fb6-9d31-739ebfab2be9 req-5fd2f68f-2aea-42bb-b3e2-fa01ab12b9de service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:26 user nova-compute[74692]: DEBUG nova.compute.manager [req-29b8f388-cf2f-4fb6-9d31-739ebfab2be9 req-5fd2f68f-2aea-42bb-b3e2-fa01ab12b9de service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] No waiting events found dispatching network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:59:26 user nova-compute[74692]: WARNING nova.compute.manager [req-29b8f388-cf2f-4fb6-9d31-739ebfab2be9 req-5fd2f68f-2aea-42bb-b3e2-fa01ab12b9de service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received unexpected event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 for instance with vm_state resized and task_state resize_reverting.
Nov 18 18:59:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 18:59:28 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Instance running successfully.
Nov 18 18:59:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] finish_revert_migration finished successfully. {{(pid=74692) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 18 18:59:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-5d0a3331-ae3d-41f1-8cb4-e38b937ff54c req-620cdc0d-36d3-4ab8-bead-a327647ba6d7 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:59:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5d0a3331-ae3d-41f1-8cb4-e38b937ff54c req-620cdc0d-36d3-4ab8-bead-a327647ba6d7 service nova] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5d0a3331-ae3d-41f1-8cb4-e38b937ff54c req-620cdc0d-36d3-4ab8-bead-a327647ba6d7 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5d0a3331-ae3d-41f1-8cb4-e38b937ff54c req-620cdc0d-36d3-4ab8-bead-a327647ba6d7 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-5d0a3331-ae3d-41f1-8cb4-e38b937ff54c req-620cdc0d-36d3-4ab8-bead-a327647ba6d7 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] No waiting events found dispatching network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:59:28 user nova-compute[74692]: WARNING nova.compute.manager [req-5d0a3331-ae3d-41f1-8cb4-e38b937ff54c req-620cdc0d-36d3-4ab8-bead-a327647ba6d7 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received unexpected event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 for instance with vm_state resized and task_state resize_reverting.
Nov 18 18:59:28 user nova-compute[74692]: INFO nova.compute.manager [None req-c00c5f36-be86-4781-907a-0bf5e73e8032 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating instance to original state: 'active'
Nov 18 18:59:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:31 user nova-compute[74692]: INFO nova.compute.manager [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Terminating instance
Nov 18 18:59:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:59:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:31 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:59:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:31 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-b8647192-488a-4567-946b-bce9e1f60677 req-6bcc0cd2-c01c-4512-9e65-eeef63639a14 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Received event network-vif-unplugged-b7b109d8-a218-4b24-8da2-e3a4c5087fdd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b8647192-488a-4567-946b-bce9e1f60677 req-6bcc0cd2-c01c-4512-9e65-eeef63639a14 service nova] Acquiring lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b8647192-488a-4567-946b-bce9e1f60677 req-6bcc0cd2-c01c-4512-9e65-eeef63639a14 service nova] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b8647192-488a-4567-946b-bce9e1f60677 req-6bcc0cd2-c01c-4512-9e65-eeef63639a14 service nova] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-b8647192-488a-4567-946b-bce9e1f60677 req-6bcc0cd2-c01c-4512-9e65-eeef63639a14 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] No waiting events found dispatching network-vif-unplugged-b7b109d8-a218-4b24-8da2-e3a4c5087fdd {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG nova.compute.manager [req-b8647192-488a-4567-946b-bce9e1f60677 req-6bcc0cd2-c01c-4512-9e65-eeef63639a14 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Received event network-vif-unplugged-b7b109d8-a218-4b24-8da2-e3a4c5087fdd for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:59:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Instance destroyed successfully.
Nov 18 18:59:32 user nova-compute[74692]: DEBUG nova.objects.instance [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'resources' on Instance uuid 5d266a05-1f0a-4ac3-85ce-7321cdcef63b {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:53:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-9562692',display_name='tempest-AttachVolumeNegativeTest-server-9562692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-9562692',id=38,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj4Lo6H4+2vDbsJyX/PVU5rGTywv4FiaeBYvQkEAPkqP91rqDweXfHwqso6yJxeB43N8DpQVfdbLqCPAKTlAT35itw1hacMoY2H3q0zigqFiV2zLyv42jToPwbG0QkhNw==',key_name='tempest-keypair-470326151',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7475e741034a4302b0ab193f1b6c67d2',ramdisk_id='',reservation_id='r-0cabsgk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-542263902',owner_user_name='tempest-AttachVolumeNegativeTest-542263902-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='def7f7c9ff4f4a29a840ace22d509755',uuid=5d266a05-1f0a-4ac3-85ce-7321cdcef63b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "address": "fa:16:3e:87:5b:a6", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b109d8-a2", "ovs_interfaceid": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converting VIF {"id": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "address": "fa:16:3e:87:5b:a6", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b109d8-a2", "ovs_interfaceid": "b7b109d8-a218-4b24-8da2-e3a4c5087fdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=b7b109d8-a218-4b24-8da2-e3a4c5087fdd,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b109d8-a2') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG os_vif [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=b7b109d8-a218-4b24-8da2-e3a4c5087fdd,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b109d8-a2') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7b109d8-a2, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6035dc54-69fd-432a-8d8d-7254b464cfd7) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:59:32 user nova-compute[74692]: INFO os_vif [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=b7b109d8-a218-4b24-8da2-e3a4c5087fdd,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b109d8-a2')
Nov 18 18:59:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Deleting instance files /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b_del
Nov 18 18:59:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Deletion of /opt/stack/data/nova/instances/5d266a05-1f0a-4ac3-85ce-7321cdcef63b_del complete
Nov 18 18:59:32 user nova-compute[74692]: INFO nova.compute.manager [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 18 18:59:32 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:59:32 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Error from libvirt while getting description of instance-00000026: [Error Code 42] Domain not found: no domain with matching uuid '5d266a05-1f0a-4ac3-85ce-7321cdcef63b' (instance-00000026): libvirt.libvirtError: Domain not found: no domain with matching uuid '5d266a05-1f0a-4ac3-85ce-7321cdcef63b' (instance-00000026)
Nov 18 18:59:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:59:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:33 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:59:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-c7a8840b-01b2-465c-9124-d2f27f8c0ece req-386f2ff3-09b7-4000-b633-eb67b2d47590 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Received event network-vif-deleted-b7b109d8-a218-4b24-8da2-e3a4c5087fdd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:59:33 user nova-compute[74692]: INFO nova.compute.manager [req-c7a8840b-01b2-465c-9124-d2f27f8c0ece req-386f2ff3-09b7-4000-b633-eb67b2d47590 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Neutron deleted interface b7b109d8-a218-4b24-8da2-e3a4c5087fdd; detaching it from the instance and deleting it from the info cache
Nov 18 18:59:33 user nova-compute[74692]: DEBUG nova.network.neutron [req-c7a8840b-01b2-465c-9124-d2f27f8c0ece req-386f2ff3-09b7-4000-b633-eb67b2d47590 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:59:33 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Took 0.78 seconds to deallocate network for instance.
Nov 18 18:59:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-c7a8840b-01b2-465c-9124-d2f27f8c0ece req-386f2ff3-09b7-4000-b633-eb67b2d47590 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Detach interface failed, port_id=b7b109d8-a218-4b24-8da2-e3a4c5087fdd, reason: Instance 5d266a05-1f0a-4ac3-85ce-7321cdcef63b could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 18:59:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:59:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 18:59:33 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:59:33 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 18:59:33 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8639MB free_disk=24.98752212524414GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 18:59:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.149s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:34 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Deleted allocations for instance 5d266a05-1f0a-4ac3-85ce-7321cdcef63b
Nov 18 18:59:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 65e6ca14-de51-49e0-a417-87a72ee1fe42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5946a617-f567-4ab6-a2db-29c2c86544a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 0443297c-0d68-4dc8-b7d6-221a14475f07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-cb33ced3-69b6-466f-ad6a-e25b54e8f6b4 req-908c7281-d8a7-4b81-b104-1856d88de563 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Received event network-vif-plugged-b7b109d8-a218-4b24-8da2-e3a4c5087fdd {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-cb33ced3-69b6-466f-ad6a-e25b54e8f6b4 req-908c7281-d8a7-4b81-b104-1856d88de563 service nova] Acquiring lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-cb33ced3-69b6-466f-ad6a-e25b54e8f6b4 req-908c7281-d8a7-4b81-b104-1856d88de563 service nova] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-cb33ced3-69b6-466f-ad6a-e25b54e8f6b4 req-908c7281-d8a7-4b81-b104-1856d88de563 service nova] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-cb33ced3-69b6-466f-ad6a-e25b54e8f6b4 req-908c7281-d8a7-4b81-b104-1856d88de563 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] No waiting events found dispatching network-vif-plugged-b7b109d8-a218-4b24-8da2-e3a4c5087fdd {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:59:34 user nova-compute[74692]: WARNING nova.compute.manager [req-cb33ced3-69b6-466f-ad6a-e25b54e8f6b4 req-908c7281-d8a7-4b81-b104-1856d88de563 service nova] [instance: 5d266a05-1f0a-4ac3-85ce-7321cdcef63b] Received unexpected event network-vif-plugged-b7b109d8-a218-4b24-8da2-e3a4c5087fdd for instance with vm_state deleted and task_state None.
Nov 18 18:59:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-65429c3b-1cca-4b91-8637-feac87f0d171 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5d266a05-1f0a-4ac3-85ce-7321cdcef63b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.408s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:59:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 18:59:37 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:59:37 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:59:37 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:59:37 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 18:59:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:59:37 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:59:37 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:59:38 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:59:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 18:59:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:59:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:59:39 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 18:59:39 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updating instance_info_cache with network_info: [{"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:59:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:59:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 18:59:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:59:40 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:59:40 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 18:59:40 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] There are 0 instances to clean {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 18:59:41 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 18:59:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:59:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:47 user nova-compute[74692]: DEBUG nova.compute.manager [req-4cdb5d7b-03dd-4438-84e6-fd31d83f7857 req-d8696c77-edb5-4761-856e-728d9dd54311 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received event network-changed-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:59:47 user nova-compute[74692]: DEBUG nova.compute.manager [req-4cdb5d7b-03dd-4438-84e6-fd31d83f7857 req-d8696c77-edb5-4761-856e-728d9dd54311 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Refreshing instance network info cache due to event network-changed-23428c32-45a0-44bb-bf79-3ea64636d40f. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:59:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4cdb5d7b-03dd-4438-84e6-fd31d83f7857 req-d8696c77-edb5-4761-856e-728d9dd54311 service nova] Acquiring lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:59:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4cdb5d7b-03dd-4438-84e6-fd31d83f7857 req-d8696c77-edb5-4761-856e-728d9dd54311 service nova] Acquired lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:59:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-4cdb5d7b-03dd-4438-84e6-fd31d83f7857 req-d8696c77-edb5-4761-856e-728d9dd54311 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Refreshing network info cache for port 23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:59:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-4cdb5d7b-03dd-4438-84e6-fd31d83f7857 req-d8696c77-edb5-4761-856e-728d9dd54311 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updated VIF entry in instance network info cache for port 23428c32-45a0-44bb-bf79-3ea64636d40f. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:59:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-4cdb5d7b-03dd-4438-84e6-fd31d83f7857 req-d8696c77-edb5-4761-856e-728d9dd54311 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updating instance_info_cache with network_info: [{"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:59:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4cdb5d7b-03dd-4438-84e6-fd31d83f7857 req-d8696c77-edb5-4761-856e-728d9dd54311 service nova] Releasing lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:59:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-f5aea9cc-ae5d-4d70-b9d3-7d0e641e244a req-45f7bab6-ffdb-426c-85ef-4152100475ce service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received event network-changed-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:59:48 user nova-compute[74692]: DEBUG nova.compute.manager [req-f5aea9cc-ae5d-4d70-b9d3-7d0e641e244a req-45f7bab6-ffdb-426c-85ef-4152100475ce service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Refreshing instance network info cache due to event network-changed-23428c32-45a0-44bb-bf79-3ea64636d40f. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 18:59:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f5aea9cc-ae5d-4d70-b9d3-7d0e641e244a req-45f7bab6-ffdb-426c-85ef-4152100475ce service nova] Acquiring lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 18:59:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f5aea9cc-ae5d-4d70-b9d3-7d0e641e244a req-45f7bab6-ffdb-426c-85ef-4152100475ce service nova] Acquired lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 18:59:48 user nova-compute[74692]: DEBUG nova.network.neutron [req-f5aea9cc-ae5d-4d70-b9d3-7d0e641e244a req-45f7bab6-ffdb-426c-85ef-4152100475ce service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Refreshing network info cache for port 23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 18:59:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:48 user nova-compute[74692]: INFO nova.compute.manager [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Detaching volume dfbf873d-b3ad-4b49-9966-cc0bb55ae755
Nov 18 18:59:48 user nova-compute[74692]: INFO nova.virt.block_device [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Attempting to driver detach volume dfbf873d-b3ad-4b49-9966-cc0bb55ae755 from mountpoint /dev/vdb
Nov 18 18:59:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Attempting to detach device vdb from instance 65e6ca14-de51-49e0-a417-87a72ee1fe42 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 18:59:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:59:48 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:59:48 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:59:48 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:59:48 user nova-compute[74692]:   <serial>dfbf873d-b3ad-4b49-9966-cc0bb55ae755</serial>
Nov 18 18:59:48 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:59:48 user nova-compute[74692]: </disk>
Nov 18 18:59:48 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:59:48 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Successfully detached device vdb from instance 65e6ca14-de51-49e0-a417-87a72ee1fe42 from the persistent domain config.
Nov 18 18:59:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 65e6ca14-de51-49e0-a417-87a72ee1fe42 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 18:59:48 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 18:59:48 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 18:59:48 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 18:59:48 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 18:59:48 user nova-compute[74692]:   <serial>dfbf873d-b3ad-4b49-9966-cc0bb55ae755</serial>
Nov 18 18:59:48 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 18:59:48 user nova-compute[74692]: </disk>
Nov 18 18:59:48 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 18:59:49 user nova-compute[74692]: DEBUG nova.network.neutron [req-f5aea9cc-ae5d-4d70-b9d3-7d0e641e244a req-45f7bab6-ffdb-426c-85ef-4152100475ce service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updated VIF entry in instance network info cache for port 23428c32-45a0-44bb-bf79-3ea64636d40f. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 18:59:49 user nova-compute[74692]: DEBUG nova.network.neutron [req-f5aea9cc-ae5d-4d70-b9d3-7d0e641e244a req-45f7bab6-ffdb-426c-85ef-4152100475ce service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updating instance_info_cache with network_info: [{"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:59:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f5aea9cc-ae5d-4d70-b9d3-7d0e641e244a req-45f7bab6-ffdb-426c-85ef-4152100475ce service nova] Releasing lock "refresh_cache-65e6ca14-de51-49e0-a417-87a72ee1fe42" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 18:59:49 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 65e6ca14-de51-49e0-a417-87a72ee1fe42 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 18:59:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "0443297c-0d68-4dc8-b7d6-221a14475f07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "0443297c-0d68-4dc8-b7d6-221a14475f07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "0443297c-0d68-4dc8-b7d6-221a14475f07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "0443297c-0d68-4dc8-b7d6-221a14475f07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "0443297c-0d68-4dc8-b7d6-221a14475f07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:49 user nova-compute[74692]: INFO nova.compute.manager [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Terminating instance
Nov 18 18:59:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 18:59:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-80a74ffd-fe0d-4514-8fd3-cad521f1adaa req-5ac0da03-538e-4ff0-80bb-9a406f30ad9c service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Received event network-vif-unplugged-910a623c-c4dd-401e-ab7d-9b13dcca2433 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-80a74ffd-fe0d-4514-8fd3-cad521f1adaa req-5ac0da03-538e-4ff0-80bb-9a406f30ad9c service nova] Acquiring lock "0443297c-0d68-4dc8-b7d6-221a14475f07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-80a74ffd-fe0d-4514-8fd3-cad521f1adaa req-5ac0da03-538e-4ff0-80bb-9a406f30ad9c service nova] Lock "0443297c-0d68-4dc8-b7d6-221a14475f07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-80a74ffd-fe0d-4514-8fd3-cad521f1adaa req-5ac0da03-538e-4ff0-80bb-9a406f30ad9c service nova] Lock "0443297c-0d68-4dc8-b7d6-221a14475f07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-80a74ffd-fe0d-4514-8fd3-cad521f1adaa req-5ac0da03-538e-4ff0-80bb-9a406f30ad9c service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] No waiting events found dispatching network-vif-unplugged-910a623c-c4dd-401e-ab7d-9b13dcca2433 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-80a74ffd-fe0d-4514-8fd3-cad521f1adaa req-5ac0da03-538e-4ff0-80bb-9a406f30ad9c service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Received event network-vif-unplugged-910a623c-c4dd-401e-ab7d-9b13dcca2433 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Instance destroyed successfully.
Nov 18 18:59:50 user nova-compute[74692]: DEBUG nova.objects.instance [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lazy-loading 'resources' on Instance uuid 0443297c-0d68-4dc8-b7d6-221a14475f07 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:57:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1597465599',display_name='tempest-TestVolumeBootPattern-server-1597465599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1597465599',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:58:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-rdz7gt6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:58:17Z,user_data=None,user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=0443297c-0d68-4dc8-b7d6-221a14475f07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "address": "fa:16:3e:8a:6d:92", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910a623c-c4", "ovs_interfaceid": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "address": "fa:16:3e:8a:6d:92", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910a623c-c4", "ovs_interfaceid": "910a623c-c4dd-401e-ab7d-9b13dcca2433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:6d:92,bridge_name='br-int',has_traffic_filtering=True,id=910a623c-c4dd-401e-ab7d-9b13dcca2433,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910a623c-c4') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_vif [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:6d:92,bridge_name='br-int',has_traffic_filtering=True,id=910a623c-c4dd-401e-ab7d-9b13dcca2433,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910a623c-c4') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap910a623c-c4, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba456b86-1530-4e1b-9fc6-7470dcbc8ae2) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:50 user nova-compute[74692]: INFO os_vif [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:6d:92,bridge_name='br-int',has_traffic_filtering=True,id=910a623c-c4dd-401e-ab7d-9b13dcca2433,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910a623c-c4')
Nov 18 18:59:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eptaYUPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 18:59:50 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fb6b97-5db2-42bb-a0c1-82bc761003ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 18:59:50 user nova-compute[74692]: No targets found.
Nov 18 18:59:50 user nova-compute[74692]: iSNS:
Nov 18 18:59:50 user nova-compute[74692]: No targets found.
Nov 18 18:59:50 user nova-compute[74692]: STATIC:
Nov 18 18:59:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755
Nov 18 18:59:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:59:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:59:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2
Nov 18 18:59:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:59:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:59:50 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823
Nov 18 18:59:50 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 18:59:50 user nova-compute[74692]:                 Iface Name: default
Nov 18 18:59:50 user nova-compute[74692]: FIRMWARE:
Nov 18 18:59:50 user nova-compute[74692]: No targets found.
Nov 18 18:59:50 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 18:59:50 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 18:59:50 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[717b1612-a9d8-4334-ae19-2190094ce686]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7715ca-e64a-4349-a492-a8801f3aa656]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:59:50 user nova-compute[74692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)
Nov 18 18:59:50 user nova-compute[74692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:59:50 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 18:59:50 user nova-compute[74692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 (non-flash)
Nov 18 18:59:50 user nova-compute[74692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 18:59:50 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c465c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2'): ({'sde'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Removing single pathed devices sde {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b88df57-c3ad-4aa8-9e01-8d7d9b9d36dd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf53bb2-e7f5-4673-ac90-4288800163d8]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flushing IO for device /dev/sde {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf497725-d97d-4cdc-8344-c84ff0f67017]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cabc24-f8f0-4c54-95a0-b7cccefd06ac]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] SCSI volumes sde have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOad93e1b7-92e494c7c037de64', '/dev/disk/by-id/scsi-23932653439346337', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ad93e1b7') {{(pid=84932) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc10b7f-ffed-4a28-b2cf-c5a0a4190b57]: (4, None) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[957bb13e-786d-47ce-a3da-89b9649d4a3b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddf9d93-5ce8-4684-9bb8-0269044ba759]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2, portal: 172.16.0.220,3260]
Nov 18 18:59:50 user nova-compute[74692]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2, portal: 172.16.0.220,3260] successful.
Nov 18 18:59:50 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c2598-301b-4c9b-9634-ee51bc406da2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f907a0-7d47-45bd-a995-93e40fe71c98]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== disconnect_volume: return (296ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 18:59:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Deleting instance files /opt/stack/data/nova/instances/0443297c-0d68-4dc8-b7d6-221a14475f07_del
Nov 18 18:59:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Deletion of /opt/stack/data/nova/instances/0443297c-0d68-4dc8-b7d6-221a14475f07_del complete
Nov 18 18:59:50 user nova-compute[74692]: INFO nova.compute.manager [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 18 18:59:50 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 18:59:50 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 18:59:51 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 18:59:51 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Took 0.65 seconds to deallocate network for instance.
Nov 18 18:59:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-2b341dd7-a466-46c4-ace0-8ffaebf9e411 req-f40a54d9-1c32-4136-8ff2-6b416db19d15 service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Received event network-vif-deleted-910a623c-c4dd-401e-ab7d-9b13dcca2433 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:59:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-f82ed521-f249-4676-b1d4-d2d018e4020e req-ba216db7-2eff-43b8-be73-b54212ab43cd service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Received event network-vif-plugged-910a623c-c4dd-401e-ab7d-9b13dcca2433 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 18:59:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f82ed521-f249-4676-b1d4-d2d018e4020e req-ba216db7-2eff-43b8-be73-b54212ab43cd service nova] Acquiring lock "0443297c-0d68-4dc8-b7d6-221a14475f07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f82ed521-f249-4676-b1d4-d2d018e4020e req-ba216db7-2eff-43b8-be73-b54212ab43cd service nova] Lock "0443297c-0d68-4dc8-b7d6-221a14475f07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f82ed521-f249-4676-b1d4-d2d018e4020e req-ba216db7-2eff-43b8-be73-b54212ab43cd service nova] Lock "0443297c-0d68-4dc8-b7d6-221a14475f07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-f82ed521-f249-4676-b1d4-d2d018e4020e req-ba216db7-2eff-43b8-be73-b54212ab43cd service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] No waiting events found dispatching network-vif-plugged-910a623c-c4dd-401e-ab7d-9b13dcca2433 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 18:59:52 user nova-compute[74692]: WARNING nova.compute.manager [req-f82ed521-f249-4676-b1d4-d2d018e4020e req-ba216db7-2eff-43b8-be73-b54212ab43cd service nova] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Received unexpected event network-vif-plugged-910a623c-c4dd-401e-ab7d-9b13dcca2433 for instance with vm_state active and task_state deleting.
Nov 18 18:59:52 user nova-compute[74692]: INFO nova.compute.manager [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Took 0.74 seconds to detach 1 volumes for instance.
Nov 18 18:59:52 user nova-compute[74692]: DEBUG nova.compute.manager [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 0443297c-0d68-4dc8-b7d6-221a14475f07] Deleting volume: e82c2598-301b-4c9b-9634-ee51bc406da2 {{(pid=74692) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 18:59:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 18:59:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 18:59:52 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 18:59:52 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 18:59:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:52 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Deleted allocations for instance 0443297c-0d68-4dc8-b7d6-221a14475f07
Nov 18 18:59:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-0bd3cc99-52bb-4190-83bb-2d12622c7c7e tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "0443297c-0d68-4dc8-b7d6-221a14475f07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.940s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 18:59:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 18:59:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:00:09 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 65e6ca14-de51-49e0-a417-87a72ee1fe42 is timed out.
Nov 18 19:00:09 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Successfully detached device vdb from instance 65e6ca14-de51-49e0-a417-87a72ee1fe42 from the live domain config.
Nov 18 19:00:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fVSWaUjn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:00:09 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ac622c-397a-4a6d-95ab-f58106ad9a1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:00:09 user nova-compute[74692]: No targets found.
Nov 18 19:00:09 user nova-compute[74692]: iSNS:
Nov 18 19:00:09 user nova-compute[74692]: No targets found.
Nov 18 19:00:09 user nova-compute[74692]: STATIC:
Nov 18 19:00:09 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755
Nov 18 19:00:09 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:00:09 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:00:09 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823
Nov 18 19:00:09 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:00:09 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:00:09 user nova-compute[74692]: FIRMWARE:
Nov 18 19:00:09 user nova-compute[74692]: No targets found.
Nov 18 19:00:09 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:00:09 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:00:09 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa7c060-17a9-42b0-bc25-08c704c07060]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee62aab9-8e97-4859-b470-356954913789]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 19:00:09 user nova-compute[74692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 19:00:09 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 (non-flash)
Nov 18 19:00:09 user nova-compute[74692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 19:00:09 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c41efb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755'): ({'sdd'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Removing single pathed devices sdd {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d455b60c-af8d-4830-9dd0-b03f3b56d606]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7006a527-e7f5-4cba-8f6f-6476037d45c6]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Flushing IO for device /dev/sdd {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4f9213-346a-4a7a-a51f-3987be8869f5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[744f6cd3-e128-4403-8d21-0c598e1151b5]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dda821a-107b-427e-9392-d68a41b9020b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68f8a2a-6353-45af-bdbc-540c61ff41cf]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755, portal: 172.16.0.220,3260]
Nov 18 19:00:09 user nova-compute[74692]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755, portal: 172.16.0.220,3260] successful.
Nov 18 19:00:09 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbf873d-b3ad-4b49-9966-cc0bb55ae755 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[667b01d9-5278-4cd8-ab1e-13708e7dc13d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] <== disconnect_volume: return (290ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:00:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:00:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:00:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:00:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:00:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:00:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:10 user nova-compute[74692]: DEBUG nova.objects.instance [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lazy-loading 'flavor' on Instance uuid 65e6ca14-de51-49e0-a417-87a72ee1fe42 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:00:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6d4f8a80-d4a3-4492-8cf9-90140d2f0d5d tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.885s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:00:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:00:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "ce2a3af7-ac82-4dca-bc25-14876d57466f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 19:00:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:00:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:25 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 19:00:25 user nova-compute[74692]: INFO nova.compute.claims [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Claim successful on node user
Nov 18 19:00:25 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:00:25 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:00:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 19:00:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 19:00:25 user nova-compute[74692]: DEBUG nova.network.neutron [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 19:00:25 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 19:00:25 user nova-compute[74692]: DEBUG nova.compute.manager [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 19:00:25 user nova-compute[74692]: DEBUG nova.policy [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'def7f7c9ff4f4a29a840ace22d509755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7475e741034a4302b0ab193f1b6c67d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 19:00:26 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Creating image(s)
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "/opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "/opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk 1073741824" returned: 0 in 0.065s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG nova.network.neutron [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Successfully created port: 60aa7752-8dff-4325-b95f-ae6d2ab82f49 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Cannot resize image /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Ensure instance console log exists: /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.network.neutron [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Successfully updated port: 60aa7752-8dff-4325-b95f-ae6d2ab82f49 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "refresh_cache-ce2a3af7-ac82-4dca-bc25-14876d57466f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquired lock "refresh_cache-ce2a3af7-ac82-4dca-bc25-14876d57466f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.network.neutron [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-a9212fd0-783f-45c3-828a-3e1786c7d25d req-ca6b2094-cd70-4124-90f6-5740781eec30 service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Received event network-changed-60aa7752-8dff-4325-b95f-ae6d2ab82f49 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-a9212fd0-783f-45c3-828a-3e1786c7d25d req-ca6b2094-cd70-4124-90f6-5740781eec30 service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Refreshing instance network info cache due to event network-changed-60aa7752-8dff-4325-b95f-ae6d2ab82f49. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a9212fd0-783f-45c3-828a-3e1786c7d25d req-ca6b2094-cd70-4124-90f6-5740781eec30 service nova] Acquiring lock "refresh_cache-ce2a3af7-ac82-4dca-bc25-14876d57466f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.network.neutron [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.network.neutron [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Updating instance_info_cache with network_info: [{"id": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "address": "fa:16:3e:a7:ae:37", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7752-8d", "ovs_interfaceid": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Releasing lock "refresh_cache-ce2a3af7-ac82-4dca-bc25-14876d57466f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.compute.manager [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Instance network_info: |[{"id": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "address": "fa:16:3e:a7:ae:37", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7752-8d", "ovs_interfaceid": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a9212fd0-783f-45c3-828a-3e1786c7d25d req-ca6b2094-cd70-4124-90f6-5740781eec30 service nova] Acquired lock "refresh_cache-ce2a3af7-ac82-4dca-bc25-14876d57466f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.network.neutron [req-a9212fd0-783f-45c3-828a-3e1786c7d25d req-ca6b2094-cd70-4124-90f6-5740781eec30 service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Refreshing network info cache for port 60aa7752-8dff-4325-b95f-ae6d2ab82f49 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Start _get_guest_xml network_info=[{"id": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "address": "fa:16:3e:a7:ae:37", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7752-8d", "ovs_interfaceid": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 19:00:27 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:00:27 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:00:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-690297032',display_name='tempest-AttachVolumeNegativeTest-server-690297032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-690297032',id=43,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2UXnbGwYO/RTzroI4cuyUOkLzAkuQnZ3C+6euoTKAj/+Szy6c0yWQMB5sknXoc0NGX2fxiauSmOdBujWoWnyOpunn6TckL1XrrHuptMXKG99jPlURezPUuEyRYFEcz9w==',key_name='tempest-keypair-327815926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7475e741034a4302b0ab193f1b6c67d2',ramdisk_id='',reservation_id='r-mg2a39r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-542263902',owner_user_name='tempest-AttachVolumeNegativeTest-542263902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='def7f7c9ff4f4a29a840ace22d509755',uuid=ce2a3af7-ac82-4dca-bc25-14876d57466f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "address": "fa:16:3e:a7:ae:37", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7752-8d", "ovs_interfaceid": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converting VIF {"id": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "address": "fa:16:3e:a7:ae:37", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7752-8d", "ovs_interfaceid": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ae:37,bridge_name='br-int',has_traffic_filtering=True,id=60aa7752-8dff-4325-b95f-ae6d2ab82f49,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60aa7752-8d') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.objects.instance [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'pci_devices' on Instance uuid ce2a3af7-ac82-4dca-bc25-14876d57466f {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] End _get_guest_xml xml=<domain type="kvm">
Nov 18 19:00:27 user nova-compute[74692]:   <uuid>ce2a3af7-ac82-4dca-bc25-14876d57466f</uuid>
Nov 18 19:00:27 user nova-compute[74692]:   <name>instance-0000002b</name>
Nov 18 19:00:27 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 19:00:27 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 19:00:27 user nova-compute[74692]:   <metadata>
Nov 18 19:00:27 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 19:00:27 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 19:00:27 user nova-compute[74692]:       <nova:name>tempest-AttachVolumeNegativeTest-server-690297032</nova:name>
Nov 18 19:00:27 user nova-compute[74692]:       <nova:creationTime>2023-11-18 19:00:27</nova:creationTime>
Nov 18 19:00:27 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 19:00:27 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 19:00:27 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 19:00:27 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 19:00:27 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 19:00:27 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 19:00:27 user nova-compute[74692]:       </nova:flavor>
Nov 18 19:00:27 user nova-compute[74692]:       <nova:owner>
Nov 18 19:00:27 user nova-compute[74692]:         <nova:user uuid="def7f7c9ff4f4a29a840ace22d509755">tempest-AttachVolumeNegativeTest-542263902-project-member</nova:user>
Nov 18 19:00:27 user nova-compute[74692]:         <nova:project uuid="7475e741034a4302b0ab193f1b6c67d2">tempest-AttachVolumeNegativeTest-542263902</nova:project>
Nov 18 19:00:27 user nova-compute[74692]:       </nova:owner>
Nov 18 19:00:27 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 19:00:27 user nova-compute[74692]:       <nova:ports>
Nov 18 19:00:27 user nova-compute[74692]:         <nova:port uuid="60aa7752-8dff-4325-b95f-ae6d2ab82f49">
Nov 18 19:00:27 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 19:00:27 user nova-compute[74692]:         </nova:port>
Nov 18 19:00:27 user nova-compute[74692]:       </nova:ports>
Nov 18 19:00:27 user nova-compute[74692]:     </nova:instance>
Nov 18 19:00:27 user nova-compute[74692]:   </metadata>
Nov 18 19:00:27 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 19:00:27 user nova-compute[74692]:     <system>
Nov 18 19:00:27 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 19:00:27 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 19:00:27 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 19:00:27 user nova-compute[74692]:       <entry name="serial">ce2a3af7-ac82-4dca-bc25-14876d57466f</entry>
Nov 18 19:00:27 user nova-compute[74692]:       <entry name="uuid">ce2a3af7-ac82-4dca-bc25-14876d57466f</entry>
Nov 18 19:00:27 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 19:00:27 user nova-compute[74692]:     </system>
Nov 18 19:00:27 user nova-compute[74692]:   </sysinfo>
Nov 18 19:00:27 user nova-compute[74692]:   <os>
Nov 18 19:00:27 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 19:00:27 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 19:00:27 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 19:00:27 user nova-compute[74692]:   </os>
Nov 18 19:00:27 user nova-compute[74692]:   <features>
Nov 18 19:00:27 user nova-compute[74692]:     <acpi/>
Nov 18 19:00:27 user nova-compute[74692]:     <apic/>
Nov 18 19:00:27 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 19:00:27 user nova-compute[74692]:   </features>
Nov 18 19:00:27 user nova-compute[74692]:   <clock offset="utc">
Nov 18 19:00:27 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 19:00:27 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 19:00:27 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 19:00:27 user nova-compute[74692]:   </clock>
Nov 18 19:00:27 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 19:00:27 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 19:00:27 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 19:00:27 user nova-compute[74692]:   </cpu>
Nov 18 19:00:27 user nova-compute[74692]:   <devices>
Nov 18 19:00:27 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 19:00:27 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 19:00:27 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk"/>
Nov 18 19:00:27 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 19:00:27 user nova-compute[74692]:     </disk>
Nov 18 19:00:27 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 19:00:27 user nova-compute[74692]:       <mac address="fa:16:3e:a7:ae:37"/>
Nov 18 19:00:27 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:00:27 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 19:00:27 user nova-compute[74692]:       <target dev="tap60aa7752-8d"/>
Nov 18 19:00:27 user nova-compute[74692]:     </interface>
Nov 18 19:00:27 user nova-compute[74692]:     <serial type="pty">
Nov 18 19:00:27 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/console.log" append="off"/>
Nov 18 19:00:27 user nova-compute[74692]:     </serial>
Nov 18 19:00:27 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 19:00:27 user nova-compute[74692]:     <video>
Nov 18 19:00:27 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:00:27 user nova-compute[74692]:     </video>
Nov 18 19:00:27 user nova-compute[74692]:     <rng model="virtio">
Nov 18 19:00:27 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 19:00:27 user nova-compute[74692]:     </rng>
Nov 18 19:00:27 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 19:00:27 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 19:00:27 user nova-compute[74692]:       <stats period="10"/>
Nov 18 19:00:27 user nova-compute[74692]:     </memballoon>
Nov 18 19:00:27 user nova-compute[74692]:   </devices>
Nov 18 19:00:27 user nova-compute[74692]: </domain>
Nov 18 19:00:27 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:00:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-690297032',display_name='tempest-AttachVolumeNegativeTest-server-690297032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-690297032',id=43,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2UXnbGwYO/RTzroI4cuyUOkLzAkuQnZ3C+6euoTKAj/+Szy6c0yWQMB5sknXoc0NGX2fxiauSmOdBujWoWnyOpunn6TckL1XrrHuptMXKG99jPlURezPUuEyRYFEcz9w==',key_name='tempest-keypair-327815926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7475e741034a4302b0ab193f1b6c67d2',ramdisk_id='',reservation_id='r-mg2a39r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-542263902',owner_user_name='tempest-AttachVolumeNegativeTest-542263902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='def7f7c9ff4f4a29a840ace22d509755',uuid=ce2a3af7-ac82-4dca-bc25-14876d57466f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "address": "fa:16:3e:a7:ae:37", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7752-8d", "ovs_interfaceid": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converting VIF {"id": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "address": "fa:16:3e:a7:ae:37", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7752-8d", "ovs_interfaceid": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ae:37,bridge_name='br-int',has_traffic_filtering=True,id=60aa7752-8dff-4325-b95f-ae6d2ab82f49,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60aa7752-8d') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG os_vif [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ae:37,bridge_name='br-int',has_traffic_filtering=True,id=60aa7752-8dff-4325-b95f-ae6d2ab82f49,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60aa7752-8d') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ccbf9fda-dfb5-5d2a-94ae-9a07f9aa9c36', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60aa7752-8d, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60aa7752-8d, col_values=(('qos', UUID('9c6b7dc7-806d-453d-96c2-15b21378feb6')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60aa7752-8d, col_values=(('external_ids', {'iface-id': '60aa7752-8dff-4325-b95f-ae6d2ab82f49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:ae:37', 'vm-uuid': 'ce2a3af7-ac82-4dca-bc25-14876d57466f'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:27 user nova-compute[74692]: INFO os_vif [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ae:37,bridge_name='br-int',has_traffic_filtering=True,id=60aa7752-8dff-4325-b95f-ae6d2ab82f49,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60aa7752-8d')
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:00:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No VIF found with MAC fa:16:3e:a7:ae:37, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:00:28 user nova-compute[74692]: DEBUG nova.network.neutron [req-a9212fd0-783f-45c3-828a-3e1786c7d25d req-ca6b2094-cd70-4124-90f6-5740781eec30 service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Updated VIF entry in instance network info cache for port 60aa7752-8dff-4325-b95f-ae6d2ab82f49. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:00:28 user nova-compute[74692]: DEBUG nova.network.neutron [req-a9212fd0-783f-45c3-828a-3e1786c7d25d req-ca6b2094-cd70-4124-90f6-5740781eec30 service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Updating instance_info_cache with network_info: [{"id": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "address": "fa:16:3e:a7:ae:37", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7752-8d", "ovs_interfaceid": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:00:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a9212fd0-783f-45c3-828a-3e1786c7d25d req-ca6b2094-cd70-4124-90f6-5740781eec30 service nova] Releasing lock "refresh_cache-ce2a3af7-ac82-4dca-bc25-14876d57466f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:00:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-eb752305-846b-4d22-9309-e320d706d060 req-5f113a9e-573f-4699-a6ed-8aab6ca5836d service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Received event network-vif-plugged-60aa7752-8dff-4325-b95f-ae6d2ab82f49 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:00:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eb752305-846b-4d22-9309-e320d706d060 req-5f113a9e-573f-4699-a6ed-8aab6ca5836d service nova] Acquiring lock "ce2a3af7-ac82-4dca-bc25-14876d57466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eb752305-846b-4d22-9309-e320d706d060 req-5f113a9e-573f-4699-a6ed-8aab6ca5836d service nova] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eb752305-846b-4d22-9309-e320d706d060 req-5f113a9e-573f-4699-a6ed-8aab6ca5836d service nova] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-eb752305-846b-4d22-9309-e320d706d060 req-5f113a9e-573f-4699-a6ed-8aab6ca5836d service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] No waiting events found dispatching network-vif-plugged-60aa7752-8dff-4325-b95f-ae6d2ab82f49 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:00:29 user nova-compute[74692]: WARNING nova.compute.manager [req-eb752305-846b-4d22-9309-e320d706d060 req-5f113a9e-573f-4699-a6ed-8aab6ca5836d service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Received unexpected event network-vif-plugged-60aa7752-8dff-4325-b95f-ae6d2ab82f49 for instance with vm_state building and task_state spawning.
Nov 18 19:00:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:29 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:00:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 19:00:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 19:00:31 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Instance spawned successfully.
Nov 18 19:00:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 19:00:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:00:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:00:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:00:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:00:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:00:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:00:31 user nova-compute[74692]: INFO nova.compute.manager [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 18 19:00:31 user nova-compute[74692]: DEBUG nova.compute.manager [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 19:00:31 user nova-compute[74692]: INFO nova.compute.manager [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Took 5.93 seconds to build instance.
Nov 18 19:00:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-746df6ee-212b-475e-a483-84a069230ec9 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.013s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-9c84cf58-31f2-44c1-b79e-30ae67661575 req-850e8a73-242f-41ca-a28d-734fabddc158 service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Received event network-vif-plugged-60aa7752-8dff-4325-b95f-ae6d2ab82f49 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:00:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9c84cf58-31f2-44c1-b79e-30ae67661575 req-850e8a73-242f-41ca-a28d-734fabddc158 service nova] Acquiring lock "ce2a3af7-ac82-4dca-bc25-14876d57466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9c84cf58-31f2-44c1-b79e-30ae67661575 req-850e8a73-242f-41ca-a28d-734fabddc158 service nova] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9c84cf58-31f2-44c1-b79e-30ae67661575 req-850e8a73-242f-41ca-a28d-734fabddc158 service nova] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:31 user nova-compute[74692]: DEBUG nova.compute.manager [req-9c84cf58-31f2-44c1-b79e-30ae67661575 req-850e8a73-242f-41ca-a28d-734fabddc158 service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] No waiting events found dispatching network-vif-plugged-60aa7752-8dff-4325-b95f-ae6d2ab82f49 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:00:31 user nova-compute[74692]: WARNING nova.compute.manager [req-9c84cf58-31f2-44c1-b79e-30ae67661575 req-850e8a73-242f-41ca-a28d-734fabddc158 service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Received unexpected event network-vif-plugged-60aa7752-8dff-4325-b95f-ae6d2ab82f49 for instance with vm_state active and task_state None.
Nov 18 19:00:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:32 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:00:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:32 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:00:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:00:33 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:34 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:00:34 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:00:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=24.99713134765625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 65e6ca14-de51-49e0-a417-87a72ee1fe42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5946a617-f567-4ab6-a2db-29c2c86544a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance ce2a3af7-ac82-4dca-bc25-14876d57466f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing inventories for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating ProviderTree inventory for provider 582be55c-ee9f-496e-b354-5900b8401d2c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating inventory in ProviderTree for provider 582be55c-ee9f-496e-b354-5900b8401d2c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing aggregate associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, aggregates: None {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing trait associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:00:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:37 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:00:37 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:00:37 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:00:37 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:00:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:00:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:00:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Didn't find any instances for network info cache update. {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 19:00:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:00:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:00:40 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:42 user nova-compute[74692]: INFO nova.compute.manager [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Terminating instance
Nov 18 19:00:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-63d83dd9-36a3-4649-ae3c-2286b6774862 req-7cf0aa85-7b80-48f1-b6e6-0dbf1e3aa70b service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received event network-vif-unplugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-63d83dd9-36a3-4649-ae3c-2286b6774862 req-7cf0aa85-7b80-48f1-b6e6-0dbf1e3aa70b service nova] Acquiring lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-63d83dd9-36a3-4649-ae3c-2286b6774862 req-7cf0aa85-7b80-48f1-b6e6-0dbf1e3aa70b service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-63d83dd9-36a3-4649-ae3c-2286b6774862 req-7cf0aa85-7b80-48f1-b6e6-0dbf1e3aa70b service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-63d83dd9-36a3-4649-ae3c-2286b6774862 req-7cf0aa85-7b80-48f1-b6e6-0dbf1e3aa70b service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] No waiting events found dispatching network-vif-unplugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-63d83dd9-36a3-4649-ae3c-2286b6774862 req-7cf0aa85-7b80-48f1-b6e6-0dbf1e3aa70b service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received event network-vif-unplugged-23428c32-45a0-44bb-bf79-3ea64636d40f for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 19:00:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:43 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Instance destroyed successfully.
Nov 18 19:00:43 user nova-compute[74692]: DEBUG nova.objects.instance [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lazy-loading 'resources' on Instance uuid 65e6ca14-de51-49e0-a417-87a72ee1fe42 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:00:43 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-626063356',display_name='tempest-TestMinimumBasicScenario-server-626063356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-626063356',id=40,image_ref='883af0bb-115a-4a16-89e9-fd1ac21f0dd1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGRaCjlWarzPlGYrhEobPHdGmzYZEzyoJ51FegKOsQXVZjfvPUvPKqM/7QgdJ9259I5kZxACf7OHEKK8WR40naSAOupJ04y3VhwRELicYPW0nPPeF4r1CL1aqqq7Bo1Ug==',key_name='tempest-TestMinimumBasicScenario-1991359170',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:55:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eff44b3a1f5486296f293bcaa879f04',ramdisk_id='',reservation_id='r-gpitjpu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='883af0bb-115a-4a16-89e9-fd1ac21f0dd1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1654716799',owner_user_name='tempest-TestMinimumBasicScenario-1654716799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:58:03Z,user_data=None,user_id='81e4fbd0fddf4c0d8051c4020165681a',uuid=65e6ca14-de51-49e0-a417-87a72ee1fe42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 19:00:43 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converting VIF {"id": "23428c32-45a0-44bb-bf79-3ea64636d40f", "address": "fa:16:3e:b0:51:1b", "network": {"id": "5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978557909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff44b3a1f5486296f293bcaa879f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23428c32-45", "ovs_interfaceid": "23428c32-45a0-44bb-bf79-3ea64636d40f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:00:43 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:51:1b,bridge_name='br-int',has_traffic_filtering=True,id=23428c32-45a0-44bb-bf79-3ea64636d40f,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23428c32-45') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:00:43 user nova-compute[74692]: DEBUG os_vif [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:51:1b,bridge_name='br-int',has_traffic_filtering=True,id=23428c32-45a0-44bb-bf79-3ea64636d40f,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23428c32-45') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 19:00:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23428c32-45, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:00:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:00:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9e72027-be55-4684-9987-284b20377e44) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:00:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:00:43 user nova-compute[74692]: INFO os_vif [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:51:1b,bridge_name='br-int',has_traffic_filtering=True,id=23428c32-45a0-44bb-bf79-3ea64636d40f,network=Network(5e9edee1-eeb4-49ab-bceb-2ba39fb9da9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23428c32-45')
Nov 18 19:00:43 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Deleting instance files /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42_del
Nov 18 19:00:43 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Deletion of /opt/stack/data/nova/instances/65e6ca14-de51-49e0-a417-87a72ee1fe42_del complete
Nov 18 19:00:43 user nova-compute[74692]: INFO nova.compute.manager [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 18 19:00:43 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 19:00:43 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 19:00:43 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 19:00:43 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:00:44 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:00:44 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Took 0.76 seconds to deallocate network for instance.
Nov 18 19:00:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:44 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:00:44 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:00:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:44 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Deleted allocations for instance 65e6ca14-de51-49e0-a417-87a72ee1fe42
Nov 18 19:00:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-05650b54-e32e-47de-8fc7-b07ac89969e7 tempest-TestMinimumBasicScenario-1654716799 tempest-TestMinimumBasicScenario-1654716799-project-member] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.129s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-9afec34a-c9ce-4b4a-8df1-a756a2a6724a req-fc16057a-2693-4aea-8dab-7948405df802 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received event network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:00:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9afec34a-c9ce-4b4a-8df1-a756a2a6724a req-fc16057a-2693-4aea-8dab-7948405df802 service nova] Acquiring lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9afec34a-c9ce-4b4a-8df1-a756a2a6724a req-fc16057a-2693-4aea-8dab-7948405df802 service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9afec34a-c9ce-4b4a-8df1-a756a2a6724a req-fc16057a-2693-4aea-8dab-7948405df802 service nova] Lock "65e6ca14-de51-49e0-a417-87a72ee1fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-9afec34a-c9ce-4b4a-8df1-a756a2a6724a req-fc16057a-2693-4aea-8dab-7948405df802 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] No waiting events found dispatching network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:00:44 user nova-compute[74692]: WARNING nova.compute.manager [req-9afec34a-c9ce-4b4a-8df1-a756a2a6724a req-fc16057a-2693-4aea-8dab-7948405df802 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received unexpected event network-vif-plugged-23428c32-45a0-44bb-bf79-3ea64636d40f for instance with vm_state deleted and task_state None.
Nov 18 19:00:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-9afec34a-c9ce-4b4a-8df1-a756a2a6724a req-fc16057a-2693-4aea-8dab-7948405df802 service nova] [instance: 65e6ca14-de51-49e0-a417-87a72ee1fe42] Received event network-vif-deleted-23428c32-45a0-44bb-bf79-3ea64636d40f {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:00:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG nova.compute.manager [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 19:00:52 user nova-compute[74692]: INFO nova.compute.claims [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Claim successful on node user
Nov 18 19:00:52 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG nova.compute.manager [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG nova.compute.manager [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG nova.network.neutron [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 19:00:52 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 19:00:52 user nova-compute[74692]: DEBUG nova.compute.manager [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG nova.policy [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f58b7c308c3b4fa7bb4f576048ef7619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a60e439a714bdd8fca1ec43e2a3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 19:00:52 user nova-compute[74692]: INFO nova.virt.block_device [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Booting with volume ca4bd948-64ab-4b37-9236-f78dda0395b6 at /dev/vda
Nov 18 19:00:52 user nova-compute[74692]: DEBUG os_brick.utils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd688d9-db8a-41df-85fd-cd959c6d228b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca23ce02-8285-478e-a5dd-f6559cda9d83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[87813834-c981-4ecf-9db0-5b2c90177cbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9bdf88-90c5-455f-92ab-53e14fdae068]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:00:52 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 19:00:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bca0c0-e9be-482c-aaed-ca2d5e225c00]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG os_brick.utils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:00:52 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Updating existing volume attachment record: b19823bd-cf73-4e96-a0c5-b7cd089a8efb {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 19:00:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:53 user nova-compute[74692]: DEBUG nova.network.neutron [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Successfully created port: cf4807d9-4efb-4ed4-9d0d-37ab13d21cde {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 19:00:53 user nova-compute[74692]: DEBUG nova.network.neutron [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Successfully updated port: cf4807d9-4efb-4ed4-9d0d-37ab13d21cde {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 19:00:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "refresh_cache-4519eaca-4744-49e2-a3ce-34d3a9fedc77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:00:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquired lock "refresh_cache-4519eaca-4744-49e2-a3ce-34d3a9fedc77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:00:53 user nova-compute[74692]: DEBUG nova.network.neutron [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 19:00:53 user nova-compute[74692]: DEBUG nova.compute.manager [req-5a653481-9e45-4b1c-ba7a-6c74dfc74b97 req-dc6931bf-bef9-4670-812b-e4f9cc01ec34 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Received event network-changed-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:00:53 user nova-compute[74692]: DEBUG nova.compute.manager [req-5a653481-9e45-4b1c-ba7a-6c74dfc74b97 req-dc6931bf-bef9-4670-812b-e4f9cc01ec34 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Refreshing instance network info cache due to event network-changed-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:00:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5a653481-9e45-4b1c-ba7a-6c74dfc74b97 req-dc6931bf-bef9-4670-812b-e4f9cc01ec34 service nova] Acquiring lock "refresh_cache-4519eaca-4744-49e2-a3ce-34d3a9fedc77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:00:54 user nova-compute[74692]: DEBUG nova.network.neutron [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 19:00:54 user nova-compute[74692]: DEBUG nova.network.neutron [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Updating instance_info_cache with network_info: [{"id": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "address": "fa:16:3e:5b:b9:cd", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf4807d9-4e", "ovs_interfaceid": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:00:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Releasing lock "refresh_cache-4519eaca-4744-49e2-a3ce-34d3a9fedc77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:00:54 user nova-compute[74692]: DEBUG nova.compute.manager [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Instance network_info: |[{"id": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "address": "fa:16:3e:5b:b9:cd", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf4807d9-4e", "ovs_interfaceid": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 19:00:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5a653481-9e45-4b1c-ba7a-6c74dfc74b97 req-dc6931bf-bef9-4670-812b-e4f9cc01ec34 service nova] Acquired lock "refresh_cache-4519eaca-4744-49e2-a3ce-34d3a9fedc77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:00:54 user nova-compute[74692]: DEBUG nova.network.neutron [req-5a653481-9e45-4b1c-ba7a-6c74dfc74b97 req-dc6931bf-bef9-4670-812b-e4f9cc01ec34 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Refreshing network info cache for port cf4807d9-4efb-4ed4-9d0d-37ab13d21cde {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:00:54 user nova-compute[74692]: DEBUG nova.network.neutron [req-5a653481-9e45-4b1c-ba7a-6c74dfc74b97 req-dc6931bf-bef9-4670-812b-e4f9cc01ec34 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Updated VIF entry in instance network info cache for port cf4807d9-4efb-4ed4-9d0d-37ab13d21cde. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:00:54 user nova-compute[74692]: DEBUG nova.network.neutron [req-5a653481-9e45-4b1c-ba7a-6c74dfc74b97 req-dc6931bf-bef9-4670-812b-e4f9cc01ec34 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Updating instance_info_cache with network_info: [{"id": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "address": "fa:16:3e:5b:b9:cd", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf4807d9-4e", "ovs_interfaceid": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:00:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5a653481-9e45-4b1c-ba7a-6c74dfc74b97 req-dc6931bf-bef9-4670-812b-e4f9cc01ec34 service nova] Releasing lock "refresh_cache-4519eaca-4744-49e2-a3ce-34d3a9fedc77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 19:00:58 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Creating image(s)
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Ensure instance console log exists: /opt/stack/data/nova/instances/4519eaca-4744-49e2-a3ce-34d3a9fedc77/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Start _get_guest_xml network_info=[{"id": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "address": "fa:16:3e:5b:b9:cd", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf4807d9-4e", "ovs_interfaceid": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rMJWPwCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4519eaca-4744-49e2-a3ce-34d3a9fedc77', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca4bd948-64ab-4b37-9236-f78dda0395b6', 'serial': 'ca4bd948-64ab-4b37-9236-f78dda0395b6'}, 'attachment_id': 'b19823bd-cf73-4e96-a0c5-b7cd089a8efb', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 19:00:58 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:00:58 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rMJWPwCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:00:58 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:00:58 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:00:58 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[549170b3-6e19-4043-94f0-4f00438fc04d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 19:00:58 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e2cb44-4d68-40a2-914e-7f830b2b962d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6] added
Nov 18 19:00:58 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[efef4580-c69a-4882-a17a-f8a4697f33ed]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bbbd24-ef0d-4717-a601-d50f0c31c2b3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rMJWPwCz {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rMJWPwCz" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa43daeb-824e-4f2c-b22a-bfd94b4f3da6]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rMJWPwCz'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[86001ce1-cb25-456c-a13c-e84152fc2592]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbf05f1-bbd8-48c1-90f6-f60bd225cc72]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 19:00:58 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 19:00:58 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[808142f5-3533-4dc2-a5ee-e0c958dfc2ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6, portal: 172.16.0.220,3260]
Nov 18 19:00:58 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6, portal: 172.16.0.220,3260] successful.
Nov 18 19:00:58 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dfbad9-e77e-4867-81d2-f9e461fa0624]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1479a01c-83ff-4715-bf32-068685bbf218]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 19:00:58 user nova-compute[74692]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:00:58 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 19:00:58 user nova-compute[74692]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:00:58 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa2666c-561f-49e5-81b4-f58ec002c25b]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:00:58 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rMJWPwCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23136386534343363', 'path': '/dev/sdc'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136386534343363', 'path': '/dev/sdc'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:00:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1367858043',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1367858043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1367858043',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQfzZ+/xGmBFj4CIP214/OdjGr8N+l2HRk1amFoOI8HMVeF6C1z3MXx7X6q5QvkKm9RO+DT/nltnFSP2o0Eqy8d/QoQBBtNVTU5LbNU61h5L18ZYlXI5UDBP7nBGyYOCg==',key_name='tempest-keypair-824552383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-hcvqha2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=4519eaca-4744-49e2-a3ce-34d3a9fedc77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "address": "fa:16:3e:5b:b9:cd", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf4807d9-4e", "ovs_interfaceid": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "address": "fa:16:3e:5b:b9:cd", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf4807d9-4e", "ovs_interfaceid": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b9:cd,bridge_name='br-int',has_traffic_filtering=True,id=cf4807d9-4efb-4ed4-9d0d-37ab13d21cde,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf4807d9-4e') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG nova.objects.instance [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lazy-loading 'pci_devices' on Instance uuid 4519eaca-4744-49e2-a3ce-34d3a9fedc77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] End _get_guest_xml xml=<domain type="kvm">
Nov 18 19:00:59 user nova-compute[74692]:   <uuid>4519eaca-4744-49e2-a3ce-34d3a9fedc77</uuid>
Nov 18 19:00:59 user nova-compute[74692]:   <name>instance-0000002c</name>
Nov 18 19:00:59 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 19:00:59 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 19:00:59 user nova-compute[74692]:   <metadata>
Nov 18 19:00:59 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 19:00:59 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 19:00:59 user nova-compute[74692]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1367858043</nova:name>
Nov 18 19:00:59 user nova-compute[74692]:       <nova:creationTime>2023-11-18 19:00:58</nova:creationTime>
Nov 18 19:00:59 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 19:00:59 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 19:00:59 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 19:00:59 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 19:00:59 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 19:00:59 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 19:00:59 user nova-compute[74692]:       </nova:flavor>
Nov 18 19:00:59 user nova-compute[74692]:       <nova:owner>
Nov 18 19:00:59 user nova-compute[74692]:         <nova:user uuid="f58b7c308c3b4fa7bb4f576048ef7619">tempest-TestVolumeBootPattern-1940625728-project-member</nova:user>
Nov 18 19:00:59 user nova-compute[74692]:         <nova:project uuid="d3a60e439a714bdd8fca1ec43e2a3139">tempest-TestVolumeBootPattern-1940625728</nova:project>
Nov 18 19:00:59 user nova-compute[74692]:       </nova:owner>
Nov 18 19:00:59 user nova-compute[74692]:       <nova:ports>
Nov 18 19:00:59 user nova-compute[74692]:         <nova:port uuid="cf4807d9-4efb-4ed4-9d0d-37ab13d21cde">
Nov 18 19:00:59 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 19:00:59 user nova-compute[74692]:         </nova:port>
Nov 18 19:00:59 user nova-compute[74692]:       </nova:ports>
Nov 18 19:00:59 user nova-compute[74692]:     </nova:instance>
Nov 18 19:00:59 user nova-compute[74692]:   </metadata>
Nov 18 19:00:59 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 19:00:59 user nova-compute[74692]:     <system>
Nov 18 19:00:59 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 19:00:59 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 19:00:59 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 19:00:59 user nova-compute[74692]:       <entry name="serial">4519eaca-4744-49e2-a3ce-34d3a9fedc77</entry>
Nov 18 19:00:59 user nova-compute[74692]:       <entry name="uuid">4519eaca-4744-49e2-a3ce-34d3a9fedc77</entry>
Nov 18 19:00:59 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 19:00:59 user nova-compute[74692]:     </system>
Nov 18 19:00:59 user nova-compute[74692]:   </sysinfo>
Nov 18 19:00:59 user nova-compute[74692]:   <os>
Nov 18 19:00:59 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 19:00:59 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 19:00:59 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 19:00:59 user nova-compute[74692]:   </os>
Nov 18 19:00:59 user nova-compute[74692]:   <features>
Nov 18 19:00:59 user nova-compute[74692]:     <acpi/>
Nov 18 19:00:59 user nova-compute[74692]:     <apic/>
Nov 18 19:00:59 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 19:00:59 user nova-compute[74692]:   </features>
Nov 18 19:00:59 user nova-compute[74692]:   <clock offset="utc">
Nov 18 19:00:59 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 19:00:59 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 19:00:59 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 19:00:59 user nova-compute[74692]:   </clock>
Nov 18 19:00:59 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 19:00:59 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 19:00:59 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 19:00:59 user nova-compute[74692]:   </cpu>
Nov 18 19:00:59 user nova-compute[74692]:   <devices>
Nov 18 19:00:59 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 19:00:59 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:00:59 user nova-compute[74692]:       <source dev="/dev/sdc"/>
Nov 18 19:00:59 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 19:00:59 user nova-compute[74692]:       <serial>ca4bd948-64ab-4b37-9236-f78dda0395b6</serial>
Nov 18 19:00:59 user nova-compute[74692]:     </disk>
Nov 18 19:00:59 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 19:00:59 user nova-compute[74692]:       <mac address="fa:16:3e:5b:b9:cd"/>
Nov 18 19:00:59 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:00:59 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 19:00:59 user nova-compute[74692]:       <target dev="tapcf4807d9-4e"/>
Nov 18 19:00:59 user nova-compute[74692]:     </interface>
Nov 18 19:00:59 user nova-compute[74692]:     <serial type="pty">
Nov 18 19:00:59 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/4519eaca-4744-49e2-a3ce-34d3a9fedc77/console.log" append="off"/>
Nov 18 19:00:59 user nova-compute[74692]:     </serial>
Nov 18 19:00:59 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 19:00:59 user nova-compute[74692]:     <video>
Nov 18 19:00:59 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:00:59 user nova-compute[74692]:     </video>
Nov 18 19:00:59 user nova-compute[74692]:     <rng model="virtio">
Nov 18 19:00:59 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 19:00:59 user nova-compute[74692]:     </rng>
Nov 18 19:00:59 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 19:00:59 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 19:00:59 user nova-compute[74692]:       <stats period="10"/>
Nov 18 19:00:59 user nova-compute[74692]:     </memballoon>
Nov 18 19:00:59 user nova-compute[74692]:   </devices>
Nov 18 19:00:59 user nova-compute[74692]: </domain>
Nov 18 19:00:59 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:00:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1367858043',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1367858043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1367858043',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQfzZ+/xGmBFj4CIP214/OdjGr8N+l2HRk1amFoOI8HMVeF6C1z3MXx7X6q5QvkKm9RO+DT/nltnFSP2o0Eqy8d/QoQBBtNVTU5LbNU61h5L18ZYlXI5UDBP7nBGyYOCg==',key_name='tempest-keypair-824552383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-hcvqha2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=4519eaca-4744-49e2-a3ce-34d3a9fedc77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "address": "fa:16:3e:5b:b9:cd", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf4807d9-4e", "ovs_interfaceid": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "address": "fa:16:3e:5b:b9:cd", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf4807d9-4e", "ovs_interfaceid": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b9:cd,bridge_name='br-int',has_traffic_filtering=True,id=cf4807d9-4efb-4ed4-9d0d-37ab13d21cde,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf4807d9-4e') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG os_vif [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b9:cd,bridge_name='br-int',has_traffic_filtering=True,id=cf4807d9-4efb-4ed4-9d0d-37ab13d21cde,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf4807d9-4e') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc57013e-6feb-529c-a886-325a9ff4512d', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf4807d9-4e, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf4807d9-4e, col_values=(('qos', UUID('be9e3372-582a-4162-b3df-3b46672aee06')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf4807d9-4e, col_values=(('external_ids', {'iface-id': 'cf4807d9-4efb-4ed4-9d0d-37ab13d21cde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:b9:cd', 'vm-uuid': '4519eaca-4744-49e2-a3ce-34d3a9fedc77'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:00:59 user nova-compute[74692]: INFO os_vif [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b9:cd,bridge_name='br-int',has_traffic_filtering=True,id=cf4807d9-4efb-4ed4-9d0d-37ab13d21cde,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf4807d9-4e')
Nov 18 19:00:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:00:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] No VIF found with MAC fa:16:3e:5b:b9:cd, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:01:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-41f0ff15-3b6c-464d-b105-7ad36b8eca5e req-779072f3-c991-421f-bd67-dd0efde301fa service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Received event network-vif-plugged-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:01:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-41f0ff15-3b6c-464d-b105-7ad36b8eca5e req-779072f3-c991-421f-bd67-dd0efde301fa service nova] Acquiring lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:01:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-41f0ff15-3b6c-464d-b105-7ad36b8eca5e req-779072f3-c991-421f-bd67-dd0efde301fa service nova] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:01:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-41f0ff15-3b6c-464d-b105-7ad36b8eca5e req-779072f3-c991-421f-bd67-dd0efde301fa service nova] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:01:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-41f0ff15-3b6c-464d-b105-7ad36b8eca5e req-779072f3-c991-421f-bd67-dd0efde301fa service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] No waiting events found dispatching network-vif-plugged-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:01:01 user nova-compute[74692]: WARNING nova.compute.manager [req-41f0ff15-3b6c-464d-b105-7ad36b8eca5e req-779072f3-c991-421f-bd67-dd0efde301fa service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Received unexpected event network-vif-plugged-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde for instance with vm_state building and task_state spawning.
Nov 18 19:01:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 19:01:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 19:01:03 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Instance spawned successfully.
Nov 18 19:01:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 19:01:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:01:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:01:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:01:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:01:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:01:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:01:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:03 user nova-compute[74692]: INFO nova.compute.manager [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 18 19:01:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 19:01:03 user nova-compute[74692]: INFO nova.compute.manager [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Took 11.01 seconds to build instance.
Nov 18 19:01:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e89-768d-4b11-89bd-e7ec50356260 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.097s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:01:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-7c5e8c47-c311-4d60-adc9-65cc3852602b req-40a7b747-aa7d-4973-b458-f168735083e0 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Received event network-vif-plugged-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:01:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7c5e8c47-c311-4d60-adc9-65cc3852602b req-40a7b747-aa7d-4973-b458-f168735083e0 service nova] Acquiring lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:01:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7c5e8c47-c311-4d60-adc9-65cc3852602b req-40a7b747-aa7d-4973-b458-f168735083e0 service nova] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:01:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7c5e8c47-c311-4d60-adc9-65cc3852602b req-40a7b747-aa7d-4973-b458-f168735083e0 service nova] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:01:03 user nova-compute[74692]: DEBUG nova.compute.manager [req-7c5e8c47-c311-4d60-adc9-65cc3852602b req-40a7b747-aa7d-4973-b458-f168735083e0 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] No waiting events found dispatching network-vif-plugged-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:01:03 user nova-compute[74692]: WARNING nova.compute.manager [req-7c5e8c47-c311-4d60-adc9-65cc3852602b req-40a7b747-aa7d-4973-b458-f168735083e0 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Received unexpected event network-vif-plugged-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde for instance with vm_state active and task_state None.
Nov 18 19:01:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:01:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:01:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:01:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:01:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:01:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:01:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:01:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:01:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:01:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:01:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:01:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:01:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:01:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:01:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:01:36 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:01:36 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:01:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8612MB free_disk=25.02696990966797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:01:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:01:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:01:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5946a617-f567-4ab6-a2db-29c2c86544a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:01:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance ce2a3af7-ac82-4dca-bc25-14876d57466f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:01:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 4519eaca-4744-49e2-a3ce-34d3a9fedc77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:01:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:01:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:01:36 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:01:36 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:01:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:01:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:01:38 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:01:38 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:01:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:01:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:38 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:01:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:01:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:01:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 19:01:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:01:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:01:40 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:01:40 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid 5946a617-f567-4ab6-a2db-29c2c86544a6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:01:40 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating instance_info_cache with network_info: [{"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:01:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-5946a617-f567-4ab6-a2db-29c2c86544a6" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:01:40 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:01:40 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:01:41 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:01:41 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:01:43 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:01:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "78457b6e-547c-4134-bf25-371b71693dc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:01:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:01:55 user nova-compute[74692]: DEBUG nova.compute.manager [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 19:01:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:01:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:01:55 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 19:01:55 user nova-compute[74692]: INFO nova.compute.claims [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Claim successful on node user
Nov 18 19:01:56 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG nova.network.neutron [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 19:01:56 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 19:01:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG nova.policy [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72f6b2cabb1247d69e650a6ed73b6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d0a7206e6b44e5bc69a7114367fd3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 19:01:56 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Creating image(s)
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "/opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "/opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "/opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk 1073741824" returned: 0 in 0.048s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 19:01:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.network.neutron [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Successfully created port: e6c77aab-5452-4fd1-b0c2-836b4ab7096a {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Cannot resize image /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Ensure instance console log exists: /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.network.neutron [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Successfully updated port: e6c77aab-5452-4fd1-b0c2-836b4ab7096a {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "refresh_cache-78457b6e-547c-4134-bf25-371b71693dc1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquired lock "refresh_cache-78457b6e-547c-4134-bf25-371b71693dc1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.network.neutron [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.network.neutron [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.compute.manager [req-da77ee02-e976-4dc7-b010-23f752033786 req-804c349f-56bd-414d-935e-e3a494117580 service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Received event network-changed-e6c77aab-5452-4fd1-b0c2-836b4ab7096a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.compute.manager [req-da77ee02-e976-4dc7-b010-23f752033786 req-804c349f-56bd-414d-935e-e3a494117580 service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Refreshing instance network info cache due to event network-changed-e6c77aab-5452-4fd1-b0c2-836b4ab7096a. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-da77ee02-e976-4dc7-b010-23f752033786 req-804c349f-56bd-414d-935e-e3a494117580 service nova] Acquiring lock "refresh_cache-78457b6e-547c-4134-bf25-371b71693dc1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.network.neutron [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Updating instance_info_cache with network_info: [{"id": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "address": "fa:16:3e:f0:af:d1", "network": {"id": "cc92e7ba-2619-4498-848c-b3b8870560fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1221693540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d0a7206e6b44e5bc69a7114367fd3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c77aab-54", "ovs_interfaceid": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Releasing lock "refresh_cache-78457b6e-547c-4134-bf25-371b71693dc1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.compute.manager [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Instance network_info: |[{"id": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "address": "fa:16:3e:f0:af:d1", "network": {"id": "cc92e7ba-2619-4498-848c-b3b8870560fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1221693540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d0a7206e6b44e5bc69a7114367fd3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c77aab-54", "ovs_interfaceid": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-da77ee02-e976-4dc7-b010-23f752033786 req-804c349f-56bd-414d-935e-e3a494117580 service nova] Acquired lock "refresh_cache-78457b6e-547c-4134-bf25-371b71693dc1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.network.neutron [req-da77ee02-e976-4dc7-b010-23f752033786 req-804c349f-56bd-414d-935e-e3a494117580 service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Refreshing network info cache for port e6c77aab-5452-4fd1-b0c2-836b4ab7096a {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Start _get_guest_xml network_info=[{"id": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "address": "fa:16:3e:f0:af:d1", "network": {"id": "cc92e7ba-2619-4498-848c-b3b8870560fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1221693540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d0a7206e6b44e5bc69a7114367fd3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c77aab-54", "ovs_interfaceid": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 19:01:57 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:01:57 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 19:01:57 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-284024118',display_name='tempest-TestServerVolumeAttachmentScenario-server-284024118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-284024118',id=45,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5RoRk669ttuI5VtMXiPeVYgay7SJqqV4p/PD2myMk+TtzMm5+l0XKQOwsP6vLQP37DT03OO0ikxZp7GBmHj2qRNRxfuvojrZcAScYuyx+yfIVQh+j7w2A7iL7Ibq9Yqw==',key_name='tempest-keypair-1401671269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81d0a7206e6b44e5bc69a7114367fd3d',ramdisk_id='',reservation_id='r-xvuckoj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-835258081',owner_user_name='tempest-TestServerVolumeAttachmentScenario-835258081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:01:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f6b2cabb1247d69e650a6ed73b6dd4',uuid=78457b6e-547c-4134-bf25-371b71693dc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "address": "fa:16:3e:f0:af:d1", "network": {"id": "cc92e7ba-2619-4498-848c-b3b8870560fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1221693540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d0a7206e6b44e5bc69a7114367fd3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c77aab-54", "ovs_interfaceid": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Converting VIF {"id": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "address": "fa:16:3e:f0:af:d1", "network": {"id": "cc92e7ba-2619-4498-848c-b3b8870560fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1221693540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d0a7206e6b44e5bc69a7114367fd3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c77aab-54", "ovs_interfaceid": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:af:d1,bridge_name='br-int',has_traffic_filtering=True,id=e6c77aab-5452-4fd1-b0c2-836b4ab7096a,network=Network(cc92e7ba-2619-4498-848c-b3b8870560fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c77aab-54') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.objects.instance [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lazy-loading 'pci_devices' on Instance uuid 78457b6e-547c-4134-bf25-371b71693dc1 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] End _get_guest_xml xml=<domain type="kvm">
Nov 18 19:01:58 user nova-compute[74692]:   <uuid>78457b6e-547c-4134-bf25-371b71693dc1</uuid>
Nov 18 19:01:58 user nova-compute[74692]:   <name>instance-0000002d</name>
Nov 18 19:01:58 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 19:01:58 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 19:01:58 user nova-compute[74692]:   <metadata>
Nov 18 19:01:58 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 19:01:58 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 19:01:58 user nova-compute[74692]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-284024118</nova:name>
Nov 18 19:01:58 user nova-compute[74692]:       <nova:creationTime>2023-11-18 19:01:57</nova:creationTime>
Nov 18 19:01:58 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 19:01:58 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 19:01:58 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 19:01:58 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 19:01:58 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 19:01:58 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 19:01:58 user nova-compute[74692]:       </nova:flavor>
Nov 18 19:01:58 user nova-compute[74692]:       <nova:owner>
Nov 18 19:01:58 user nova-compute[74692]:         <nova:user uuid="72f6b2cabb1247d69e650a6ed73b6dd4">tempest-TestServerVolumeAttachmentScenario-835258081-project-member</nova:user>
Nov 18 19:01:58 user nova-compute[74692]:         <nova:project uuid="81d0a7206e6b44e5bc69a7114367fd3d">tempest-TestServerVolumeAttachmentScenario-835258081</nova:project>
Nov 18 19:01:58 user nova-compute[74692]:       </nova:owner>
Nov 18 19:01:58 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 19:01:58 user nova-compute[74692]:       <nova:ports>
Nov 18 19:01:58 user nova-compute[74692]:         <nova:port uuid="e6c77aab-5452-4fd1-b0c2-836b4ab7096a">
Nov 18 19:01:58 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 18 19:01:58 user nova-compute[74692]:         </nova:port>
Nov 18 19:01:58 user nova-compute[74692]:       </nova:ports>
Nov 18 19:01:58 user nova-compute[74692]:     </nova:instance>
Nov 18 19:01:58 user nova-compute[74692]:   </metadata>
Nov 18 19:01:58 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 19:01:58 user nova-compute[74692]:     <system>
Nov 18 19:01:58 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 19:01:58 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 19:01:58 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 19:01:58 user nova-compute[74692]:       <entry name="serial">78457b6e-547c-4134-bf25-371b71693dc1</entry>
Nov 18 19:01:58 user nova-compute[74692]:       <entry name="uuid">78457b6e-547c-4134-bf25-371b71693dc1</entry>
Nov 18 19:01:58 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 19:01:58 user nova-compute[74692]:     </system>
Nov 18 19:01:58 user nova-compute[74692]:   </sysinfo>
Nov 18 19:01:58 user nova-compute[74692]:   <os>
Nov 18 19:01:58 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 19:01:58 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 19:01:58 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 19:01:58 user nova-compute[74692]:   </os>
Nov 18 19:01:58 user nova-compute[74692]:   <features>
Nov 18 19:01:58 user nova-compute[74692]:     <acpi/>
Nov 18 19:01:58 user nova-compute[74692]:     <apic/>
Nov 18 19:01:58 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 19:01:58 user nova-compute[74692]:   </features>
Nov 18 19:01:58 user nova-compute[74692]:   <clock offset="utc">
Nov 18 19:01:58 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 19:01:58 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 19:01:58 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 19:01:58 user nova-compute[74692]:   </clock>
Nov 18 19:01:58 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 19:01:58 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 19:01:58 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 19:01:58 user nova-compute[74692]:   </cpu>
Nov 18 19:01:58 user nova-compute[74692]:   <devices>
Nov 18 19:01:58 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 19:01:58 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 19:01:58 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk"/>
Nov 18 19:01:58 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 19:01:58 user nova-compute[74692]:     </disk>
Nov 18 19:01:58 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 19:01:58 user nova-compute[74692]:       <mac address="fa:16:3e:f0:af:d1"/>
Nov 18 19:01:58 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:01:58 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 19:01:58 user nova-compute[74692]:       <target dev="tape6c77aab-54"/>
Nov 18 19:01:58 user nova-compute[74692]:     </interface>
Nov 18 19:01:58 user nova-compute[74692]:     <serial type="pty">
Nov 18 19:01:58 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/console.log" append="off"/>
Nov 18 19:01:58 user nova-compute[74692]:     </serial>
Nov 18 19:01:58 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 19:01:58 user nova-compute[74692]:     <video>
Nov 18 19:01:58 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:01:58 user nova-compute[74692]:     </video>
Nov 18 19:01:58 user nova-compute[74692]:     <rng model="virtio">
Nov 18 19:01:58 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 19:01:58 user nova-compute[74692]:     </rng>
Nov 18 19:01:58 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 19:01:58 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 19:01:58 user nova-compute[74692]:       <stats period="10"/>
Nov 18 19:01:58 user nova-compute[74692]:     </memballoon>
Nov 18 19:01:58 user nova-compute[74692]:   </devices>
Nov 18 19:01:58 user nova-compute[74692]: </domain>
Nov 18 19:01:58 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-284024118',display_name='tempest-TestServerVolumeAttachmentScenario-server-284024118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-284024118',id=45,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5RoRk669ttuI5VtMXiPeVYgay7SJqqV4p/PD2myMk+TtzMm5+l0XKQOwsP6vLQP37DT03OO0ikxZp7GBmHj2qRNRxfuvojrZcAScYuyx+yfIVQh+j7w2A7iL7Ibq9Yqw==',key_name='tempest-keypair-1401671269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81d0a7206e6b44e5bc69a7114367fd3d',ramdisk_id='',reservation_id='r-xvuckoj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-835258081',owner_user_name='tempest-TestServerVolumeAttachmentScenario-835258081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:01:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f6b2cabb1247d69e650a6ed73b6dd4',uuid=78457b6e-547c-4134-bf25-371b71693dc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "address": "fa:16:3e:f0:af:d1", "network": {"id": "cc92e7ba-2619-4498-848c-b3b8870560fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1221693540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d0a7206e6b44e5bc69a7114367fd3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c77aab-54", "ovs_interfaceid": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Converting VIF {"id": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "address": "fa:16:3e:f0:af:d1", "network": {"id": "cc92e7ba-2619-4498-848c-b3b8870560fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1221693540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d0a7206e6b44e5bc69a7114367fd3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c77aab-54", "ovs_interfaceid": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:af:d1,bridge_name='br-int',has_traffic_filtering=True,id=e6c77aab-5452-4fd1-b0c2-836b4ab7096a,network=Network(cc92e7ba-2619-4498-848c-b3b8870560fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c77aab-54') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG os_vif [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:af:d1,bridge_name='br-int',has_traffic_filtering=True,id=e6c77aab-5452-4fd1-b0c2-836b4ab7096a,network=Network(cc92e7ba-2619-4498-848c-b3b8870560fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c77aab-54') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d362ff8-6c2e-5b43-a728-a191df8ed64e', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6c77aab-54, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6c77aab-54, col_values=(('qos', UUID('9ef8347f-1dd5-4a04-b351-c4157287f1dd')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6c77aab-54, col_values=(('external_ids', {'iface-id': 'e6c77aab-5452-4fd1-b0c2-836b4ab7096a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:af:d1', 'vm-uuid': '78457b6e-547c-4134-bf25-371b71693dc1'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:58 user nova-compute[74692]: INFO os_vif [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:af:d1,bridge_name='br-int',has_traffic_filtering=True,id=e6c77aab-5452-4fd1-b0c2-836b4ab7096a,network=Network(cc92e7ba-2619-4498-848c-b3b8870560fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c77aab-54')
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] No VIF found with MAC fa:16:3e:f0:af:d1, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.network.neutron [req-da77ee02-e976-4dc7-b010-23f752033786 req-804c349f-56bd-414d-935e-e3a494117580 service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Updated VIF entry in instance network info cache for port e6c77aab-5452-4fd1-b0c2-836b4ab7096a. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG nova.network.neutron [req-da77ee02-e976-4dc7-b010-23f752033786 req-804c349f-56bd-414d-935e-e3a494117580 service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Updating instance_info_cache with network_info: [{"id": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "address": "fa:16:3e:f0:af:d1", "network": {"id": "cc92e7ba-2619-4498-848c-b3b8870560fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1221693540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d0a7206e6b44e5bc69a7114367fd3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c77aab-54", "ovs_interfaceid": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:01:58 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-da77ee02-e976-4dc7-b010-23f752033786 req-804c349f-56bd-414d-935e-e3a494117580 service nova] Releasing lock "refresh_cache-78457b6e-547c-4134-bf25-371b71693dc1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:01:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-43d51069-f46e-492c-8b97-05b1b3d2ea12 req-085abcbe-ec1f-41e9-ae24-0f00ac8b168a service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Received event network-vif-plugged-e6c77aab-5452-4fd1-b0c2-836b4ab7096a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:01:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-43d51069-f46e-492c-8b97-05b1b3d2ea12 req-085abcbe-ec1f-41e9-ae24-0f00ac8b168a service nova] Acquiring lock "78457b6e-547c-4134-bf25-371b71693dc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:01:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-43d51069-f46e-492c-8b97-05b1b3d2ea12 req-085abcbe-ec1f-41e9-ae24-0f00ac8b168a service nova] Lock "78457b6e-547c-4134-bf25-371b71693dc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:01:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-43d51069-f46e-492c-8b97-05b1b3d2ea12 req-085abcbe-ec1f-41e9-ae24-0f00ac8b168a service nova] Lock "78457b6e-547c-4134-bf25-371b71693dc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:01:59 user nova-compute[74692]: DEBUG nova.compute.manager [req-43d51069-f46e-492c-8b97-05b1b3d2ea12 req-085abcbe-ec1f-41e9-ae24-0f00ac8b168a service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] No waiting events found dispatching network-vif-plugged-e6c77aab-5452-4fd1-b0c2-836b4ab7096a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:01:59 user nova-compute[74692]: WARNING nova.compute.manager [req-43d51069-f46e-492c-8b97-05b1b3d2ea12 req-085abcbe-ec1f-41e9-ae24-0f00ac8b168a service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Received unexpected event network-vif-plugged-e6c77aab-5452-4fd1-b0c2-836b4ab7096a for instance with vm_state building and task_state spawning.
Nov 18 19:01:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:01:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 19:02:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 19:02:01 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Instance spawned successfully.
Nov 18 19:02:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 19:02:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:02:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:02:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:02:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:02:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:02:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:02:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-5579f0b6-04ec-4c4f-8f59-3caebed39767 req-e47627f5-b3ce-4fe9-af07-9cf364a4f08b service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Received event network-vif-plugged-e6c77aab-5452-4fd1-b0c2-836b4ab7096a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:02:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5579f0b6-04ec-4c4f-8f59-3caebed39767 req-e47627f5-b3ce-4fe9-af07-9cf364a4f08b service nova] Acquiring lock "78457b6e-547c-4134-bf25-371b71693dc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:02:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5579f0b6-04ec-4c4f-8f59-3caebed39767 req-e47627f5-b3ce-4fe9-af07-9cf364a4f08b service nova] Lock "78457b6e-547c-4134-bf25-371b71693dc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:02:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5579f0b6-04ec-4c4f-8f59-3caebed39767 req-e47627f5-b3ce-4fe9-af07-9cf364a4f08b service nova] Lock "78457b6e-547c-4134-bf25-371b71693dc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:02:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-5579f0b6-04ec-4c4f-8f59-3caebed39767 req-e47627f5-b3ce-4fe9-af07-9cf364a4f08b service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] No waiting events found dispatching network-vif-plugged-e6c77aab-5452-4fd1-b0c2-836b4ab7096a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:02:01 user nova-compute[74692]: WARNING nova.compute.manager [req-5579f0b6-04ec-4c4f-8f59-3caebed39767 req-e47627f5-b3ce-4fe9-af07-9cf364a4f08b service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Received unexpected event network-vif-plugged-e6c77aab-5452-4fd1-b0c2-836b4ab7096a for instance with vm_state building and task_state spawning.
Nov 18 19:02:01 user nova-compute[74692]: INFO nova.compute.manager [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 18 19:02:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 19:02:01 user nova-compute[74692]: INFO nova.compute.manager [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Took 5.79 seconds to build instance.
Nov 18 19:02:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-416ac755-02a7-49d5-a5a2-07d98438fb90 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.886s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:02:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:02:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.007s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:02:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:02:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:02:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:02:03 user nova-compute[74692]: INFO nova.compute.manager [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Terminating instance
Nov 18 19:02:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 19:02:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-883ab652-7611-4ac7-82b0-968d7234798a req-fa916f73-e357-4260-a420-80f183a1353e service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-vif-unplugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-883ab652-7611-4ac7-82b0-968d7234798a req-fa916f73-e357-4260-a420-80f183a1353e service nova] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-883ab652-7611-4ac7-82b0-968d7234798a req-fa916f73-e357-4260-a420-80f183a1353e service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-883ab652-7611-4ac7-82b0-968d7234798a req-fa916f73-e357-4260-a420-80f183a1353e service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-883ab652-7611-4ac7-82b0-968d7234798a req-fa916f73-e357-4260-a420-80f183a1353e service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] No waiting events found dispatching network-vif-unplugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-883ab652-7611-4ac7-82b0-968d7234798a req-fa916f73-e357-4260-a420-80f183a1353e service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-vif-unplugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 19:02:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Instance destroyed successfully.
Nov 18 19:02:04 user nova-compute[74692]: DEBUG nova.objects.instance [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lazy-loading 'resources' on Instance uuid 5946a617-f567-4ab6-a2db-29c2c86544a6 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T18:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-675233857',display_name='tempest-ServerActionsTestOtherB-server-675233857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-675233857',id=37,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ44427Z/m0lH604ZCZCT3wxxkPLCJECR2dRCAhCy9jp32w/HG5k9bXDcxq0dLrD4N0NbsbYxgMfyC4dHsM3g1rzNAEweUIJRjnGxWc9qXCJAk0Y2gFT55F56wQDpzJ2w==',key_name='tempest-keypair-1851665456',keypairs=<?>,launch_index=0,launched_at=2023-11-18T18:59:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e622388d2bbe41a0ba6a5fb42c494a96',ramdisk_id='',reservation_id='r-y4r329pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-461353456',owner_user_name='tempest-ServerActionsTestOtherB-461353456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T18:59:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e28b31fb4e1b45fdae81ac6c9d512c95',uuid=5946a617-f567-4ab6-a2db-29c2c86544a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converting VIF {"id": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "address": "fa:16:3e:44:c1:a3", "network": {"id": "57e03c6f-17c3-4b0e-82ae-de2325f8e1b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2140056775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e622388d2bbe41a0ba6a5fb42c494a96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f70b63-f3", "ovs_interfaceid": "38f70b63-f3b8-41f4-b96a-0c87108ccd85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_vif [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38f70b63-f3, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=058cf07b-0b04-4f8d-8921-1b12be8b3f2e) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:02:04 user nova-compute[74692]: INFO os_vif [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:c1:a3,bridge_name='br-int',has_traffic_filtering=True,id=38f70b63-f3b8-41f4-b96a-0c87108ccd85,network=Network(57e03c6f-17c3-4b0e-82ae-de2325f8e1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f70b63-f3')
Nov 18 19:02:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGlOzbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:02:04 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b009c720-6be8-49b1-ad5e-2d26e08be82d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:02:04 user nova-compute[74692]: No targets found.
Nov 18 19:02:04 user nova-compute[74692]: iSNS:
Nov 18 19:02:04 user nova-compute[74692]: No targets found.
Nov 18 19:02:04 user nova-compute[74692]: STATIC:
Nov 18 19:02:04 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6
Nov 18 19:02:04 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:02:04 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:02:04 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823
Nov 18 19:02:04 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:02:04 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:02:04 user nova-compute[74692]: FIRMWARE:
Nov 18 19:02:04 user nova-compute[74692]: No targets found.
Nov 18 19:02:04 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:02:04 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:02:04 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8c5686-e98d-4015-a453-44c64f1547f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[01538b5e-9d59-458a-8850-21a521aaf1d7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 19:02:04 user nova-compute[74692]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:02:04 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 (non-flash)
Nov 18 19:02:04 user nova-compute[74692]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:02:04 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c46204c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e97205-e865-4a30-afb8-c6a91bce0d16]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0af462-5a4a-4f36-92c5-64b68346528a]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb64fa4-774e-4d42-a2e1-9d9677c0d863]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74fab02-43ca-4201-ab06-9398a4fd0d9b]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[216e87ad-88bf-4bc4-9f0e-73ac832a406f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3253b7-d6a2-4733-9251-fab86c5f574b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260]
Nov 18 19:02:04 user nova-compute[74692]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823, portal: 172.16.0.220,3260] successful.
Nov 18 19:02:04 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e9e32f-0bbb-4b9f-9850-cedc8bd47823 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe8faf7-fb8f-4b6c-8ba5-dbd42a925dab]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] <== disconnect_volume: return (314ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:02:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Deleting instance files /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6_del
Nov 18 19:02:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Deletion of /opt/stack/data/nova/instances/5946a617-f567-4ab6-a2db-29c2c86544a6_del complete
Nov 18 19:02:04 user nova-compute[74692]: INFO nova.compute.manager [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 18 19:02:04 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 19:02:04 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 19:02:05 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:02:05 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Took 0.96 seconds to deallocate network for instance.
Nov 18 19:02:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-045dcc94-990d-4227-b2c9-6f6ff1a08949 req-b0767d2a-4257-48a9-a9d4-a2a4d4a84781 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:02:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-045dcc94-990d-4227-b2c9-6f6ff1a08949 req-b0767d2a-4257-48a9-a9d4-a2a4d4a84781 service nova] Acquiring lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:02:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-045dcc94-990d-4227-b2c9-6f6ff1a08949 req-b0767d2a-4257-48a9-a9d4-a2a4d4a84781 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:02:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-045dcc94-990d-4227-b2c9-6f6ff1a08949 req-b0767d2a-4257-48a9-a9d4-a2a4d4a84781 service nova] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:02:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-045dcc94-990d-4227-b2c9-6f6ff1a08949 req-b0767d2a-4257-48a9-a9d4-a2a4d4a84781 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] No waiting events found dispatching network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:02:06 user nova-compute[74692]: WARNING nova.compute.manager [req-045dcc94-990d-4227-b2c9-6f6ff1a08949 req-b0767d2a-4257-48a9-a9d4-a2a4d4a84781 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received unexpected event network-vif-plugged-38f70b63-f3b8-41f4-b96a-0c87108ccd85 for instance with vm_state active and task_state deleting.
Nov 18 19:02:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-045dcc94-990d-4227-b2c9-6f6ff1a08949 req-b0767d2a-4257-48a9-a9d4-a2a4d4a84781 service nova] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Received event network-vif-deleted-38f70b63-f3b8-41f4-b96a-0c87108ccd85 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:02:06 user nova-compute[74692]: INFO nova.compute.manager [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] [instance: 5946a617-f567-4ab6-a2db-29c2c86544a6] Took 1.00 seconds to detach 1 volumes for instance.
Nov 18 19:02:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:02:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:02:07 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:02:07 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:02:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:02:07 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Deleted allocations for instance 5946a617-f567-4ab6-a2db-29c2c86544a6
Nov 18 19:02:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-89d6d2b1-8045-416b-bb2d-1b2c2fe8c718 tempest-ServerActionsTestOtherB-461353456 tempest-ServerActionsTestOtherB-461353456-project-member] Lock "5946a617-f567-4ab6-a2db-29c2c86544a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.547s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:02:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-256058b1-9f07-470b-abb8-5b18840846d1 req-de7cf6b0-7197-466c-acd3-ae77956aa1df service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Received event network-changed-60aa7752-8dff-4325-b95f-ae6d2ab82f49 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:02:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-256058b1-9f07-470b-abb8-5b18840846d1 req-de7cf6b0-7197-466c-acd3-ae77956aa1df service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Refreshing instance network info cache due to event network-changed-60aa7752-8dff-4325-b95f-ae6d2ab82f49. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:02:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-256058b1-9f07-470b-abb8-5b18840846d1 req-de7cf6b0-7197-466c-acd3-ae77956aa1df service nova] Acquiring lock "refresh_cache-ce2a3af7-ac82-4dca-bc25-14876d57466f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:02:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-256058b1-9f07-470b-abb8-5b18840846d1 req-de7cf6b0-7197-466c-acd3-ae77956aa1df service nova] Acquired lock "refresh_cache-ce2a3af7-ac82-4dca-bc25-14876d57466f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:02:16 user nova-compute[74692]: DEBUG nova.network.neutron [req-256058b1-9f07-470b-abb8-5b18840846d1 req-de7cf6b0-7197-466c-acd3-ae77956aa1df service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Refreshing network info cache for port 60aa7752-8dff-4325-b95f-ae6d2ab82f49 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:02:16 user nova-compute[74692]: DEBUG nova.network.neutron [req-256058b1-9f07-470b-abb8-5b18840846d1 req-de7cf6b0-7197-466c-acd3-ae77956aa1df service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Updated VIF entry in instance network info cache for port 60aa7752-8dff-4325-b95f-ae6d2ab82f49. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:02:16 user nova-compute[74692]: DEBUG nova.network.neutron [req-256058b1-9f07-470b-abb8-5b18840846d1 req-de7cf6b0-7197-466c-acd3-ae77956aa1df service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Updating instance_info_cache with network_info: [{"id": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "address": "fa:16:3e:a7:ae:37", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7752-8d", "ovs_interfaceid": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:02:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-256058b1-9f07-470b-abb8-5b18840846d1 req-de7cf6b0-7197-466c-acd3-ae77956aa1df service nova] Releasing lock "refresh_cache-ce2a3af7-ac82-4dca-bc25-14876d57466f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:02:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "ce2a3af7-ac82-4dca-bc25-14876d57466f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:02:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:02:18 user nova-compute[74692]: DEBUG nova.objects.instance [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'flavor' on Instance uuid ce2a3af7-ac82-4dca-bc25-14876d57466f {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:02:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "ce2a3af7-ac82-4dca-bc25-14876d57466f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:02:19 user nova-compute[74692]: INFO nova.compute.manager [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Attaching volume 540c6538-9701-447d-887a-0602ff902da8 to /dev/vdb
Nov 18 19:02:19 user nova-compute[74692]: DEBUG os_brick.utils [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[993e87fe-fa8f-4332-84a1-f0b831216b2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02f28ba-009e-4414-a67a-37f318bdf553]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeef799-418a-47e6-b9ae-350317a7c5e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfaa8e4-ffa8-427a-a77d-63833f6d77ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:02:19 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 19:02:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3cf056-c1fc-4126-b046-c4e8887d9437]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG os_brick.utils [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Updating existing volume attachment record: 7a2f9e66-890b-4aa2-8685-a1f3c52b8861 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 19:02:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZKJCGik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:02:24 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:02:24 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:02:24 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa42c8f-9632-4efc-bdbc-322d2768eec3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 19:02:24 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8368604f-b9c9-40de-9146-f89401dcefc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8] added
Nov 18 19:02:24 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3914385-73ef-4aa0-bcda-02489d379982]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba95baf-20e9-4c51-9df7-8055a248fec8]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XZKJCGik {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XZKJCGik" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b511dc-fb71-46b1-853a-052b25b2a48d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XZKJCGik'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef92126b-7a49-497f-abfd-0d16852242d6]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[66320d0d-9f20-4e73-9486-48cdad3b682d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:02:24 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:02:24 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db5d6cd-8b3e-4783-a044-f6837b299953]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8, portal: 172.16.0.220,3260]
Nov 18 19:02:24 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8, portal: 172.16.0.220,3260] successful.
Nov 18 19:02:24 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a98662-3e7a-4424-ab70-1898ac86eab8]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ff073b-65d1-46e7-87fb-824dd4bb5f88]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:02:24 user nova-compute[74692]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 (non-flash)
Nov 18 19:02:24 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:02:24 user nova-compute[74692]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 (non-flash)
Nov 18 19:02:24 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[06561a35-fa5b-46f0-8ab9-478fe9351d87]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:02:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZKJCGik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 19:02:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:02:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26432343932363438', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:02:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432343932363438', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 19:02:25 user nova-compute[74692]: DEBUG nova.objects.instance [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'flavor' on Instance uuid ce2a3af7-ac82-4dca-bc25-14876d57466f {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:02:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 19:02:25 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:02:25 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:02:25 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:02:25 user nova-compute[74692]:   <serial>540c6538-9701-447d-887a-0602ff902da8</serial>
Nov 18 19:02:25 user nova-compute[74692]: </disk>
Nov 18 19:02:25 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 19:02:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:02:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:02:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No VIF found with MAC fa:16:3e:a7:ae:37, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:02:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-62d9800a-b684-4128-bd3a-5f9efbbc8fbc tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.421s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:02:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "ce2a3af7-ac82-4dca-bc25-14876d57466f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:02:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:02:26 user nova-compute[74692]: INFO nova.compute.manager [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Detaching volume 540c6538-9701-447d-887a-0602ff902da8
Nov 18 19:02:26 user nova-compute[74692]: INFO nova.virt.block_device [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Attempting to driver detach volume 540c6538-9701-447d-887a-0602ff902da8 from mountpoint /dev/vdb
Nov 18 19:02:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Attempting to detach device vdb from instance ce2a3af7-ac82-4dca-bc25-14876d57466f from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 19:02:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:02:26 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:02:26 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:02:26 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:02:26 user nova-compute[74692]:   <serial>540c6538-9701-447d-887a-0602ff902da8</serial>
Nov 18 19:02:26 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:02:26 user nova-compute[74692]: </disk>
Nov 18 19:02:26 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:02:26 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Successfully detached device vdb from instance ce2a3af7-ac82-4dca-bc25-14876d57466f from the persistent domain config.
Nov 18 19:02:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce2a3af7-ac82-4dca-bc25-14876d57466f from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 19:02:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:02:26 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:02:26 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:02:26 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:02:26 user nova-compute[74692]:   <serial>540c6538-9701-447d-887a-0602ff902da8</serial>
Nov 18 19:02:26 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:02:26 user nova-compute[74692]: </disk>
Nov 18 19:02:26 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:02:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce2a3af7-ac82-4dca-bc25-14876d57466f {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 19:02:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:02:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:02:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:02:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:02:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:02:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:02:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:02:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:36 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:02:36 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:02:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8625MB free_disk=25.023521423339844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:02:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:02:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:02:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance ce2a3af7-ac82-4dca-bc25-14876d57466f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:02:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 4519eaca-4744-49e2-a3ce-34d3a9fedc77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:02:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 78457b6e-547c-4134-bf25-371b71693dc1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:02:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:02:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:02:36 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:02:36 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:02:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:02:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:02:38 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:02:38 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:02:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:02:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:02:41 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:02:41 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:02:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-ce2a3af7-ac82-4dca-bc25-14876d57466f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:02:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-ce2a3af7-ac82-4dca-bc25-14876d57466f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:02:42 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:02:42 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Updating instance_info_cache with network_info: [{"id": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "address": "fa:16:3e:a7:ae:37", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7752-8d", "ovs_interfaceid": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:02:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-ce2a3af7-ac82-4dca-bc25-14876d57466f" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:02:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:02:42 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:02:42 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:02:42 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:02:43 user nova-compute[74692]: DEBUG nova.compute.manager [req-a5d423ed-3801-4d8d-9a69-d025b90045db req-4219f217-f871-4479-a5c9-dc1a9d681b21 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Received event network-changed-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:02:43 user nova-compute[74692]: DEBUG nova.compute.manager [req-a5d423ed-3801-4d8d-9a69-d025b90045db req-4219f217-f871-4479-a5c9-dc1a9d681b21 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Refreshing instance network info cache due to event network-changed-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:02:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a5d423ed-3801-4d8d-9a69-d025b90045db req-4219f217-f871-4479-a5c9-dc1a9d681b21 service nova] Acquiring lock "refresh_cache-4519eaca-4744-49e2-a3ce-34d3a9fedc77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:02:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a5d423ed-3801-4d8d-9a69-d025b90045db req-4219f217-f871-4479-a5c9-dc1a9d681b21 service nova] Acquired lock "refresh_cache-4519eaca-4744-49e2-a3ce-34d3a9fedc77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:02:43 user nova-compute[74692]: DEBUG nova.network.neutron [req-a5d423ed-3801-4d8d-9a69-d025b90045db req-4219f217-f871-4479-a5c9-dc1a9d681b21 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Refreshing network info cache for port cf4807d9-4efb-4ed4-9d0d-37ab13d21cde {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:02:43 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:02:44 user nova-compute[74692]: DEBUG nova.network.neutron [req-a5d423ed-3801-4d8d-9a69-d025b90045db req-4219f217-f871-4479-a5c9-dc1a9d681b21 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Updated VIF entry in instance network info cache for port cf4807d9-4efb-4ed4-9d0d-37ab13d21cde. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:02:44 user nova-compute[74692]: DEBUG nova.network.neutron [req-a5d423ed-3801-4d8d-9a69-d025b90045db req-4219f217-f871-4479-a5c9-dc1a9d681b21 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Updating instance_info_cache with network_info: [{"id": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "address": "fa:16:3e:5b:b9:cd", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf4807d9-4e", "ovs_interfaceid": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:02:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a5d423ed-3801-4d8d-9a69-d025b90045db req-4219f217-f871-4479-a5c9-dc1a9d681b21 service nova] Releasing lock "refresh_cache-4519eaca-4744-49e2-a3ce-34d3a9fedc77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:02:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:47 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce2a3af7-ac82-4dca-bc25-14876d57466f is timed out.
Nov 18 19:02:47 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Successfully detached device vdb from instance ce2a3af7-ac82-4dca-bc25-14876d57466f from the live domain config.
Nov 18 19:02:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZKJCGik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:02:47 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[36746707-89ff-4548-a5fd-2b16603c3d5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:02:47 user nova-compute[74692]: No targets found.
Nov 18 19:02:47 user nova-compute[74692]: iSNS:
Nov 18 19:02:47 user nova-compute[74692]: No targets found.
Nov 18 19:02:47 user nova-compute[74692]: STATIC:
Nov 18 19:02:47 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8
Nov 18 19:02:47 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:02:47 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:02:47 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6
Nov 18 19:02:47 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:02:47 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:02:47 user nova-compute[74692]: FIRMWARE:
Nov 18 19:02:47 user nova-compute[74692]: No targets found.
Nov 18 19:02:47 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:02:47 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:02:47 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c78abec-b1f7-44fb-a0e6-b90a6b620fc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dbc3b4-f970-4eaf-bcc6-8c183c088d18]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:02:47 user nova-compute[74692]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 (non-flash)
Nov 18 19:02:47 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:02:47 user nova-compute[74692]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 (non-flash)
Nov 18 19:02:47 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a45ac310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2491462c-6bff-44a4-8aa4-a6af3657b76f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffbdf77-16c4-4118-a4bc-5f72061a2905]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2467b6c-d6d7-4877-9c17-ec49b4bbc51d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff784280-0a2f-4294-83e0-fba6f36252cd]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4eb622-789e-4a8b-90c9-75b307b55cfc]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[51428bb9-3fae-47c6-b94a-95c347f3f349]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8, portal: 172.16.0.220,3260]
Nov 18 19:02:47 user nova-compute[74692]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8, portal: 172.16.0.220,3260] successful.
Nov 18 19:02:47 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540c6538-9701-447d-887a-0602ff902da8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6cb754-7236-47e7-89f3-80cff74aa537]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] <== disconnect_volume: return (302ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:02:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:48 user nova-compute[74692]: DEBUG nova.objects.instance [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'flavor' on Instance uuid ce2a3af7-ac82-4dca-bc25-14876d57466f {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:02:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-76a5d756-d0f2-4f05-87e0-9d8ca960413e tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.608s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:02:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:02:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:02:50 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 19:02:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:02:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:02:50 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 19:02:50 user nova-compute[74692]: INFO nova.compute.claims [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Claim successful on node user
Nov 18 19:02:50 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:02:50 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:02:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:02:50 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 19:02:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 19:02:50 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 19:02:50 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 19:02:50 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 19:02:50 user nova-compute[74692]: INFO nova.virt.block_device [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Booting with volume snapshot 5943dfa7-8595-4460-b50a-8d4870ca8a2d at /dev/vda
Nov 18 19:02:51 user nova-compute[74692]: DEBUG nova.policy [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f58b7c308c3b4fa7bb4f576048ef7619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a60e439a714bdd8fca1ec43e2a3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 19:02:51 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Successfully created port: 1db65409-17e5-4526-b1f2-c15fd1ba41a1 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Successfully updated port: 1db65409-17e5-4526-b1f2-c15fd1ba41a1 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "refresh_cache-ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquired lock "refresh_cache-ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-5a4cbb1a-d04e-499f-bf4d-d1a23a34710b req-f54f888f-2009-41a2-a4ed-a42b80bfbc7b service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Received event network-changed-1db65409-17e5-4526-b1f2-c15fd1ba41a1 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-5a4cbb1a-d04e-499f-bf4d-d1a23a34710b req-f54f888f-2009-41a2-a4ed-a42b80bfbc7b service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Refreshing instance network info cache due to event network-changed-1db65409-17e5-4526-b1f2-c15fd1ba41a1. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5a4cbb1a-d04e-499f-bf4d-d1a23a34710b req-f54f888f-2009-41a2-a4ed-a42b80bfbc7b service nova] Acquiring lock "refresh_cache-ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG nova.network.neutron [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Updating instance_info_cache with network_info: [{"id": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "address": "fa:16:3e:61:55:73", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db65409-17", "ovs_interfaceid": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Releasing lock "refresh_cache-ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Instance network_info: |[{"id": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "address": "fa:16:3e:61:55:73", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db65409-17", "ovs_interfaceid": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5a4cbb1a-d04e-499f-bf4d-d1a23a34710b req-f54f888f-2009-41a2-a4ed-a42b80bfbc7b service nova] Acquired lock "refresh_cache-ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG nova.network.neutron [req-5a4cbb1a-d04e-499f-bf4d-d1a23a34710b req-f54f888f-2009-41a2-a4ed-a42b80bfbc7b service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Refreshing network info cache for port 1db65409-17e5-4526-b1f2-c15fd1ba41a1 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG nova.network.neutron [req-5a4cbb1a-d04e-499f-bf4d-d1a23a34710b req-f54f888f-2009-41a2-a4ed-a42b80bfbc7b service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Updated VIF entry in instance network info cache for port 1db65409-17e5-4526-b1f2-c15fd1ba41a1. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG nova.network.neutron [req-5a4cbb1a-d04e-499f-bf4d-d1a23a34710b req-f54f888f-2009-41a2-a4ed-a42b80bfbc7b service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Updating instance_info_cache with network_info: [{"id": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "address": "fa:16:3e:61:55:73", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db65409-17", "ovs_interfaceid": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:02:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5a4cbb1a-d04e-499f-bf4d-d1a23a34710b req-f54f888f-2009-41a2-a4ed-a42b80bfbc7b service nova] Releasing lock "refresh_cache-ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:02:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG os_brick.utils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd22774-ad26-4def-80af-fba18c51440c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2484fe-732f-4a9c-b4f7-96b74f0bc86c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf019d14-3153-41b3-ab3b-98dd6d12142a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a043c5f-e58b-4f14-871f-ac52ee0a30cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:02:56 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 19:02:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf645d73-d39a-4dad-a6b6-7fe468cbc5c3]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG os_brick.utils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:02:56 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Updating existing volume attachment record: 00b44731-7049-46d7-8119-af05e325add2 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 19:02:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 19:03:01 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Creating image(s)
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Ensure instance console log exists: /opt/stack/data/nova/instances/ecf7ac8f-0ec0-4c81-9b67-0ad78f178204/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Start _get_guest_xml network_info=[{"id": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "address": "fa:16:3e:61:55:73", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db65409-17", "ovs_interfaceid": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-18T19:02:46Z,direct_url=<?>,disk_format='qcow2',id=a0c5352f-0b08-43ef-9912-c1d815680ecf,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1621482177',owner='d3a60e439a714bdd8fca1ec43e2a3139',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-18T19:02:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CjyMGlAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ecf7ac8f-0ec0-4c81-9b67-0ad78f178204', 'attached_at': '', 'detached_at': '', 'volume_id': '672d12d8-5b10-4a6d-9792-ff3d92544e84', 'serial': '672d12d8-5b10-4a6d-9792-ff3d92544e84'}, 'attachment_id': '00b44731-7049-46d7-8119-af05e325add2', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 19:03:01 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:03:01 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-18T19:02:46Z,direct_url=<?>,disk_format='qcow2',id=a0c5352f-0b08-43ef-9912-c1d815680ecf,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1621482177',owner='d3a60e439a714bdd8fca1ec43e2a3139',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-18T19:02:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CjyMGlAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:03:01 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:03:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:03:01 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:03:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:03:01 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:03:01 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 19:03:01 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc95207-a701-47fb-82b4-7b126302c40c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 19:03:02 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cc5912-d980-4c00-b687-180d42c8e58d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84] added
Nov 18 19:03:02 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cb1064-3958-4c18-8f81-b82a47981754]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe26197-66c6-4c5e-ac81-395db8ad5654]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CjyMGlAI {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CjyMGlAI" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3fbe61-4de7-492c-909f-63d294c62cb7]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CjyMGlAI'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c7832c-ec07-4051-8baa-7aabf38a02c9]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e2bc2d-e395-4494-a84a-c4f6fe8981d3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:03:02 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:03:02 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff7d6f6-4418-44ff-aaa7-7846f7c91ed8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84, portal: 172.16.0.220,3260]
Nov 18 19:03:02 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84, portal: 172.16.0.220,3260] successful.
Nov 18 19:03:02 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2414f2c5-d0d8-4142-9c81-ce3a868511f5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57a5a13-b593-4761-89e9-fa2b17848bcb]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:03:02 user nova-compute[74692]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)
Nov 18 19:03:02 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:03:02 user nova-compute[74692]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)
Nov 18 19:03:02 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3f0e5b-0684-4eef-9523-f216fbd38f4e]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:03:02 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CjyMGlAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23331316265636531', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331316265636531', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1912581183',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1912581183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1912581183',id=46,image_ref='a0c5352f-0b08-43ef-9912-c1d815680ecf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAOkAbZO5p6NmoxLUzJ5vDYCUHbM8TEbnHiovAA7yQIxUWIWAj6Fn9u1elwTRjbzBu1X7erRIuI3EReRcZaPHrxL2R/dfXowEMYb+OCYKlpuS4mFTbaxCNhsmbOl/rYSg==',key_name='tempest-keypair-370155261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-c65vd0m6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1940625728',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:02:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=ecf7ac8f-0ec0-4c81-9b67-0ad78f178204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "address": "fa:16:3e:61:55:73", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db65409-17", "ovs_interfaceid": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "address": "fa:16:3e:61:55:73", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db65409-17", "ovs_interfaceid": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:55:73,bridge_name='br-int',has_traffic_filtering=True,id=1db65409-17e5-4526-b1f2-c15fd1ba41a1,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db65409-17') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG nova.objects.instance [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lazy-loading 'pci_devices' on Instance uuid ecf7ac8f-0ec0-4c81-9b67-0ad78f178204 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] End _get_guest_xml xml=<domain type="kvm">
Nov 18 19:03:03 user nova-compute[74692]:   <uuid>ecf7ac8f-0ec0-4c81-9b67-0ad78f178204</uuid>
Nov 18 19:03:03 user nova-compute[74692]:   <name>instance-0000002e</name>
Nov 18 19:03:03 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 19:03:03 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 19:03:03 user nova-compute[74692]:   <metadata>
Nov 18 19:03:03 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 19:03:03 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 19:03:03 user nova-compute[74692]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1912581183</nova:name>
Nov 18 19:03:03 user nova-compute[74692]:       <nova:creationTime>2023-11-18 19:03:01</nova:creationTime>
Nov 18 19:03:03 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 19:03:03 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 19:03:03 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 19:03:03 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 19:03:03 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 19:03:03 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 19:03:03 user nova-compute[74692]:       </nova:flavor>
Nov 18 19:03:03 user nova-compute[74692]:       <nova:owner>
Nov 18 19:03:03 user nova-compute[74692]:         <nova:user uuid="f58b7c308c3b4fa7bb4f576048ef7619">tempest-TestVolumeBootPattern-1940625728-project-member</nova:user>
Nov 18 19:03:03 user nova-compute[74692]:         <nova:project uuid="d3a60e439a714bdd8fca1ec43e2a3139">tempest-TestVolumeBootPattern-1940625728</nova:project>
Nov 18 19:03:03 user nova-compute[74692]:       </nova:owner>
Nov 18 19:03:03 user nova-compute[74692]:       <nova:root type="image" uuid="a0c5352f-0b08-43ef-9912-c1d815680ecf"/>
Nov 18 19:03:03 user nova-compute[74692]:       <nova:ports>
Nov 18 19:03:03 user nova-compute[74692]:         <nova:port uuid="1db65409-17e5-4526-b1f2-c15fd1ba41a1">
Nov 18 19:03:03 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 19:03:03 user nova-compute[74692]:         </nova:port>
Nov 18 19:03:03 user nova-compute[74692]:       </nova:ports>
Nov 18 19:03:03 user nova-compute[74692]:     </nova:instance>
Nov 18 19:03:03 user nova-compute[74692]:   </metadata>
Nov 18 19:03:03 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 19:03:03 user nova-compute[74692]:     <system>
Nov 18 19:03:03 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 19:03:03 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 19:03:03 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 19:03:03 user nova-compute[74692]:       <entry name="serial">ecf7ac8f-0ec0-4c81-9b67-0ad78f178204</entry>
Nov 18 19:03:03 user nova-compute[74692]:       <entry name="uuid">ecf7ac8f-0ec0-4c81-9b67-0ad78f178204</entry>
Nov 18 19:03:03 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 19:03:03 user nova-compute[74692]:     </system>
Nov 18 19:03:03 user nova-compute[74692]:   </sysinfo>
Nov 18 19:03:03 user nova-compute[74692]:   <os>
Nov 18 19:03:03 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 19:03:03 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 19:03:03 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 19:03:03 user nova-compute[74692]:   </os>
Nov 18 19:03:03 user nova-compute[74692]:   <features>
Nov 18 19:03:03 user nova-compute[74692]:     <acpi/>
Nov 18 19:03:03 user nova-compute[74692]:     <apic/>
Nov 18 19:03:03 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 19:03:03 user nova-compute[74692]:   </features>
Nov 18 19:03:03 user nova-compute[74692]:   <clock offset="utc">
Nov 18 19:03:03 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 19:03:03 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 19:03:03 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 19:03:03 user nova-compute[74692]:   </clock>
Nov 18 19:03:03 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 19:03:03 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 19:03:03 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 19:03:03 user nova-compute[74692]:   </cpu>
Nov 18 19:03:03 user nova-compute[74692]:   <devices>
Nov 18 19:03:03 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 19:03:03 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:03:03 user nova-compute[74692]:       <source dev="/dev/sdb"/>
Nov 18 19:03:03 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 19:03:03 user nova-compute[74692]:       <serial>672d12d8-5b10-4a6d-9792-ff3d92544e84</serial>
Nov 18 19:03:03 user nova-compute[74692]:     </disk>
Nov 18 19:03:03 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 19:03:03 user nova-compute[74692]:       <mac address="fa:16:3e:61:55:73"/>
Nov 18 19:03:03 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:03:03 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 19:03:03 user nova-compute[74692]:       <target dev="tap1db65409-17"/>
Nov 18 19:03:03 user nova-compute[74692]:     </interface>
Nov 18 19:03:03 user nova-compute[74692]:     <serial type="pty">
Nov 18 19:03:03 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/ecf7ac8f-0ec0-4c81-9b67-0ad78f178204/console.log" append="off"/>
Nov 18 19:03:03 user nova-compute[74692]:     </serial>
Nov 18 19:03:03 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 19:03:03 user nova-compute[74692]:     <video>
Nov 18 19:03:03 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:03:03 user nova-compute[74692]:     </video>
Nov 18 19:03:03 user nova-compute[74692]:     <rng model="virtio">
Nov 18 19:03:03 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 19:03:03 user nova-compute[74692]:     </rng>
Nov 18 19:03:03 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 19:03:03 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 19:03:03 user nova-compute[74692]:       <stats period="10"/>
Nov 18 19:03:03 user nova-compute[74692]:     </memballoon>
Nov 18 19:03:03 user nova-compute[74692]:   </devices>
Nov 18 19:03:03 user nova-compute[74692]: </domain>
Nov 18 19:03:03 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1912581183',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1912581183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1912581183',id=46,image_ref='a0c5352f-0b08-43ef-9912-c1d815680ecf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAOkAbZO5p6NmoxLUzJ5vDYCUHbM8TEbnHiovAA7yQIxUWIWAj6Fn9u1elwTRjbzBu1X7erRIuI3EReRcZaPHrxL2R/dfXowEMYb+OCYKlpuS4mFTbaxCNhsmbOl/rYSg==',key_name='tempest-keypair-370155261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-c65vd0m6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1940625728',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:02:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=ecf7ac8f-0ec0-4c81-9b67-0ad78f178204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "address": "fa:16:3e:61:55:73", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db65409-17", "ovs_interfaceid": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "address": "fa:16:3e:61:55:73", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db65409-17", "ovs_interfaceid": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:55:73,bridge_name='br-int',has_traffic_filtering=True,id=1db65409-17e5-4526-b1f2-c15fd1ba41a1,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db65409-17') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG os_vif [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:55:73,bridge_name='br-int',has_traffic_filtering=True,id=1db65409-17e5-4526-b1f2-c15fd1ba41a1,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db65409-17') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f66caeb3-7a91-5030-aa2f-4aefae079bfb', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1db65409-17, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1db65409-17, col_values=(('qos', UUID('05a89ac7-af18-4039-8f70-8b8be5f729f5')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1db65409-17, col_values=(('external_ids', {'iface-id': '1db65409-17e5-4526-b1f2-c15fd1ba41a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:55:73', 'vm-uuid': 'ecf7ac8f-0ec0-4c81-9b67-0ad78f178204'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:03 user nova-compute[74692]: INFO os_vif [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:55:73,bridge_name='br-int',has_traffic_filtering=True,id=1db65409-17e5-4526-b1f2-c15fd1ba41a1,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db65409-17')
Nov 18 19:03:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:03:03 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] No VIF found with MAC fa:16:3e:61:55:73, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:03:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-88a1c3c5-ad82-4fd9-80f1-4f49aee0018f req-6d76ac4a-d092-4293-b1fc-28a0acd0ab5f service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Received event network-vif-plugged-1db65409-17e5-4526-b1f2-c15fd1ba41a1 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:03:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-88a1c3c5-ad82-4fd9-80f1-4f49aee0018f req-6d76ac4a-d092-4293-b1fc-28a0acd0ab5f service nova] Acquiring lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-88a1c3c5-ad82-4fd9-80f1-4f49aee0018f req-6d76ac4a-d092-4293-b1fc-28a0acd0ab5f service nova] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-88a1c3c5-ad82-4fd9-80f1-4f49aee0018f req-6d76ac4a-d092-4293-b1fc-28a0acd0ab5f service nova] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-88a1c3c5-ad82-4fd9-80f1-4f49aee0018f req-6d76ac4a-d092-4293-b1fc-28a0acd0ab5f service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] No waiting events found dispatching network-vif-plugged-1db65409-17e5-4526-b1f2-c15fd1ba41a1 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:03:04 user nova-compute[74692]: WARNING nova.compute.manager [req-88a1c3c5-ad82-4fd9-80f1-4f49aee0018f req-6d76ac4a-d092-4293-b1fc-28a0acd0ab5f service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Received unexpected event network-vif-plugged-1db65409-17e5-4526-b1f2-c15fd1ba41a1 for instance with vm_state building and task_state spawning.
Nov 18 19:03:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:06 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 19:03:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 19:03:06 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Instance spawned successfully.
Nov 18 19:03:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 19:03:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:03:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:03:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-6c60b268-23f9-4955-acae-b3de22c8b9bd req-32b5c369-1146-4950-9354-8322d3fba43d service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Received event network-vif-plugged-1db65409-17e5-4526-b1f2-c15fd1ba41a1 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:03:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6c60b268-23f9-4955-acae-b3de22c8b9bd req-32b5c369-1146-4950-9354-8322d3fba43d service nova] Acquiring lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6c60b268-23f9-4955-acae-b3de22c8b9bd req-32b5c369-1146-4950-9354-8322d3fba43d service nova] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6c60b268-23f9-4955-acae-b3de22c8b9bd req-32b5c369-1146-4950-9354-8322d3fba43d service nova] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-6c60b268-23f9-4955-acae-b3de22c8b9bd req-32b5c369-1146-4950-9354-8322d3fba43d service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] No waiting events found dispatching network-vif-plugged-1db65409-17e5-4526-b1f2-c15fd1ba41a1 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:03:06 user nova-compute[74692]: WARNING nova.compute.manager [req-6c60b268-23f9-4955-acae-b3de22c8b9bd req-32b5c369-1146-4950-9354-8322d3fba43d service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Received unexpected event network-vif-plugged-1db65409-17e5-4526-b1f2-c15fd1ba41a1 for instance with vm_state building and task_state spawning.
Nov 18 19:03:06 user nova-compute[74692]: INFO nova.compute.manager [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 18 19:03:06 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 19:03:07 user nova-compute[74692]: INFO nova.compute.manager [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Took 16.81 seconds to build instance.
Nov 18 19:03:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5f0e5ead-8281-474c-ac8b-15867c9ac6df tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.952s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:03:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:03:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:03:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:03:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "ce2a3af7-ac82-4dca-bc25-14876d57466f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "ce2a3af7-ac82-4dca-bc25-14876d57466f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:17 user nova-compute[74692]: INFO nova.compute.manager [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Terminating instance
Nov 18 19:03:17 user nova-compute[74692]: DEBUG nova.compute.manager [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 19:03:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:17 user nova-compute[74692]: DEBUG nova.compute.manager [req-9b54e544-d291-410e-8217-0107ff298e01 req-cc141334-0d5e-40fa-8dbc-88888656dc11 service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Received event network-vif-unplugged-60aa7752-8dff-4325-b95f-ae6d2ab82f49 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:03:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9b54e544-d291-410e-8217-0107ff298e01 req-cc141334-0d5e-40fa-8dbc-88888656dc11 service nova] Acquiring lock "ce2a3af7-ac82-4dca-bc25-14876d57466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9b54e544-d291-410e-8217-0107ff298e01 req-cc141334-0d5e-40fa-8dbc-88888656dc11 service nova] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:17 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-9b54e544-d291-410e-8217-0107ff298e01 req-cc141334-0d5e-40fa-8dbc-88888656dc11 service nova] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:17 user nova-compute[74692]: DEBUG nova.compute.manager [req-9b54e544-d291-410e-8217-0107ff298e01 req-cc141334-0d5e-40fa-8dbc-88888656dc11 service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] No waiting events found dispatching network-vif-unplugged-60aa7752-8dff-4325-b95f-ae6d2ab82f49 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:03:17 user nova-compute[74692]: DEBUG nova.compute.manager [req-9b54e544-d291-410e-8217-0107ff298e01 req-cc141334-0d5e-40fa-8dbc-88888656dc11 service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Received event network-vif-unplugged-60aa7752-8dff-4325-b95f-ae6d2ab82f49 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 19:03:18 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Instance destroyed successfully.
Nov 18 19:03:18 user nova-compute[74692]: DEBUG nova.objects.instance [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'resources' on Instance uuid ce2a3af7-ac82-4dca-bc25-14876d57466f {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:00:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-690297032',display_name='tempest-AttachVolumeNegativeTest-server-690297032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-690297032',id=43,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2UXnbGwYO/RTzroI4cuyUOkLzAkuQnZ3C+6euoTKAj/+Szy6c0yWQMB5sknXoc0NGX2fxiauSmOdBujWoWnyOpunn6TckL1XrrHuptMXKG99jPlURezPUuEyRYFEcz9w==',key_name='tempest-keypair-327815926',keypairs=<?>,launch_index=0,launched_at=2023-11-18T19:00:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7475e741034a4302b0ab193f1b6c67d2',ramdisk_id='',reservation_id='r-mg2a39r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-542263902',owner_user_name='tempest-AttachVolumeNegativeTest-542263902-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T19:00:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='def7f7c9ff4f4a29a840ace22d509755',uuid=ce2a3af7-ac82-4dca-bc25-14876d57466f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "address": "fa:16:3e:a7:ae:37", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7752-8d", "ovs_interfaceid": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converting VIF {"id": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "address": "fa:16:3e:a7:ae:37", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7752-8d", "ovs_interfaceid": "60aa7752-8dff-4325-b95f-ae6d2ab82f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ae:37,bridge_name='br-int',has_traffic_filtering=True,id=60aa7752-8dff-4325-b95f-ae6d2ab82f49,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60aa7752-8d') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG os_vif [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ae:37,bridge_name='br-int',has_traffic_filtering=True,id=60aa7752-8dff-4325-b95f-ae6d2ab82f49,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60aa7752-8d') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60aa7752-8d, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c6b7dc7-806d-453d-96c2-15b21378feb6) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:03:18 user nova-compute[74692]: INFO os_vif [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ae:37,bridge_name='br-int',has_traffic_filtering=True,id=60aa7752-8dff-4325-b95f-ae6d2ab82f49,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60aa7752-8d')
Nov 18 19:03:18 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Deleting instance files /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f_del
Nov 18 19:03:18 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Deletion of /opt/stack/data/nova/instances/ce2a3af7-ac82-4dca-bc25-14876d57466f_del complete
Nov 18 19:03:18 user nova-compute[74692]: INFO nova.compute.manager [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 18 19:03:18 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:18 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:03:18 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Took 0.82 seconds to deallocate network for instance.
Nov 18 19:03:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:19 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:03:19 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:03:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:19 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Deleted allocations for instance ce2a3af7-ac82-4dca-bc25-14876d57466f
Nov 18 19:03:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-aeee87ad-3a42-4ebd-af5c-1ec3b8b8cd42 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.027s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-f0e5d260-b138-4475-a203-7745e54982e8 req-38840644-52eb-41f5-9987-20fb933920ff service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Received event network-vif-plugged-60aa7752-8dff-4325-b95f-ae6d2ab82f49 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:03:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f0e5d260-b138-4475-a203-7745e54982e8 req-38840644-52eb-41f5-9987-20fb933920ff service nova] Acquiring lock "ce2a3af7-ac82-4dca-bc25-14876d57466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f0e5d260-b138-4475-a203-7745e54982e8 req-38840644-52eb-41f5-9987-20fb933920ff service nova] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f0e5d260-b138-4475-a203-7745e54982e8 req-38840644-52eb-41f5-9987-20fb933920ff service nova] Lock "ce2a3af7-ac82-4dca-bc25-14876d57466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-f0e5d260-b138-4475-a203-7745e54982e8 req-38840644-52eb-41f5-9987-20fb933920ff service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] No waiting events found dispatching network-vif-plugged-60aa7752-8dff-4325-b95f-ae6d2ab82f49 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:03:19 user nova-compute[74692]: WARNING nova.compute.manager [req-f0e5d260-b138-4475-a203-7745e54982e8 req-38840644-52eb-41f5-9987-20fb933920ff service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Received unexpected event network-vif-plugged-60aa7752-8dff-4325-b95f-ae6d2ab82f49 for instance with vm_state deleted and task_state None.
Nov 18 19:03:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-f0e5d260-b138-4475-a203-7745e54982e8 req-38840644-52eb-41f5-9987-20fb933920ff service nova] [instance: ce2a3af7-ac82-4dca-bc25-14876d57466f] Received event network-vif-deleted-60aa7752-8dff-4325-b95f-ae6d2ab82f49 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:03:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:03:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquiring lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:35 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:03:35 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:03:35 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8618MB free_disk=25.03896713256836GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 4519eaca-4744-49e2-a3ce-34d3a9fedc77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 78457b6e-547c-4134-bf25-371b71693dc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance ecf7ac8f-0ec0-4c81-9b67-0ad78f178204 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:03:35 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.301s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 19:03:36 user nova-compute[74692]: INFO nova.compute.claims [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Claim successful on node user
Nov 18 19:03:36 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG nova.network.neutron [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 19:03:36 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 19:03:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG nova.policy [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c661ecd6f1344268389f2ffc0f80efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdb51828ce4e47b876798b91b4c970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 19:03:36 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Creating image(s)
Nov 18 19:03:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "/opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "/opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.179s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk 1073741824" returned: 0 in 0.046s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG nova.network.neutron [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Successfully created port: 065590c8-71bb-4202-af01-656d23704cb9 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Cannot resize image /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Ensure instance console log exists: /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG nova.network.neutron [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Successfully updated port: 065590c8-71bb-4202-af01-656d23704cb9 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquiring lock "refresh_cache-3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquired lock "refresh_cache-3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG nova.network.neutron [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG nova.compute.manager [req-b9cddb0b-ec63-4386-a9d0-2fdd33b19523 req-3c356a3e-fd6f-4ace-9309-2cf8d675ef00 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Received event network-changed-065590c8-71bb-4202-af01-656d23704cb9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG nova.compute.manager [req-b9cddb0b-ec63-4386-a9d0-2fdd33b19523 req-3c356a3e-fd6f-4ace-9309-2cf8d675ef00 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Refreshing instance network info cache due to event network-changed-065590c8-71bb-4202-af01-656d23704cb9. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:03:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b9cddb0b-ec63-4386-a9d0-2fdd33b19523 req-3c356a3e-fd6f-4ace-9309-2cf8d675ef00 service nova] Acquiring lock "refresh_cache-3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.network.neutron [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.network.neutron [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Updating instance_info_cache with network_info: [{"id": "065590c8-71bb-4202-af01-656d23704cb9", "address": "fa:16:3e:da:b3:8c", "network": {"id": "841612ef-9562-4cd0-8707-6df7c5be44c9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1767401438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94cdb51828ce4e47b876798b91b4c970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065590c8-71", "ovs_interfaceid": "065590c8-71bb-4202-af01-656d23704cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Releasing lock "refresh_cache-3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Instance network_info: |[{"id": "065590c8-71bb-4202-af01-656d23704cb9", "address": "fa:16:3e:da:b3:8c", "network": {"id": "841612ef-9562-4cd0-8707-6df7c5be44c9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1767401438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94cdb51828ce4e47b876798b91b4c970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065590c8-71", "ovs_interfaceid": "065590c8-71bb-4202-af01-656d23704cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b9cddb0b-ec63-4386-a9d0-2fdd33b19523 req-3c356a3e-fd6f-4ace-9309-2cf8d675ef00 service nova] Acquired lock "refresh_cache-3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.network.neutron [req-b9cddb0b-ec63-4386-a9d0-2fdd33b19523 req-3c356a3e-fd6f-4ace-9309-2cf8d675ef00 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Refreshing network info cache for port 065590c8-71bb-4202-af01-656d23704cb9 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Start _get_guest_xml network_info=[{"id": "065590c8-71bb-4202-af01-656d23704cb9", "address": "fa:16:3e:da:b3:8c", "network": {"id": "841612ef-9562-4cd0-8707-6df7c5be44c9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1767401438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94cdb51828ce4e47b876798b91b4c970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065590c8-71", "ovs_interfaceid": "065590c8-71bb-4202-af01-656d23704cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 19:03:38 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:03:38 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-168899072',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-168899072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1688990',id=47,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFRFJMmEIzwnmsaSAjA3wy2/w35oxDkTJZfNfJzCfMNZWoMGtYhO8z51g2IylyV8FEceVkYxhut8entOc8Ced5G/5NrIBH++sQXj4wx4IStFsG6pM8gzwwAU8Fuf/Rb0Q==',key_name='tempest-keypair-1265193666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94cdb51828ce4e47b876798b91b4c970',ramdisk_id='',reservation_id='r-di8jdeh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-176979081',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c661ecd6f1344268389f2ffc0f80efc',uuid=3fa99ece-b7fa-4518-ae01-c3d0b2d243ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "065590c8-71bb-4202-af01-656d23704cb9", "address": "fa:16:3e:da:b3:8c", "network": {"id": "841612ef-9562-4cd0-8707-6df7c5be44c9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1767401438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94cdb51828ce4e47b876798b91b4c970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065590c8-71", "ovs_interfaceid": "065590c8-71bb-4202-af01-656d23704cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Converting VIF {"id": "065590c8-71bb-4202-af01-656d23704cb9", "address": "fa:16:3e:da:b3:8c", "network": {"id": "841612ef-9562-4cd0-8707-6df7c5be44c9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1767401438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94cdb51828ce4e47b876798b91b4c970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065590c8-71", "ovs_interfaceid": "065590c8-71bb-4202-af01-656d23704cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:b3:8c,bridge_name='br-int',has_traffic_filtering=True,id=065590c8-71bb-4202-af01-656d23704cb9,network=Network(841612ef-9562-4cd0-8707-6df7c5be44c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065590c8-71') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.objects.instance [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] End _get_guest_xml xml=<domain type="kvm">
Nov 18 19:03:38 user nova-compute[74692]:   <uuid>3fa99ece-b7fa-4518-ae01-c3d0b2d243ce</uuid>
Nov 18 19:03:38 user nova-compute[74692]:   <name>instance-0000002f</name>
Nov 18 19:03:38 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 19:03:38 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 19:03:38 user nova-compute[74692]:   <metadata>
Nov 18 19:03:38 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 19:03:38 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 19:03:38 user nova-compute[74692]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-168899072</nova:name>
Nov 18 19:03:38 user nova-compute[74692]:       <nova:creationTime>2023-11-18 19:03:38</nova:creationTime>
Nov 18 19:03:38 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 19:03:38 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 19:03:38 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 19:03:38 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 19:03:38 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 19:03:38 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 19:03:38 user nova-compute[74692]:       </nova:flavor>
Nov 18 19:03:38 user nova-compute[74692]:       <nova:owner>
Nov 18 19:03:38 user nova-compute[74692]:         <nova:user uuid="7c661ecd6f1344268389f2ffc0f80efc">tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member</nova:user>
Nov 18 19:03:38 user nova-compute[74692]:         <nova:project uuid="94cdb51828ce4e47b876798b91b4c970">tempest-TestServerVolumeAttachScenarioOldVersion-176979081</nova:project>
Nov 18 19:03:38 user nova-compute[74692]:       </nova:owner>
Nov 18 19:03:38 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 19:03:38 user nova-compute[74692]:       <nova:ports>
Nov 18 19:03:38 user nova-compute[74692]:         <nova:port uuid="065590c8-71bb-4202-af01-656d23704cb9">
Nov 18 19:03:38 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 19:03:38 user nova-compute[74692]:         </nova:port>
Nov 18 19:03:38 user nova-compute[74692]:       </nova:ports>
Nov 18 19:03:38 user nova-compute[74692]:     </nova:instance>
Nov 18 19:03:38 user nova-compute[74692]:   </metadata>
Nov 18 19:03:38 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 19:03:38 user nova-compute[74692]:     <system>
Nov 18 19:03:38 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 19:03:38 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 19:03:38 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 19:03:38 user nova-compute[74692]:       <entry name="serial">3fa99ece-b7fa-4518-ae01-c3d0b2d243ce</entry>
Nov 18 19:03:38 user nova-compute[74692]:       <entry name="uuid">3fa99ece-b7fa-4518-ae01-c3d0b2d243ce</entry>
Nov 18 19:03:38 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 19:03:38 user nova-compute[74692]:     </system>
Nov 18 19:03:38 user nova-compute[74692]:   </sysinfo>
Nov 18 19:03:38 user nova-compute[74692]:   <os>
Nov 18 19:03:38 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 19:03:38 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 19:03:38 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 19:03:38 user nova-compute[74692]:   </os>
Nov 18 19:03:38 user nova-compute[74692]:   <features>
Nov 18 19:03:38 user nova-compute[74692]:     <acpi/>
Nov 18 19:03:38 user nova-compute[74692]:     <apic/>
Nov 18 19:03:38 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 19:03:38 user nova-compute[74692]:   </features>
Nov 18 19:03:38 user nova-compute[74692]:   <clock offset="utc">
Nov 18 19:03:38 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 19:03:38 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 19:03:38 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 19:03:38 user nova-compute[74692]:   </clock>
Nov 18 19:03:38 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 19:03:38 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 19:03:38 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 19:03:38 user nova-compute[74692]:   </cpu>
Nov 18 19:03:38 user nova-compute[74692]:   <devices>
Nov 18 19:03:38 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 19:03:38 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 19:03:38 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk"/>
Nov 18 19:03:38 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 19:03:38 user nova-compute[74692]:     </disk>
Nov 18 19:03:38 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 19:03:38 user nova-compute[74692]:       <mac address="fa:16:3e:da:b3:8c"/>
Nov 18 19:03:38 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:03:38 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 19:03:38 user nova-compute[74692]:       <target dev="tap065590c8-71"/>
Nov 18 19:03:38 user nova-compute[74692]:     </interface>
Nov 18 19:03:38 user nova-compute[74692]:     <serial type="pty">
Nov 18 19:03:38 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/console.log" append="off"/>
Nov 18 19:03:38 user nova-compute[74692]:     </serial>
Nov 18 19:03:38 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 19:03:38 user nova-compute[74692]:     <video>
Nov 18 19:03:38 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:03:38 user nova-compute[74692]:     </video>
Nov 18 19:03:38 user nova-compute[74692]:     <rng model="virtio">
Nov 18 19:03:38 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 19:03:38 user nova-compute[74692]:     </rng>
Nov 18 19:03:38 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 19:03:38 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 19:03:38 user nova-compute[74692]:       <stats period="10"/>
Nov 18 19:03:38 user nova-compute[74692]:     </memballoon>
Nov 18 19:03:38 user nova-compute[74692]:   </devices>
Nov 18 19:03:38 user nova-compute[74692]: </domain>
Nov 18 19:03:38 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-168899072',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-168899072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1688990',id=47,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFRFJMmEIzwnmsaSAjA3wy2/w35oxDkTJZfNfJzCfMNZWoMGtYhO8z51g2IylyV8FEceVkYxhut8entOc8Ced5G/5NrIBH++sQXj4wx4IStFsG6pM8gzwwAU8Fuf/Rb0Q==',key_name='tempest-keypair-1265193666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94cdb51828ce4e47b876798b91b4c970',ramdisk_id='',reservation_id='r-di8jdeh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-176979081',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c661ecd6f1344268389f2ffc0f80efc',uuid=3fa99ece-b7fa-4518-ae01-c3d0b2d243ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "065590c8-71bb-4202-af01-656d23704cb9", "address": "fa:16:3e:da:b3:8c", "network": {"id": "841612ef-9562-4cd0-8707-6df7c5be44c9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1767401438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94cdb51828ce4e47b876798b91b4c970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065590c8-71", "ovs_interfaceid": "065590c8-71bb-4202-af01-656d23704cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Converting VIF {"id": "065590c8-71bb-4202-af01-656d23704cb9", "address": "fa:16:3e:da:b3:8c", "network": {"id": "841612ef-9562-4cd0-8707-6df7c5be44c9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1767401438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94cdb51828ce4e47b876798b91b4c970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065590c8-71", "ovs_interfaceid": "065590c8-71bb-4202-af01-656d23704cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:b3:8c,bridge_name='br-int',has_traffic_filtering=True,id=065590c8-71bb-4202-af01-656d23704cb9,network=Network(841612ef-9562-4cd0-8707-6df7c5be44c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065590c8-71') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG os_vif [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b3:8c,bridge_name='br-int',has_traffic_filtering=True,id=065590c8-71bb-4202-af01-656d23704cb9,network=Network(841612ef-9562-4cd0-8707-6df7c5be44c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065590c8-71') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '629f9460-ccb8-51b9-be45-fc82492712a9', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap065590c8-71, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap065590c8-71, col_values=(('qos', UUID('7376d00f-92b0-4033-995f-dbd51b8bf88b')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap065590c8-71, col_values=(('external_ids', {'iface-id': '065590c8-71bb-4202-af01-656d23704cb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:b3:8c', 'vm-uuid': '3fa99ece-b7fa-4518-ae01-c3d0b2d243ce'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:38 user nova-compute[74692]: INFO os_vif [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b3:8c,bridge_name='br-int',has_traffic_filtering=True,id=065590c8-71bb-4202-af01-656d23704cb9,network=Network(841612ef-9562-4cd0-8707-6df7c5be44c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065590c8-71')
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] No VIF found with MAC fa:16:3e:da:b3:8c, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.network.neutron [req-b9cddb0b-ec63-4386-a9d0-2fdd33b19523 req-3c356a3e-fd6f-4ace-9309-2cf8d675ef00 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Updated VIF entry in instance network info cache for port 065590c8-71bb-4202-af01-656d23704cb9. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG nova.network.neutron [req-b9cddb0b-ec63-4386-a9d0-2fdd33b19523 req-3c356a3e-fd6f-4ace-9309-2cf8d675ef00 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Updating instance_info_cache with network_info: [{"id": "065590c8-71bb-4202-af01-656d23704cb9", "address": "fa:16:3e:da:b3:8c", "network": {"id": "841612ef-9562-4cd0-8707-6df7c5be44c9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1767401438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94cdb51828ce4e47b876798b91b4c970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065590c8-71", "ovs_interfaceid": "065590c8-71bb-4202-af01-656d23704cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:03:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-b9cddb0b-ec63-4386-a9d0-2fdd33b19523 req-3c356a3e-fd6f-4ace-9309-2cf8d675ef00 service nova] Releasing lock "refresh_cache-3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:03:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-73b80b32-ec1c-4404-bd46-9c48362881c0 req-88e6d1a1-67b3-4221-84e6-b5cdfc7844b1 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Received event network-vif-plugged-065590c8-71bb-4202-af01-656d23704cb9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:03:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-73b80b32-ec1c-4404-bd46-9c48362881c0 req-88e6d1a1-67b3-4221-84e6-b5cdfc7844b1 service nova] Acquiring lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-73b80b32-ec1c-4404-bd46-9c48362881c0 req-88e6d1a1-67b3-4221-84e6-b5cdfc7844b1 service nova] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-73b80b32-ec1c-4404-bd46-9c48362881c0 req-88e6d1a1-67b3-4221-84e6-b5cdfc7844b1 service nova] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:39 user nova-compute[74692]: DEBUG nova.compute.manager [req-73b80b32-ec1c-4404-bd46-9c48362881c0 req-88e6d1a1-67b3-4221-84e6-b5cdfc7844b1 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] No waiting events found dispatching network-vif-plugged-065590c8-71bb-4202-af01-656d23704cb9 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:03:39 user nova-compute[74692]: WARNING nova.compute.manager [req-73b80b32-ec1c-4404-bd46-9c48362881c0 req-88e6d1a1-67b3-4221-84e6-b5cdfc7844b1 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Received unexpected event network-vif-plugged-065590c8-71bb-4202-af01-656d23704cb9 for instance with vm_state building and task_state spawning.
Nov 18 19:03:40 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:03:40 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:03:40 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:03:40 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:03:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:41 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 19:03:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 19:03:41 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Instance spawned successfully.
Nov 18 19:03:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 19:03:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:03:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:03:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:03:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:03:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:03:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:03:41 user nova-compute[74692]: INFO nova.compute.manager [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 18 19:03:41 user nova-compute[74692]: DEBUG nova.compute.manager [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 19:03:42 user nova-compute[74692]: INFO nova.compute.manager [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Took 6.14 seconds to build instance.
Nov 18 19:03:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-2a10be19-a242-4998-ac97-228e9d1f92b9 req-323b886e-d8ee-4322-9557-f63b2aa596e6 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Received event network-vif-plugged-065590c8-71bb-4202-af01-656d23704cb9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:03:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2a10be19-a242-4998-ac97-228e9d1f92b9 req-323b886e-d8ee-4322-9557-f63b2aa596e6 service nova] Acquiring lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2a10be19-a242-4998-ac97-228e9d1f92b9 req-323b886e-d8ee-4322-9557-f63b2aa596e6 service nova] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-2a10be19-a242-4998-ac97-228e9d1f92b9 req-323b886e-d8ee-4322-9557-f63b2aa596e6 service nova] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-2a10be19-a242-4998-ac97-228e9d1f92b9 req-323b886e-d8ee-4322-9557-f63b2aa596e6 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] No waiting events found dispatching network-vif-plugged-065590c8-71bb-4202-af01-656d23704cb9 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:03:42 user nova-compute[74692]: WARNING nova.compute.manager [req-2a10be19-a242-4998-ac97-228e9d1f92b9 req-323b886e-d8ee-4322-9557-f63b2aa596e6 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Received unexpected event network-vif-plugged-065590c8-71bb-4202-af01-656d23704cb9 for instance with vm_state active and task_state None.
Nov 18 19:03:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-11cf7b70-3013-404b-b802-47d5843b99ee tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.239s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:42 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:03:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:03:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-4519eaca-4744-49e2-a3ce-34d3a9fedc77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:03:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-4519eaca-4744-49e2-a3ce-34d3a9fedc77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:03:43 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:03:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:43 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Updating instance_info_cache with network_info: [{"id": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "address": "fa:16:3e:5b:b9:cd", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf4807d9-4e", "ovs_interfaceid": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:03:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-4519eaca-4744-49e2-a3ce-34d3a9fedc77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:03:43 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:03:43 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:03:43 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:03:44 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:03:44 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:03:47 user nova-compute[74692]: DEBUG nova.compute.manager [req-98c78de3-b5a5-48da-84a2-137125003e14 req-0418bd52-dca3-4db6-8a39-cbdc5002b2ef service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Received event network-changed-e6c77aab-5452-4fd1-b0c2-836b4ab7096a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:03:47 user nova-compute[74692]: DEBUG nova.compute.manager [req-98c78de3-b5a5-48da-84a2-137125003e14 req-0418bd52-dca3-4db6-8a39-cbdc5002b2ef service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Refreshing instance network info cache due to event network-changed-e6c77aab-5452-4fd1-b0c2-836b4ab7096a. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:03:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-98c78de3-b5a5-48da-84a2-137125003e14 req-0418bd52-dca3-4db6-8a39-cbdc5002b2ef service nova] Acquiring lock "refresh_cache-78457b6e-547c-4134-bf25-371b71693dc1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:03:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-98c78de3-b5a5-48da-84a2-137125003e14 req-0418bd52-dca3-4db6-8a39-cbdc5002b2ef service nova] Acquired lock "refresh_cache-78457b6e-547c-4134-bf25-371b71693dc1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:03:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-98c78de3-b5a5-48da-84a2-137125003e14 req-0418bd52-dca3-4db6-8a39-cbdc5002b2ef service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Refreshing network info cache for port e6c77aab-5452-4fd1-b0c2-836b4ab7096a {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:03:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-98c78de3-b5a5-48da-84a2-137125003e14 req-0418bd52-dca3-4db6-8a39-cbdc5002b2ef service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Updated VIF entry in instance network info cache for port e6c77aab-5452-4fd1-b0c2-836b4ab7096a. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:03:47 user nova-compute[74692]: DEBUG nova.network.neutron [req-98c78de3-b5a5-48da-84a2-137125003e14 req-0418bd52-dca3-4db6-8a39-cbdc5002b2ef service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Updating instance_info_cache with network_info: [{"id": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "address": "fa:16:3e:f0:af:d1", "network": {"id": "cc92e7ba-2619-4498-848c-b3b8870560fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1221693540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d0a7206e6b44e5bc69a7114367fd3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c77aab-54", "ovs_interfaceid": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:03:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-98c78de3-b5a5-48da-84a2-137125003e14 req-0418bd52-dca3-4db6-8a39-cbdc5002b2ef service nova] Releasing lock "refresh_cache-78457b6e-547c-4134-bf25-371b71693dc1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "78457b6e-547c-4134-bf25-371b71693dc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG nova.objects.instance [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lazy-loading 'flavor' on Instance uuid 78457b6e-547c-4134-bf25-371b71693dc1 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "78457b6e-547c-4134-bf25-371b71693dc1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:48 user nova-compute[74692]: INFO nova.compute.manager [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Attaching volume 131c74a2-4e2d-439f-ac4e-1ac96b5aee84 to /dev/vdb
Nov 18 19:03:48 user nova-compute[74692]: DEBUG os_brick.utils [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2501910c-e7d3-42bd-a031-b3b40c61188f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a5d26c-e22f-4ee1-802e-6f23f16f309c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc56b60-eb40-4fa2-92cf-0d4dfc3dccc0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f589990-49aa-44e3-ad19-0b55f4780e9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:03:48 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 19:03:48 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cb9df9-a152-4127-a8b4-631a145449b5]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG os_brick.utils [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:03:48 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Updating existing volume attachment record: 33bf8bd2-d796-483b-8337-3b3b0ea99ae6 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpauedAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:03:53 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:03:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:03:53 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:03:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:03:53 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3396080f-4fd3-4a18-bde3-e04272736e3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 19:03:53 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[314c5f42-a8f4-404b-8795-cfa8526732b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84] added
Nov 18 19:03:53 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[31376282-b560-4e58-8694-0640f669a8ee]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5d27a2-8dff-4d86-bbd9-a8d61706646f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LpauedAS {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LpauedAS" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[69046144-f0cf-47fe-a5b5-8716b879c3de]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LpauedAS'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcbd46d-44ac-4296-9150-7087988b8b95]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3ba74d-7df0-4281-b1b2-68bb084ccd40]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:03:54 user nova-compute[74692]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)
Nov 18 19:03:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:03:54 user nova-compute[74692]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)
Nov 18 19:03:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f5dc01-c202-409a-a5a1-815a1dd4c824]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84, portal: 172.16.0.220,3260]
Nov 18 19:03:54 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84, portal: 172.16.0.220,3260] successful.
Nov 18 19:03:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b46126-1be7-42f2-a91b-20ee97e49461]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a949394-3e65-4a78-8577-581ec67a7396]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:03:54 user nova-compute[74692]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)
Nov 18 19:03:54 user nova-compute[74692]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)
Nov 18 19:03:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:03:54 user nova-compute[74692]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)
Nov 18 19:03:54 user nova-compute[74692]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)
Nov 18 19:03:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be2512c-1bde-42d7-b58e-5523b7d230ff]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:03:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpauedAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 19:03:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:03:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26234343161613466', 'path': '/dev/sdd'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:03:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234343161613466', 'path': '/dev/sdd'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 19:03:55 user nova-compute[74692]: DEBUG nova.objects.instance [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lazy-loading 'flavor' on Instance uuid 78457b6e-547c-4134-bf25-371b71693dc1 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:03:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 19:03:55 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:03:55 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 19:03:55 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:03:55 user nova-compute[74692]:   <serial>131c74a2-4e2d-439f-ac4e-1ac96b5aee84</serial>
Nov 18 19:03:55 user nova-compute[74692]: </disk>
Nov 18 19:03:55 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 19:03:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:03:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:03:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] No VIF found with MAC fa:16:3e:f0:af:d1, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:03:55 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-b30413c6-0c60-4749-b7d3-cd0efc0ec97a tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.494s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "78457b6e-547c-4134-bf25-371b71693dc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG nova.objects.instance [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lazy-loading 'flavor' on Instance uuid 78457b6e-547c-4134-bf25-371b71693dc1 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "78457b6e-547c-4134-bf25-371b71693dc1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:03:59 user nova-compute[74692]: INFO nova.compute.manager [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Attaching volume 3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 to /dev/vdc
Nov 18 19:03:59 user nova-compute[74692]: DEBUG os_brick.utils [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9184b25c-0204-4293-b4e3-9cf78cbe5b43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e60d3b-58f9-438c-8615-876047142162]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e91e67a-6567-455e-b1ea-a10798289426]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e5de88-4c7d-4cec-8106-816ff7ebdae7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:03:59 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 19:03:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[95270412-c520-41da-ae1a-4489fdd5fdbb]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG os_brick.utils [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:03:59 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Updating existing volume attachment record: bf3d5d10-73b0-45b7-8efa-cf60a5388c68 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 19:04:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:04:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Verify base images {{(pid=74692) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Image id 503b14b1-1e1e-41a7-a748-0e4d907ae048 yields fingerprint 6a94b3b2d60897f024d763f2dd4230a6419cd701 {{(pid=74692) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 18 19:04:02 user nova-compute[74692]: INFO nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] image 503b14b1-1e1e-41a7-a748-0e4d907ae048 at (/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701): checking
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] image 503b14b1-1e1e-41a7-a748-0e4d907ae048 at (/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701): image is in use {{(pid=74692) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74692) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Image id a0c5352f-0b08-43ef-9912-c1d815680ecf yields fingerprint 4d76a588d1979dfaff659ad1261e6f0482b8b752 {{(pid=74692) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] ecf7ac8f-0ec0-4c81-9b67-0ad78f178204 is a valid instance name {{(pid=74692) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] 4519eaca-4744-49e2-a3ce-34d3a9fedc77 is a valid instance name {{(pid=74692) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce is a valid instance name {{(pid=74692) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce has a disk file {{(pid=74692) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce is backed by 6a94b3b2d60897f024d763f2dd4230a6419cd701 {{(pid=74692) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] 78457b6e-547c-4134-bf25-371b71693dc1 is a valid instance name {{(pid=74692) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] 78457b6e-547c-4134-bf25-371b71693dc1 has a disk file {{(pid=74692) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 78457b6e-547c-4134-bf25-371b71693dc1 is backed by 6a94b3b2d60897f024d763f2dd4230a6419cd701 {{(pid=74692) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 18 19:04:02 user nova-compute[74692]: WARNING nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Unknown base file: /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed
Nov 18 19:04:02 user nova-compute[74692]: WARNING nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Unknown base file: /opt/stack/data/nova/instances/_base/253ee24bfac4c97da6febfa762d33b0bc2aa69ee
Nov 18 19:04:02 user nova-compute[74692]: WARNING nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Unknown base file: /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f
Nov 18 19:04:02 user nova-compute[74692]: WARNING nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Unknown base file: /opt/stack/data/nova/instances/_base/ba681db75743ae797f0930b18b144c2b4a369d64
Nov 18 19:04:02 user nova-compute[74692]: WARNING nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Unknown base file: /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d
Nov 18 19:04:02 user nova-compute[74692]: WARNING nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Unknown base file: /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe
Nov 18 19:04:02 user nova-compute[74692]: WARNING nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Unknown base file: /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de
Nov 18 19:04:02 user nova-compute[74692]: WARNING nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Unknown base file: /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39
Nov 18 19:04:02 user nova-compute[74692]: WARNING nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Unknown base file: /opt/stack/data/nova/instances/_base/437c4b0d16665a5a8f9a51ac9fb5008fa5da712d
Nov 18 19:04:02 user nova-compute[74692]: INFO nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Active base files: /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701
Nov 18 19:04:02 user nova-compute[74692]: INFO nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Removable base files: /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed /opt/stack/data/nova/instances/_base/253ee24bfac4c97da6febfa762d33b0bc2aa69ee /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f /opt/stack/data/nova/instances/_base/ba681db75743ae797f0930b18b144c2b4a369d64 /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39 /opt/stack/data/nova/instances/_base/437c4b0d16665a5a8f9a51ac9fb5008fa5da712d
Nov 18 19:04:02 user nova-compute[74692]: INFO nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7d2e942f16d61fc19875780fc1c5781911eee9ed
Nov 18 19:04:02 user nova-compute[74692]: INFO nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/253ee24bfac4c97da6febfa762d33b0bc2aa69ee
Nov 18 19:04:02 user nova-compute[74692]: INFO nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5cc7daf44f837ed6b8d93d340a8eebf1a7b2429f
Nov 18 19:04:02 user nova-compute[74692]: INFO nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ba681db75743ae797f0930b18b144c2b4a369d64
Nov 18 19:04:02 user nova-compute[74692]: INFO nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/94a7a3685e3312f3dcbdcebd95146b31549f3e4d
Nov 18 19:04:02 user nova-compute[74692]: INFO nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a2c5671fbc4964770d5d5e05fce1fe2e5f5fbbfe
Nov 18 19:04:02 user nova-compute[74692]: INFO nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/381b3bfd6fe8e3107878f9f107b6129414b698de
Nov 18 19:04:02 user nova-compute[74692]: INFO nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bd086d4fcfe8c2d9c492684aad1981db24a52a39
Nov 18 19:04:02 user nova-compute[74692]: INFO nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/437c4b0d16665a5a8f9a51ac9fb5008fa5da712d
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Verification complete {{(pid=74692) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Verify swap images {{(pid=74692) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 18 19:04:02 user nova-compute[74692]: DEBUG nova.virt.libvirt.imagecache [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Verify ephemeral images {{(pid=74692) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 18 19:04:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEhVSHMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:04:05 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:04:05 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:04:05 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0189c7-6fd7-4bc8-b582-124ac19fef91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 19:04:05 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b976c191-0315-4f87-91db-36cdd2ddbb03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6] added
Nov 18 19:04:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fca8ff-b629-4808-b5c5-3df6c574f56d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd74ebf3-6c7d-4369-b436-e081902c38c2]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eEhVSHMb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eEhVSHMb" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[81985a6f-186f-4286-8d11-cb9d5950972b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eEhVSHMb'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5870606-4dc7-4cc8-ae9e-ff7ed1a1238e]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba781758-a1d5-4d0b-81b5-48fa2ccaa1ea]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:04:05 user nova-compute[74692]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)
Nov 18 19:04:05 user nova-compute[74692]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)
Nov 18 19:04:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:04:05 user nova-compute[74692]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)
Nov 18 19:04:05 user nova-compute[74692]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)
Nov 18 19:04:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdb5ecd-74a8-441a-85d2-0617863c2bc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6, portal: 172.16.0.220,3260]
Nov 18 19:04:05 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6, portal: 172.16.0.220,3260] successful.
Nov 18 19:04:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44caeba-60d9-4ad4-a737-e3348474e2d6]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[db81ffe1-6901-46fc-93c9-f8ab0b87de7b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:04:05 user nova-compute[74692]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)
Nov 18 19:04:05 user nova-compute[74692]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)
Nov 18 19:04:05 user nova-compute[74692]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 (non-flash)
Nov 18 19:04:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:04:05 user nova-compute[74692]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)
Nov 18 19:04:05 user nova-compute[74692]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)
Nov 18 19:04:05 user nova-compute[74692]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 (non-flash)
Nov 18 19:04:05 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] HCTL ('36', '-', '-', 0) found on session 58 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71fcceb-9d96-4e7e-9bac-348568d4c9d2]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Searching for a device in session 58 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:04:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEhVSHMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 19:04:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:04:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23130373865326562', 'path': '/dev/sde'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:04:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130373865326562', 'path': '/dev/sde'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 19:04:06 user nova-compute[74692]: DEBUG nova.objects.instance [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lazy-loading 'flavor' on Instance uuid 78457b6e-547c-4134-bf25-371b71693dc1 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:04:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 19:04:06 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:04:06 user nova-compute[74692]:   <source dev="/dev/sde"/>
Nov 18 19:04:06 user nova-compute[74692]:   <target dev="vdc" bus="virtio"/>
Nov 18 19:04:06 user nova-compute[74692]:   <serial>3e8a7b88-2703-46ab-b1a9-71a6f182c1e6</serial>
Nov 18 19:04:06 user nova-compute[74692]: </disk>
Nov 18 19:04:06 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 19:04:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:04:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:04:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:04:07 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] No VIF found with MAC fa:16:3e:f0:af:d1, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:04:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6d1a184d-a462-4d29-86bc-e4320ec0e2a0 tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.614s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "78457b6e-547c-4134-bf25-371b71693dc1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:08 user nova-compute[74692]: INFO nova.compute.manager [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Detaching volume 3e8a7b88-2703-46ab-b1a9-71a6f182c1e6
Nov 18 19:04:09 user nova-compute[74692]: INFO nova.virt.block_device [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Attempting to driver detach volume 3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 from mountpoint /dev/vdc
Nov 18 19:04:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Attempting to detach device vdc from instance 78457b6e-547c-4134-bf25-371b71693dc1 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 19:04:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:04:09 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:04:09 user nova-compute[74692]:   <source dev="/dev/sde"/>
Nov 18 19:04:09 user nova-compute[74692]:   <target dev="vdc" bus="virtio"/>
Nov 18 19:04:09 user nova-compute[74692]:   <serial>3e8a7b88-2703-46ab-b1a9-71a6f182c1e6</serial>
Nov 18 19:04:09 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 19:04:09 user nova-compute[74692]: </disk>
Nov 18 19:04:09 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:04:09 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Successfully detached device vdc from instance 78457b6e-547c-4134-bf25-371b71693dc1 from the persistent domain config.
Nov 18 19:04:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 78457b6e-547c-4134-bf25-371b71693dc1 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 19:04:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:04:09 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:04:09 user nova-compute[74692]:   <source dev="/dev/sde"/>
Nov 18 19:04:09 user nova-compute[74692]:   <target dev="vdc" bus="virtio"/>
Nov 18 19:04:09 user nova-compute[74692]:   <serial>3e8a7b88-2703-46ab-b1a9-71a6f182c1e6</serial>
Nov 18 19:04:09 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 19:04:09 user nova-compute[74692]: </disk>
Nov 18 19:04:09 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:04:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 78457b6e-547c-4134-bf25-371b71693dc1 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 19:04:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:10 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 19:04:11 user nova-compute[74692]: INFO nova.compute.claims [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Claim successful on node user
Nov 18 19:04:11 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 19:04:11 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 19:04:11 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG nova.policy [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'def7f7c9ff4f4a29a840ace22d509755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7475e741034a4302b0ab193f1b6c67d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 19:04:11 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Creating image(s)
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "/opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "/opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk 1073741824" returned: 0 in 0.048s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Successfully created port: ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Cannot resize image /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Ensure instance console log exists: /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Successfully updated port: ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "refresh_cache-5b24b127-17d8-4e1e-9384-fdebb3ac312d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquired lock "refresh_cache-5b24b127-17d8-4e1e-9384-fdebb3ac312d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.compute.manager [req-3c414b61-d5f8-4b42-94cb-8322e9acf38b req-3e3e3467-0f0d-4ddd-a2d2-687e5f3bb445 service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Received event network-changed-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.compute.manager [req-3c414b61-d5f8-4b42-94cb-8322e9acf38b req-3e3e3467-0f0d-4ddd-a2d2-687e5f3bb445 service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Refreshing instance network info cache due to event network-changed-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3c414b61-d5f8-4b42-94cb-8322e9acf38b req-3e3e3467-0f0d-4ddd-a2d2-687e5f3bb445 service nova] Acquiring lock "refresh_cache-5b24b127-17d8-4e1e-9384-fdebb3ac312d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.network.neutron [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Updating instance_info_cache with network_info: [{"id": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "address": "fa:16:3e:a0:bb:5c", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef90c059-3b", "ovs_interfaceid": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Releasing lock "refresh_cache-5b24b127-17d8-4e1e-9384-fdebb3ac312d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Instance network_info: |[{"id": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "address": "fa:16:3e:a0:bb:5c", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef90c059-3b", "ovs_interfaceid": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3c414b61-d5f8-4b42-94cb-8322e9acf38b req-3e3e3467-0f0d-4ddd-a2d2-687e5f3bb445 service nova] Acquired lock "refresh_cache-5b24b127-17d8-4e1e-9384-fdebb3ac312d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.network.neutron [req-3c414b61-d5f8-4b42-94cb-8322e9acf38b req-3e3e3467-0f0d-4ddd-a2d2-687e5f3bb445 service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Refreshing network info cache for port ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Start _get_guest_xml network_info=[{"id": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "address": "fa:16:3e:a0:bb:5c", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef90c059-3b", "ovs_interfaceid": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 19:04:12 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:04:12 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 19:04:12 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-451458097',display_name='tempest-AttachVolumeNegativeTest-server-451458097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-451458097',id=48,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5u5/ZAHHJWAQWuDvvFv/Bz/uTIKQEAcrciKhgqcQIOYxDSDO5Ibx7cHl7eYU2LSLL8kGQbgXqecsThGXmJVltzBR6KpkIXjKO7J0BMNB/jTGRn6xQqB3gKVTrNQfw3Ow==',key_name='tempest-keypair-1590893607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7475e741034a4302b0ab193f1b6c67d2',ramdisk_id='',reservation_id='r-toamwy5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-542263902',owner_user_name='tempest-AttachVolumeNegativeTest-542263902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:04:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='def7f7c9ff4f4a29a840ace22d509755',uuid=5b24b127-17d8-4e1e-9384-fdebb3ac312d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "address": "fa:16:3e:a0:bb:5c", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef90c059-3b", "ovs_interfaceid": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converting VIF {"id": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "address": "fa:16:3e:a0:bb:5c", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef90c059-3b", "ovs_interfaceid": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bb:5c,bridge_name='br-int',has_traffic_filtering=True,id=ef90c059-3bb9-4d7f-ba03-7e015eb13bb8,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef90c059-3b') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG nova.objects.instance [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b24b127-17d8-4e1e-9384-fdebb3ac312d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] End _get_guest_xml xml=<domain type="kvm">
Nov 18 19:04:13 user nova-compute[74692]:   <uuid>5b24b127-17d8-4e1e-9384-fdebb3ac312d</uuid>
Nov 18 19:04:13 user nova-compute[74692]:   <name>instance-00000030</name>
Nov 18 19:04:13 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 19:04:13 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 19:04:13 user nova-compute[74692]:   <metadata>
Nov 18 19:04:13 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 19:04:13 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 19:04:13 user nova-compute[74692]:       <nova:name>tempest-AttachVolumeNegativeTest-server-451458097</nova:name>
Nov 18 19:04:13 user nova-compute[74692]:       <nova:creationTime>2023-11-18 19:04:12</nova:creationTime>
Nov 18 19:04:13 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 19:04:13 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 19:04:13 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 19:04:13 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 19:04:13 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 19:04:13 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 19:04:13 user nova-compute[74692]:       </nova:flavor>
Nov 18 19:04:13 user nova-compute[74692]:       <nova:owner>
Nov 18 19:04:13 user nova-compute[74692]:         <nova:user uuid="def7f7c9ff4f4a29a840ace22d509755">tempest-AttachVolumeNegativeTest-542263902-project-member</nova:user>
Nov 18 19:04:13 user nova-compute[74692]:         <nova:project uuid="7475e741034a4302b0ab193f1b6c67d2">tempest-AttachVolumeNegativeTest-542263902</nova:project>
Nov 18 19:04:13 user nova-compute[74692]:       </nova:owner>
Nov 18 19:04:13 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 19:04:13 user nova-compute[74692]:       <nova:ports>
Nov 18 19:04:13 user nova-compute[74692]:         <nova:port uuid="ef90c059-3bb9-4d7f-ba03-7e015eb13bb8">
Nov 18 19:04:13 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 19:04:13 user nova-compute[74692]:         </nova:port>
Nov 18 19:04:13 user nova-compute[74692]:       </nova:ports>
Nov 18 19:04:13 user nova-compute[74692]:     </nova:instance>
Nov 18 19:04:13 user nova-compute[74692]:   </metadata>
Nov 18 19:04:13 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 19:04:13 user nova-compute[74692]:     <system>
Nov 18 19:04:13 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 19:04:13 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 19:04:13 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 19:04:13 user nova-compute[74692]:       <entry name="serial">5b24b127-17d8-4e1e-9384-fdebb3ac312d</entry>
Nov 18 19:04:13 user nova-compute[74692]:       <entry name="uuid">5b24b127-17d8-4e1e-9384-fdebb3ac312d</entry>
Nov 18 19:04:13 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 19:04:13 user nova-compute[74692]:     </system>
Nov 18 19:04:13 user nova-compute[74692]:   </sysinfo>
Nov 18 19:04:13 user nova-compute[74692]:   <os>
Nov 18 19:04:13 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 19:04:13 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 19:04:13 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 19:04:13 user nova-compute[74692]:   </os>
Nov 18 19:04:13 user nova-compute[74692]:   <features>
Nov 18 19:04:13 user nova-compute[74692]:     <acpi/>
Nov 18 19:04:13 user nova-compute[74692]:     <apic/>
Nov 18 19:04:13 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 19:04:13 user nova-compute[74692]:   </features>
Nov 18 19:04:13 user nova-compute[74692]:   <clock offset="utc">
Nov 18 19:04:13 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 19:04:13 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 19:04:13 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 19:04:13 user nova-compute[74692]:   </clock>
Nov 18 19:04:13 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 19:04:13 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 19:04:13 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 19:04:13 user nova-compute[74692]:   </cpu>
Nov 18 19:04:13 user nova-compute[74692]:   <devices>
Nov 18 19:04:13 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 19:04:13 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 19:04:13 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk"/>
Nov 18 19:04:13 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 19:04:13 user nova-compute[74692]:     </disk>
Nov 18 19:04:13 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 19:04:13 user nova-compute[74692]:       <mac address="fa:16:3e:a0:bb:5c"/>
Nov 18 19:04:13 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:04:13 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 19:04:13 user nova-compute[74692]:       <target dev="tapef90c059-3b"/>
Nov 18 19:04:13 user nova-compute[74692]:     </interface>
Nov 18 19:04:13 user nova-compute[74692]:     <serial type="pty">
Nov 18 19:04:13 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/console.log" append="off"/>
Nov 18 19:04:13 user nova-compute[74692]:     </serial>
Nov 18 19:04:13 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 19:04:13 user nova-compute[74692]:     <video>
Nov 18 19:04:13 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:04:13 user nova-compute[74692]:     </video>
Nov 18 19:04:13 user nova-compute[74692]:     <rng model="virtio">
Nov 18 19:04:13 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 19:04:13 user nova-compute[74692]:     </rng>
Nov 18 19:04:13 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 19:04:13 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 19:04:13 user nova-compute[74692]:       <stats period="10"/>
Nov 18 19:04:13 user nova-compute[74692]:     </memballoon>
Nov 18 19:04:13 user nova-compute[74692]:   </devices>
Nov 18 19:04:13 user nova-compute[74692]: </domain>
Nov 18 19:04:13 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-451458097',display_name='tempest-AttachVolumeNegativeTest-server-451458097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-451458097',id=48,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5u5/ZAHHJWAQWuDvvFv/Bz/uTIKQEAcrciKhgqcQIOYxDSDO5Ibx7cHl7eYU2LSLL8kGQbgXqecsThGXmJVltzBR6KpkIXjKO7J0BMNB/jTGRn6xQqB3gKVTrNQfw3Ow==',key_name='tempest-keypair-1590893607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7475e741034a4302b0ab193f1b6c67d2',ramdisk_id='',reservation_id='r-toamwy5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-542263902',owner_user_name='tempest-AttachVolumeNegativeTest-542263902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:04:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='def7f7c9ff4f4a29a840ace22d509755',uuid=5b24b127-17d8-4e1e-9384-fdebb3ac312d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "address": "fa:16:3e:a0:bb:5c", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef90c059-3b", "ovs_interfaceid": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converting VIF {"id": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "address": "fa:16:3e:a0:bb:5c", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef90c059-3b", "ovs_interfaceid": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bb:5c,bridge_name='br-int',has_traffic_filtering=True,id=ef90c059-3bb9-4d7f-ba03-7e015eb13bb8,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef90c059-3b') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG os_vif [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bb:5c,bridge_name='br-int',has_traffic_filtering=True,id=ef90c059-3bb9-4d7f-ba03-7e015eb13bb8,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef90c059-3b') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a17bb44-4e54-5aaf-9b48-1692279e94df', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef90c059-3b, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef90c059-3b, col_values=(('qos', UUID('6f7dc313-353f-4e42-bc0b-89ebc6ebe722')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef90c059-3b, col_values=(('external_ids', {'iface-id': 'ef90c059-3bb9-4d7f-ba03-7e015eb13bb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:bb:5c', 'vm-uuid': '5b24b127-17d8-4e1e-9384-fdebb3ac312d'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:13 user nova-compute[74692]: INFO os_vif [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bb:5c,bridge_name='br-int',has_traffic_filtering=True,id=ef90c059-3bb9-4d7f-ba03-7e015eb13bb8,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef90c059-3b')
Nov 18 19:04:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No VIF found with MAC fa:16:3e:a0:bb:5c, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG nova.network.neutron [req-3c414b61-d5f8-4b42-94cb-8322e9acf38b req-3e3e3467-0f0d-4ddd-a2d2-687e5f3bb445 service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Updated VIF entry in instance network info cache for port ef90c059-3bb9-4d7f-ba03-7e015eb13bb8. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG nova.network.neutron [req-3c414b61-d5f8-4b42-94cb-8322e9acf38b req-3e3e3467-0f0d-4ddd-a2d2-687e5f3bb445 service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Updating instance_info_cache with network_info: [{"id": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "address": "fa:16:3e:a0:bb:5c", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef90c059-3b", "ovs_interfaceid": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-3c414b61-d5f8-4b42-94cb-8322e9acf38b req-3e3e3467-0f0d-4ddd-a2d2-687e5f3bb445 service nova] Releasing lock "refresh_cache-5b24b127-17d8-4e1e-9384-fdebb3ac312d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:04:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-13ddb1b9-ce13-4230-98a3-058c8474a357 req-08b8126d-1d01-4795-9c02-ce497929008a service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Received event network-vif-plugged-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:04:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-13ddb1b9-ce13-4230-98a3-058c8474a357 req-08b8126d-1d01-4795-9c02-ce497929008a service nova] Acquiring lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-13ddb1b9-ce13-4230-98a3-058c8474a357 req-08b8126d-1d01-4795-9c02-ce497929008a service nova] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:14 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-13ddb1b9-ce13-4230-98a3-058c8474a357 req-08b8126d-1d01-4795-9c02-ce497929008a service nova] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:14 user nova-compute[74692]: DEBUG nova.compute.manager [req-13ddb1b9-ce13-4230-98a3-058c8474a357 req-08b8126d-1d01-4795-9c02-ce497929008a service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] No waiting events found dispatching network-vif-plugged-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:04:14 user nova-compute[74692]: WARNING nova.compute.manager [req-13ddb1b9-ce13-4230-98a3-058c8474a357 req-08b8126d-1d01-4795-9c02-ce497929008a service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Received unexpected event network-vif-plugged-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 for instance with vm_state building and task_state spawning.
Nov 18 19:04:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 19:04:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 19:04:16 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Instance spawned successfully.
Nov 18 19:04:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 19:04:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:04:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:04:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:04:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:04:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:04:16 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:04:16 user nova-compute[74692]: INFO nova.compute.manager [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 18 19:04:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 19:04:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-815280de-4eb2-42cb-9b24-9f30c05fe759 req-f59ceae1-e137-4561-b1ae-1ccd50df233f service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Received event network-vif-plugged-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:04:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-815280de-4eb2-42cb-9b24-9f30c05fe759 req-f59ceae1-e137-4561-b1ae-1ccd50df233f service nova] Acquiring lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-815280de-4eb2-42cb-9b24-9f30c05fe759 req-f59ceae1-e137-4561-b1ae-1ccd50df233f service nova] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-815280de-4eb2-42cb-9b24-9f30c05fe759 req-f59ceae1-e137-4561-b1ae-1ccd50df233f service nova] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:16 user nova-compute[74692]: DEBUG nova.compute.manager [req-815280de-4eb2-42cb-9b24-9f30c05fe759 req-f59ceae1-e137-4561-b1ae-1ccd50df233f service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] No waiting events found dispatching network-vif-plugged-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:04:16 user nova-compute[74692]: WARNING nova.compute.manager [req-815280de-4eb2-42cb-9b24-9f30c05fe759 req-f59ceae1-e137-4561-b1ae-1ccd50df233f service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Received unexpected event network-vif-plugged-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 for instance with vm_state active and task_state None.
Nov 18 19:04:16 user nova-compute[74692]: INFO nova.compute.manager [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Took 5.73 seconds to build instance.
Nov 18 19:04:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-6f1150ea-54b1-4664-8e26-f29077515333 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.822s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:27 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:04:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:04:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:04:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:04:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:04:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:29 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 78457b6e-547c-4134-bf25-371b71693dc1 is timed out.
Nov 18 19:04:29 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Successfully detached device vdc from instance 78457b6e-547c-4134-bf25-371b71693dc1 from the live domain config.
Nov 18 19:04:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEhVSHMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:04:29 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdd138b-1818-4c33-a07e-476c91e2a0c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:04:29 user nova-compute[74692]: No targets found.
Nov 18 19:04:29 user nova-compute[74692]: iSNS:
Nov 18 19:04:29 user nova-compute[74692]: No targets found.
Nov 18 19:04:29 user nova-compute[74692]: STATIC:
Nov 18 19:04:29 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6
Nov 18 19:04:29 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:04:29 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:04:29 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6
Nov 18 19:04:29 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:04:29 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:04:29 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84
Nov 18 19:04:29 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:04:29 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:04:29 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84
Nov 18 19:04:29 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:04:29 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:04:29 user nova-compute[74692]: FIRMWARE:
Nov 18 19:04:29 user nova-compute[74692]: No targets found.
Nov 18 19:04:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:04:29 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:04:29 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.049s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2417006d-d23c-4c00-812e-79441482ba72]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef893738-b93c-4a8d-a9d4-6ac65686d6ec]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:04:29 user nova-compute[74692]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)
Nov 18 19:04:29 user nova-compute[74692]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)
Nov 18 19:04:29 user nova-compute[74692]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 (non-flash)
Nov 18 19:04:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:04:29 user nova-compute[74692]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)
Nov 18 19:04:29 user nova-compute[74692]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)
Nov 18 19:04:29 user nova-compute[74692]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 (non-flash)
Nov 18 19:04:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c4622290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6'): ({'sde'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Removing single pathed devices sde {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0b3768-18a6-4f35-8e46-274502091ca2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[62586c87-166b-4035-ba62-b204b6575c6b]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Flushing IO for device /dev/sde {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4476ac4-60d1-47aa-bd83-209c5f0930d0]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.027s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4318c3fe-0b52-439c-9a36-5832031de228]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] SCSI volumes sde have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[585f1b60-55e6-442f-b008-7f51a6b499f8]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2196db1f-8948-4ab0-9a0f-c99163990551]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6, portal: 172.16.0.220,3260]
Nov 18 19:04:29 user nova-compute[74692]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6, portal: 172.16.0.220,3260] successful.
Nov 18 19:04:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a7b88-2703-46ab-b1a9-71a6f182c1e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cdd26a-c227-40f5-a4b9-62dd14567a18]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] <== disconnect_volume: return (325ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:04:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:04:30 user nova-compute[74692]: DEBUG nova.objects.instance [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lazy-loading 'flavor' on Instance uuid 78457b6e-547c-4134-bf25-371b71693dc1 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:04:30 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28bdae71-3da2-4d53-9fad-06dac5ea1dcc tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.697s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:04:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:04:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:34 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:04:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:04:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:04:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:04:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:36 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:36 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:04:36 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:04:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8293MB free_disk=24.981109619140625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:04:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 4519eaca-4744-49e2-a3ce-34d3a9fedc77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:04:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 78457b6e-547c-4134-bf25-371b71693dc1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:04:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance ecf7ac8f-0ec0-4c81-9b67-0ad78f178204 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:04:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:04:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5b24b127-17d8-4e1e-9384-fdebb3ac312d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:04:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:04:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:04:36 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:04:36 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:04:37 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:04:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:37 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:04:37 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 19:04:38 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:04:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:04:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-a8d418fe-9e24-4104-8b38-34895704c149 req-210296ca-dea9-4c11-9093-00be3f43d3f2 service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Received event network-changed-1db65409-17e5-4526-b1f2-c15fd1ba41a1 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-a8d418fe-9e24-4104-8b38-34895704c149 req-210296ca-dea9-4c11-9093-00be3f43d3f2 service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Refreshing instance network info cache due to event network-changed-1db65409-17e5-4526-b1f2-c15fd1ba41a1. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a8d418fe-9e24-4104-8b38-34895704c149 req-210296ca-dea9-4c11-9093-00be3f43d3f2 service nova] Acquiring lock "refresh_cache-ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a8d418fe-9e24-4104-8b38-34895704c149 req-210296ca-dea9-4c11-9093-00be3f43d3f2 service nova] Acquired lock "refresh_cache-ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG nova.network.neutron [req-a8d418fe-9e24-4104-8b38-34895704c149 req-210296ca-dea9-4c11-9093-00be3f43d3f2 service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Refreshing network info cache for port 1db65409-17e5-4526-b1f2-c15fd1ba41a1 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG nova.network.neutron [req-a8d418fe-9e24-4104-8b38-34895704c149 req-210296ca-dea9-4c11-9093-00be3f43d3f2 service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Updated VIF entry in instance network info cache for port 1db65409-17e5-4526-b1f2-c15fd1ba41a1. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG nova.network.neutron [req-a8d418fe-9e24-4104-8b38-34895704c149 req-210296ca-dea9-4c11-9093-00be3f43d3f2 service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Updating instance_info_cache with network_info: [{"id": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "address": "fa:16:3e:61:55:73", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db65409-17", "ovs_interfaceid": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a8d418fe-9e24-4104-8b38-34895704c149 req-210296ca-dea9-4c11-9093-00be3f43d3f2 service nova] Releasing lock "refresh_cache-ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:41 user nova-compute[74692]: INFO nova.compute.manager [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Terminating instance
Nov 18 19:04:41 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-d81a8897-08d1-4c66-be77-f50f68d64ca2 req-8491c1f3-3f09-4f04-9000-078dc2d29bee service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Received event network-vif-unplugged-1db65409-17e5-4526-b1f2-c15fd1ba41a1 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d81a8897-08d1-4c66-be77-f50f68d64ca2 req-8491c1f3-3f09-4f04-9000-078dc2d29bee service nova] Acquiring lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d81a8897-08d1-4c66-be77-f50f68d64ca2 req-8491c1f3-3f09-4f04-9000-078dc2d29bee service nova] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d81a8897-08d1-4c66-be77-f50f68d64ca2 req-8491c1f3-3f09-4f04-9000-078dc2d29bee service nova] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-d81a8897-08d1-4c66-be77-f50f68d64ca2 req-8491c1f3-3f09-4f04-9000-078dc2d29bee service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] No waiting events found dispatching network-vif-unplugged-1db65409-17e5-4526-b1f2-c15fd1ba41a1 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:04:41 user nova-compute[74692]: DEBUG nova.compute.manager [req-d81a8897-08d1-4c66-be77-f50f68d64ca2 req-8491c1f3-3f09-4f04-9000-078dc2d29bee service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Received event network-vif-unplugged-1db65409-17e5-4526-b1f2-c15fd1ba41a1 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:42 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Instance destroyed successfully.
Nov 18 19:04:42 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lazy-loading 'resources' on Instance uuid ecf7ac8f-0ec0-4c81-9b67-0ad78f178204 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1912581183',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1912581183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1912581183',id=46,image_ref='a0c5352f-0b08-43ef-9912-c1d815680ecf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAOkAbZO5p6NmoxLUzJ5vDYCUHbM8TEbnHiovAA7yQIxUWIWAj6Fn9u1elwTRjbzBu1X7erRIuI3EReRcZaPHrxL2R/dfXowEMYb+OCYKlpuS4mFTbaxCNhsmbOl/rYSg==',key_name='tempest-keypair-370155261',keypairs=<?>,launch_index=0,launched_at=2023-11-18T19:03:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-c65vd0m6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1940625728',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T19:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=ecf7ac8f-0ec0-4c81-9b67-0ad78f178204,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "address": "fa:16:3e:61:55:73", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db65409-17", "ovs_interfaceid": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "address": "fa:16:3e:61:55:73", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db65409-17", "ovs_interfaceid": "1db65409-17e5-4526-b1f2-c15fd1ba41a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:55:73,bridge_name='br-int',has_traffic_filtering=True,id=1db65409-17e5-4526-b1f2-c15fd1ba41a1,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db65409-17') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_vif [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:55:73,bridge_name='br-int',has_traffic_filtering=True,id=1db65409-17e5-4526-b1f2-c15fd1ba41a1,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db65409-17') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1db65409-17, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05a89ac7-af18-4039-8f70-8b8be5f729f5) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:04:42 user nova-compute[74692]: INFO os_vif [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:55:73,bridge_name='br-int',has_traffic_filtering=True,id=1db65409-17e5-4526-b1f2-c15fd1ba41a1,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db65409-17')
Nov 18 19:04:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CjyMGlAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:04:42 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[763e0f3b-933c-4df9-b797-93882fc5a6c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:04:42 user nova-compute[74692]: No targets found.
Nov 18 19:04:42 user nova-compute[74692]: iSNS:
Nov 18 19:04:42 user nova-compute[74692]: No targets found.
Nov 18 19:04:42 user nova-compute[74692]: STATIC:
Nov 18 19:04:42 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6
Nov 18 19:04:42 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:04:42 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:04:42 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84
Nov 18 19:04:42 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:04:42 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:04:42 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84
Nov 18 19:04:42 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:04:42 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:04:42 user nova-compute[74692]: FIRMWARE:
Nov 18 19:04:42 user nova-compute[74692]: No targets found.
Nov 18 19:04:42 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:04:42 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:04:42 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[da25c3db-7328-4bfd-a5e9-995fc8e8831d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1929e2-d92d-4662-bd94-5cf1294ff44f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:04:42 user nova-compute[74692]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)
Nov 18 19:04:42 user nova-compute[74692]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)
Nov 18 19:04:42 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:04:42 user nova-compute[74692]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 (non-flash)
Nov 18 19:04:42 user nova-compute[74692]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)
Nov 18 19:04:42 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c41efa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaf9e58-c7d1-43ff-80bd-60bb3590fa6a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d41034-fb5e-4579-a0a7-702bda085af1]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4408fde8-e5aa-410b-bbe1-b26864100a63]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[237f71f6-a6ea-4b30-95a1-925269f1833f]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23331316265636531', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a6bd70d9', '/dev/disk/by-id/scsi-1SCST_BIOa6bd70d9-311bece19f82c2e2') {{(pid=84932) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4940206e-fd85-42cf-8c67-0e5ca42fa6d8]: (4, None) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fe1156-e2f5-4bdb-ac88-9840e9f0c0bf]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4698b5bf-a21f-4363-b163-9ce27c804736]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84, portal: 172.16.0.220,3260]
Nov 18 19:04:42 user nova-compute[74692]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84, portal: 172.16.0.220,3260] successful.
Nov 18 19:04:42 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672d12d8-5b10-4a6d-9792-ff3d92544e84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[434b454b-c0a4-4a8a-bfcc-14b7d835d67c]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== disconnect_volume: return (302ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:04:42 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Deleting instance files /opt/stack/data/nova/instances/ecf7ac8f-0ec0-4c81-9b67-0ad78f178204_del
Nov 18 19:04:42 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Deletion of /opt/stack/data/nova/instances/ecf7ac8f-0ec0-4c81-9b67-0ad78f178204_del complete
Nov 18 19:04:42 user nova-compute[74692]: INFO nova.compute.manager [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:04:42 user nova-compute[74692]: WARNING nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] While synchronizing instance power states, found 5 instances in the database and 4 instances on the hypervisor.
Nov 18 19:04:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 4519eaca-4744-49e2-a3ce-34d3a9fedc77 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 78457b6e-547c-4134-bf25-371b71693dc1 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid 5b24b127-17d8-4e1e-9384-fdebb3ac312d {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Triggering sync for uuid ecf7ac8f-0ec0-4c81-9b67-0ad78f178204 {{(pid=74692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "78457b6e-547c-4134-bf25-371b71693dc1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "78457b6e-547c-4134-bf25-371b71693dc1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "78457b6e-547c-4134-bf25-371b71693dc1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:42 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:04:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:43 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:04:43 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Took 0.70 seconds to deallocate network for instance.
Nov 18 19:04:43 user nova-compute[74692]: DEBUG nova.compute.manager [req-ffe64a0c-305d-434d-ae8d-746327d50a9d req-d0c55b30-7234-432d-834d-ab92aa0b1959 service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Received event network-vif-deleted-1db65409-17e5-4526-b1f2-c15fd1ba41a1 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:04:43 user nova-compute[74692]: INFO nova.compute.manager [req-ffe64a0c-305d-434d-ae8d-746327d50a9d req-d0c55b30-7234-432d-834d-ab92aa0b1959 service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Neutron deleted interface 1db65409-17e5-4526-b1f2-c15fd1ba41a1; detaching it from the instance and deleting it from the info cache
Nov 18 19:04:43 user nova-compute[74692]: DEBUG nova.network.neutron [req-ffe64a0c-305d-434d-ae8d-746327d50a9d req-d0c55b30-7234-432d-834d-ab92aa0b1959 service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:04:43 user nova-compute[74692]: DEBUG nova.compute.manager [req-ffe64a0c-305d-434d-ae8d-746327d50a9d req-d0c55b30-7234-432d-834d-ab92aa0b1959 service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Detach interface failed, port_id=1db65409-17e5-4526-b1f2-c15fd1ba41a1, reason: Instance ecf7ac8f-0ec0-4c81-9b67-0ad78f178204 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 19:04:43 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:04:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-938dcc18-e8b9-4717-be30-fa2e2bbcb8fa req-96f04e0e-2f8a-4325-8cf9-b50ab02317c5 service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Received event network-vif-plugged-1db65409-17e5-4526-b1f2-c15fd1ba41a1 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:04:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-938dcc18-e8b9-4717-be30-fa2e2bbcb8fa req-96f04e0e-2f8a-4325-8cf9-b50ab02317c5 service nova] Acquiring lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-938dcc18-e8b9-4717-be30-fa2e2bbcb8fa req-96f04e0e-2f8a-4325-8cf9-b50ab02317c5 service nova] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-938dcc18-e8b9-4717-be30-fa2e2bbcb8fa req-96f04e0e-2f8a-4325-8cf9-b50ab02317c5 service nova] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-938dcc18-e8b9-4717-be30-fa2e2bbcb8fa req-96f04e0e-2f8a-4325-8cf9-b50ab02317c5 service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] No waiting events found dispatching network-vif-plugged-1db65409-17e5-4526-b1f2-c15fd1ba41a1 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:04:44 user nova-compute[74692]: WARNING nova.compute.manager [req-938dcc18-e8b9-4717-be30-fa2e2bbcb8fa req-96f04e0e-2f8a-4325-8cf9-b50ab02317c5 service nova] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Received unexpected event network-vif-plugged-1db65409-17e5-4526-b1f2-c15fd1ba41a1 for instance with vm_state active and task_state deleting.
Nov 18 19:04:44 user nova-compute[74692]: INFO nova.compute.manager [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Took 1.01 seconds to detach 1 volumes for instance.
Nov 18 19:04:44 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] Deleting volume: 672d12d8-5b10-4a6d-9792-ff3d92544e84 {{(pid=74692) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 19:04:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:44 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:04:44 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:04:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:44 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:04:44 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:04:44 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:04:44 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 19:04:44 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Deleted allocations for instance ecf7ac8f-0ec0-4c81-9b67-0ad78f178204
Nov 18 19:04:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-4519eaca-4744-49e2-a3ce-34d3a9fedc77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:04:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-4519eaca-4744-49e2-a3ce-34d3a9fedc77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:04:45 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:04:45 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid 4519eaca-4744-49e2-a3ce-34d3a9fedc77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:04:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c70324d9-32d6-4d63-a98a-d56aa5077ac2 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.336s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.122s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:45 user nova-compute[74692]: INFO nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: ecf7ac8f-0ec0-4c81-9b67-0ad78f178204] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 18 19:04:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "ecf7ac8f-0ec0-4c81-9b67-0ad78f178204" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:04:45 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Updating instance_info_cache with network_info: [{"id": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "address": "fa:16:3e:5b:b9:cd", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf4807d9-4e", "ovs_interfaceid": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:04:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-4519eaca-4744-49e2-a3ce-34d3a9fedc77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:04:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:04:46 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:04:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:47 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:04:47 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 19:04:47 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] There are 0 instances to clean {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 19:04:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:04:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:04:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:04:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:04:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:04:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "78457b6e-547c-4134-bf25-371b71693dc1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:04:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:04:59 user nova-compute[74692]: INFO nova.compute.manager [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Detaching volume 131c74a2-4e2d-439f-ac4e-1ac96b5aee84
Nov 18 19:04:59 user nova-compute[74692]: INFO nova.virt.block_device [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Attempting to driver detach volume 131c74a2-4e2d-439f-ac4e-1ac96b5aee84 from mountpoint /dev/vdb
Nov 18 19:04:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Attempting to detach device vdb from instance 78457b6e-547c-4134-bf25-371b71693dc1 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 19:04:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:04:59 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:04:59 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 19:04:59 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:04:59 user nova-compute[74692]:   <serial>131c74a2-4e2d-439f-ac4e-1ac96b5aee84</serial>
Nov 18 19:04:59 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:04:59 user nova-compute[74692]: </disk>
Nov 18 19:04:59 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:04:59 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Successfully detached device vdb from instance 78457b6e-547c-4134-bf25-371b71693dc1 from the persistent domain config.
Nov 18 19:04:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 78457b6e-547c-4134-bf25-371b71693dc1 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 19:04:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:04:59 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:04:59 user nova-compute[74692]:   <source dev="/dev/sdd"/>
Nov 18 19:04:59 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:04:59 user nova-compute[74692]:   <serial>131c74a2-4e2d-439f-ac4e-1ac96b5aee84</serial>
Nov 18 19:04:59 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:04:59 user nova-compute[74692]: </disk>
Nov 18 19:04:59 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:05:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 78457b6e-547c-4134-bf25-371b71693dc1 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 19:05:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:05:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:05:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:05:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:20 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 78457b6e-547c-4134-bf25-371b71693dc1 is timed out.
Nov 18 19:05:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Successfully detached device vdb from instance 78457b6e-547c-4134-bf25-371b71693dc1 from the live domain config.
Nov 18 19:05:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpauedAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:05:20 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a76e264-59ff-437a-b317-594bcce4ef1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:05:20 user nova-compute[74692]: No targets found.
Nov 18 19:05:20 user nova-compute[74692]: iSNS:
Nov 18 19:05:20 user nova-compute[74692]: No targets found.
Nov 18 19:05:20 user nova-compute[74692]: STATIC:
Nov 18 19:05:20 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6
Nov 18 19:05:20 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:05:20 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:05:20 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84
Nov 18 19:05:20 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:05:20 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:05:20 user nova-compute[74692]: FIRMWARE:
Nov 18 19:05:20 user nova-compute[74692]: No targets found.
Nov 18 19:05:20 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:05:20 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:05:20 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1772d954-aa5c-4269-bb89-a610992db024]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6d0da0-aafc-4389-846e-b785678b427c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:05:20 user nova-compute[74692]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)
Nov 18 19:05:20 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:05:20 user nova-compute[74692]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 (non-flash)
Nov 18 19:05:20 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c43cc0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84'): ({'sdd'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Removing single pathed devices sdd {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fef1d22-eb4c-4270-bcba-631d451feefa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7984801f-52f8-4e25-9607-af0abf6be527]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Flushing IO for device /dev/sdd {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[de29f03b-2dc6-49a4-aa2b-de8e1b496daf]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18ec532-e448-41d9-b179-c9cb409a553f]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] SCSI volumes sdd have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0243d359-0535-4cdb-8b94-db86febf3c55]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f62f3b3-0300-4b4f-b318-3df577432838]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84, portal: 172.16.0.220,3260]
Nov 18 19:05:20 user nova-compute[74692]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84, portal: 172.16.0.220,3260] successful.
Nov 18 19:05:20 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:131c74a2-4e2d-439f-ac4e-1ac96b5aee84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7960f012-03ff-4709-93c9-233b4d2cc547]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] <== disconnect_volume: return (290ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:05:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:05:21 user nova-compute[74692]: DEBUG nova.objects.instance [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lazy-loading 'flavor' on Instance uuid 78457b6e-547c-4134-bf25-371b71693dc1 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:05:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-9dd065a7-16ab-4b4c-9758-d987648d9fbd tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.618s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:05:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:26 user nova-compute[74692]: DEBUG nova.compute.manager [req-ddc1ca1e-361e-4429-87fe-fa9f40d66a3d req-18fa8571-1789-4a4a-a9c9-f86a90286b41 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Received event network-changed-065590c8-71bb-4202-af01-656d23704cb9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:05:26 user nova-compute[74692]: DEBUG nova.compute.manager [req-ddc1ca1e-361e-4429-87fe-fa9f40d66a3d req-18fa8571-1789-4a4a-a9c9-f86a90286b41 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Refreshing instance network info cache due to event network-changed-065590c8-71bb-4202-af01-656d23704cb9. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:05:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ddc1ca1e-361e-4429-87fe-fa9f40d66a3d req-18fa8571-1789-4a4a-a9c9-f86a90286b41 service nova] Acquiring lock "refresh_cache-3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:05:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ddc1ca1e-361e-4429-87fe-fa9f40d66a3d req-18fa8571-1789-4a4a-a9c9-f86a90286b41 service nova] Acquired lock "refresh_cache-3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:05:26 user nova-compute[74692]: DEBUG nova.network.neutron [req-ddc1ca1e-361e-4429-87fe-fa9f40d66a3d req-18fa8571-1789-4a4a-a9c9-f86a90286b41 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Refreshing network info cache for port 065590c8-71bb-4202-af01-656d23704cb9 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:05:27 user nova-compute[74692]: DEBUG nova.network.neutron [req-ddc1ca1e-361e-4429-87fe-fa9f40d66a3d req-18fa8571-1789-4a4a-a9c9-f86a90286b41 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Updated VIF entry in instance network info cache for port 065590c8-71bb-4202-af01-656d23704cb9. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:05:27 user nova-compute[74692]: DEBUG nova.network.neutron [req-ddc1ca1e-361e-4429-87fe-fa9f40d66a3d req-18fa8571-1789-4a4a-a9c9-f86a90286b41 service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Updating instance_info_cache with network_info: [{"id": "065590c8-71bb-4202-af01-656d23704cb9", "address": "fa:16:3e:da:b3:8c", "network": {"id": "841612ef-9562-4cd0-8707-6df7c5be44c9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1767401438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94cdb51828ce4e47b876798b91b4c970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065590c8-71", "ovs_interfaceid": "065590c8-71bb-4202-af01-656d23704cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:05:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ddc1ca1e-361e-4429-87fe-fa9f40d66a3d req-18fa8571-1789-4a4a-a9c9-f86a90286b41 service nova] Releasing lock "refresh_cache-3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:05:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquiring lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:05:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:05:29 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lazy-loading 'flavor' on Instance uuid 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:05:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:05:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquiring lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:05:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:05:29 user nova-compute[74692]: INFO nova.compute.manager [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Attaching volume 0994514b-4d31-44e0-a75a-400e96d2e12b to /dev/vdb
Nov 18 19:05:29 user nova-compute[74692]: DEBUG os_brick.utils [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:05:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab6eff9-b623-4c23-96a9-1f156b91c255]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3922d1-195c-49af-8a3f-2e2d918fb1e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[348a6b12-3b42-4a2d-a3a0-d9e0dd887736]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a99eb56-b1e7-47c9-adb4-59309c798328]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:05:30 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 19:05:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff06791-97d6-46b2-b387-82a57b6c8682]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG os_brick.utils [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:05:30 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Updating existing volume attachment record: 397fea89-adab-4577-976e-79042ba3dfda {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 19:05:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:05:34 user nova-compute[74692]: INFO nova.compute.manager [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Terminating instance
Nov 18 19:05:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-c06bf979-b25a-4059-9547-23202e2a67dc req-68a27915-1d8a-414f-b8db-26322aaa55d4 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Received event network-vif-unplugged-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c06bf979-b25a-4059-9547-23202e2a67dc req-68a27915-1d8a-414f-b8db-26322aaa55d4 service nova] Acquiring lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c06bf979-b25a-4059-9547-23202e2a67dc req-68a27915-1d8a-414f-b8db-26322aaa55d4 service nova] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c06bf979-b25a-4059-9547-23202e2a67dc req-68a27915-1d8a-414f-b8db-26322aaa55d4 service nova] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-c06bf979-b25a-4059-9547-23202e2a67dc req-68a27915-1d8a-414f-b8db-26322aaa55d4 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] No waiting events found dispatching network-vif-unplugged-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG nova.compute.manager [req-c06bf979-b25a-4059-9547-23202e2a67dc req-68a27915-1d8a-414f-b8db-26322aaa55d4 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Received event network-vif-unplugged-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 19:05:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:35 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Instance destroyed successfully.
Nov 18 19:05:35 user nova-compute[74692]: DEBUG nova.objects.instance [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lazy-loading 'resources' on Instance uuid 4519eaca-4744-49e2-a3ce-34d3a9fedc77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:00:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1367858043',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1367858043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1367858043',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQfzZ+/xGmBFj4CIP214/OdjGr8N+l2HRk1amFoOI8HMVeF6C1z3MXx7X6q5QvkKm9RO+DT/nltnFSP2o0Eqy8d/QoQBBtNVTU5LbNU61h5L18ZYlXI5UDBP7nBGyYOCg==',key_name='tempest-keypair-824552383',keypairs=<?>,launch_index=0,launched_at=2023-11-18T19:01:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-hcvqha2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T19:01:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=4519eaca-4744-49e2-a3ce-34d3a9fedc77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "address": "fa:16:3e:5b:b9:cd", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf4807d9-4e", "ovs_interfaceid": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "address": "fa:16:3e:5b:b9:cd", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf4807d9-4e", "ovs_interfaceid": "cf4807d9-4efb-4ed4-9d0d-37ab13d21cde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b9:cd,bridge_name='br-int',has_traffic_filtering=True,id=cf4807d9-4efb-4ed4-9d0d-37ab13d21cde,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf4807d9-4e') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_vif [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b9:cd,bridge_name='br-int',has_traffic_filtering=True,id=cf4807d9-4efb-4ed4-9d0d-37ab13d21cde,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf4807d9-4e') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf4807d9-4e, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be9e3372-582a-4162-b3df-3b46672aee06) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:05:35 user nova-compute[74692]: INFO os_vif [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b9:cd,bridge_name='br-int',has_traffic_filtering=True,id=cf4807d9-4efb-4ed4-9d0d-37ab13d21cde,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf4807d9-4e')
Nov 18 19:05:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rMJWPwCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:05:35 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6e052a-d8e5-4373-ab04-2962f2770a5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:05:35 user nova-compute[74692]: No targets found.
Nov 18 19:05:35 user nova-compute[74692]: iSNS:
Nov 18 19:05:35 user nova-compute[74692]: No targets found.
Nov 18 19:05:35 user nova-compute[74692]: STATIC:
Nov 18 19:05:35 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6
Nov 18 19:05:35 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:05:35 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:05:35 user nova-compute[74692]: FIRMWARE:
Nov 18 19:05:35 user nova-compute[74692]: No targets found.
Nov 18 19:05:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:05:35 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:05:35 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[82880fea-1b76-4c22-bfce-b6199144c46e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9cdf65-e360-4ac4-8b96-0dd4eb71232f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:05:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 (non-flash)
Nov 18 19:05:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c4621f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6'): ({'sdc'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Removing single pathed devices sdc {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cce6c6-4cbc-4c15-9cf0-fb01f67aa413]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14a4b19-d6c8-4ed7-bf9b-974d4bab3922]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flushing IO for device /dev/sdc {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef10246a-deaf-4005-9eb3-c442ed0f880d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a455206e-249b-48f1-870a-08ca095b855d]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b850aeff', '/dev/disk/by-id/scsi-23136386534343363', '/dev/disk/by-id/scsi-1SCST_BIOb850aeff-168e443cc6afb554') {{(pid=84932) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[965bb81f-5b1c-42bf-bdd9-8b97f784b89a]: (4, None) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f07c1c-c22b-4cdb-a4ee-a9c4c54fe367]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1055a732-58f4-4de4-8577-d9c3851e162e]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6, portal: 172.16.0.220,3260]
Nov 18 19:05:35 user nova-compute[74692]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6, portal: 172.16.0.220,3260] successful.
Nov 18 19:05:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bd948-64ab-4b37-9236-f78dda0395b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f4f58b-dcb7-4b0b-8c96-46d5a97365e2]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== disconnect_volume: return (291ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:05:35 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Deleting instance files /opt/stack/data/nova/instances/4519eaca-4744-49e2-a3ce-34d3a9fedc77_del
Nov 18 19:05:35 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Deletion of /opt/stack/data/nova/instances/4519eaca-4744-49e2-a3ce-34d3a9fedc77_del complete
Nov 18 19:05:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fUCHLzcZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:05:35 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:05:35 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:05:35 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3db92f6-3aa4-49d9-9bec-32c4758b88d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 19:05:35 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[295a2cf6-4651-464a-be7d-590a79d46bed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b] added
Nov 18 19:05:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: INFO nova.compute.manager [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5218a8-24d1-483a-94d2-b77e698c7728]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[99791089-3402-4848-99b6-e86c90930e75]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fUCHLzcZ {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fUCHLzcZ" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[672d3950-1be6-415f-b55d-b1bc52cde590]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fUCHLzcZ'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc5ab74-54ce-456e-9bab-8e6cb0b82cb6]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d868b1cd-b3bf-44b7-8409-16abad774c1b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:05:35 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:05:35 user nova-compute[74692]:  {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:05:35 user nova-compute[74692]: WARNING os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 19:05:35 user nova-compute[74692]: 
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffe3ac6-8278-40d9-a6d1-604cf8ed1e2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b, portal: 172.16.0.220,3260]
Nov 18 19:05:35 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b, portal: 172.16.0.220,3260] successful.
Nov 18 19:05:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[18559a07-7089-40d0-8a01-e030748f3095]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4cd037-36b7-4d54-8a83-8cb92c787bc3]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b (non-flash)
Nov 18 19:05:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b (non-flash)
Nov 18 19:05:35 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e62c8b6-e071-4920-8c5e-7808f4fcd263]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:05:35 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fUCHLzcZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 19:05:36 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:05:36 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Took 0.89 seconds to deallocate network for instance.
Nov 18 19:05:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-8cc861a6-621d-4e10-8f01-c6e40ac71608 req-b6cc42fa-7949-444e-a011-8a74fdd06758 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Received event network-vif-deleted-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:05:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-71e79fc5-a9a3-47d8-8bc4-e2a203e48efa req-ac0247ef-7401-437a-acf8-ccda00ea6041 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Received event network-vif-plugged-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:05:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-71e79fc5-a9a3-47d8-8bc4-e2a203e48efa req-ac0247ef-7401-437a-acf8-ccda00ea6041 service nova] Acquiring lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:05:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-71e79fc5-a9a3-47d8-8bc4-e2a203e48efa req-ac0247ef-7401-437a-acf8-ccda00ea6041 service nova] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:05:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-71e79fc5-a9a3-47d8-8bc4-e2a203e48efa req-ac0247ef-7401-437a-acf8-ccda00ea6041 service nova] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:05:36 user nova-compute[74692]: DEBUG nova.compute.manager [req-71e79fc5-a9a3-47d8-8bc4-e2a203e48efa req-ac0247ef-7401-437a-acf8-ccda00ea6041 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] No waiting events found dispatching network-vif-plugged-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:05:36 user nova-compute[74692]: WARNING nova.compute.manager [req-71e79fc5-a9a3-47d8-8bc4-e2a203e48efa req-ac0247ef-7401-437a-acf8-ccda00ea6041 service nova] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Received unexpected event network-vif-plugged-cf4807d9-4efb-4ed4-9d0d-37ab13d21cde for instance with vm_state active and task_state deleting.
Nov 18 19:05:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:05:36 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26230313839333739', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:05:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230313839333739', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 19:05:36 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lazy-loading 'flavor' on Instance uuid 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:05:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 19:05:36 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:05:36 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:05:36 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:05:36 user nova-compute[74692]:   <serial>0994514b-4d31-44e0-a75a-400e96d2e12b</serial>
Nov 18 19:05:36 user nova-compute[74692]: </disk>
Nov 18 19:05:36 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 19:05:36 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:05:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:05:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:05:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:05:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:05:37 user nova-compute[74692]: INFO nova.compute.manager [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Took 0.79 seconds to detach 1 volumes for instance.
Nov 18 19:05:37 user nova-compute[74692]: DEBUG nova.compute.manager [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 4519eaca-4744-49e2-a3ce-34d3a9fedc77] Deleting volume: ca4bd948-64ab-4b37-9236-f78dda0395b6 {{(pid=74692) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] No VIF found with MAC fa:16:3e:da:b3:8c, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Refreshing inventories for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3de8568d-eb0a-4a06-8603-69ae1de1c30c tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.523s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Updating ProviderTree inventory for provider 582be55c-ee9f-496e-b354-5900b8401d2c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Updating inventory in ProviderTree for provider 582be55c-ee9f-496e-b354-5900b8401d2c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Refreshing aggregate associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, aggregates: None {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Refreshing trait associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce/disk --force-share --output=json" returned: 0 in 0.355s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:05:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.564s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:05:37 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Deleted allocations for instance 4519eaca-4744-49e2-a3ce-34d3a9fedc77
Nov 18 19:05:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-06974390-2731-42a3-af2c-8c2b0755690c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "4519eaca-4744-49e2-a3ce-34d3a9fedc77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.694s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:05:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:38 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:05:38 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:05:38 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8604MB free_disk=24.977779388427734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:05:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:05:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:05:39 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 78457b6e-547c-4134-bf25-371b71693dc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:05:39 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:05:39 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5b24b127-17d8-4e1e-9384-fdebb3ac312d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:05:39 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:05:39 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:05:39 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:05:39 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:05:39 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:05:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:05:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquiring lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:05:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:05:39 user nova-compute[74692]: INFO nova.compute.manager [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Detaching volume 0994514b-4d31-44e0-a75a-400e96d2e12b
Nov 18 19:05:39 user nova-compute[74692]: INFO nova.virt.block_device [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Attempting to driver detach volume 0994514b-4d31-44e0-a75a-400e96d2e12b from mountpoint /dev/vdb
Nov 18 19:05:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Attempting to detach device vdb from instance 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 19:05:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:05:39 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:05:39 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:05:39 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:05:39 user nova-compute[74692]:   <serial>0994514b-4d31-44e0-a75a-400e96d2e12b</serial>
Nov 18 19:05:39 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:05:39 user nova-compute[74692]: </disk>
Nov 18 19:05:39 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:05:39 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Successfully detached device vdb from instance 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce from the persistent domain config.
Nov 18 19:05:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 19:05:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:05:39 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:05:39 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:05:39 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:05:39 user nova-compute[74692]:   <serial>0994514b-4d31-44e0-a75a-400e96d2e12b</serial>
Nov 18 19:05:39 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:05:39 user nova-compute[74692]: </disk>
Nov 18 19:05:39 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:05:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 19:05:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:43 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:05:43 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:05:43 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:05:43 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:05:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:43 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:05:44 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:05:44 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:05:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-78457b6e-547c-4134-bf25-371b71693dc1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:05:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-78457b6e-547c-4134-bf25-371b71693dc1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:05:45 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:05:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:45 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Updating instance_info_cache with network_info: [{"id": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "address": "fa:16:3e:f0:af:d1", "network": {"id": "cc92e7ba-2619-4498-848c-b3b8870560fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1221693540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d0a7206e6b44e5bc69a7114367fd3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c77aab-54", "ovs_interfaceid": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:05:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-78457b6e-547c-4134-bf25-371b71693dc1" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:05:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:05:45 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:05:46 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:05:47 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:05:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "78457b6e-547c-4134-bf25-371b71693dc1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:05:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:05:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "78457b6e-547c-4134-bf25-371b71693dc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:05:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:05:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:05:49 user nova-compute[74692]: INFO nova.compute.manager [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Terminating instance
Nov 18 19:05:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 19:05:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-5eefdf15-a93c-4e09-a65d-6eea3f6c2618 req-86ced572-9ef1-4bfe-a60a-0915a5dbe3c7 service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Received event network-vif-unplugged-e6c77aab-5452-4fd1-b0c2-836b4ab7096a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5eefdf15-a93c-4e09-a65d-6eea3f6c2618 req-86ced572-9ef1-4bfe-a60a-0915a5dbe3c7 service nova] Acquiring lock "78457b6e-547c-4134-bf25-371b71693dc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5eefdf15-a93c-4e09-a65d-6eea3f6c2618 req-86ced572-9ef1-4bfe-a60a-0915a5dbe3c7 service nova] Lock "78457b6e-547c-4134-bf25-371b71693dc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5eefdf15-a93c-4e09-a65d-6eea3f6c2618 req-86ced572-9ef1-4bfe-a60a-0915a5dbe3c7 service nova] Lock "78457b6e-547c-4134-bf25-371b71693dc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-5eefdf15-a93c-4e09-a65d-6eea3f6c2618 req-86ced572-9ef1-4bfe-a60a-0915a5dbe3c7 service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] No waiting events found dispatching network-vif-unplugged-e6c77aab-5452-4fd1-b0c2-836b4ab7096a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG nova.compute.manager [req-5eefdf15-a93c-4e09-a65d-6eea3f6c2618 req-86ced572-9ef1-4bfe-a60a-0915a5dbe3c7 service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Received event network-vif-unplugged-e6c77aab-5452-4fd1-b0c2-836b4ab7096a for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Instance destroyed successfully.
Nov 18 19:05:50 user nova-compute[74692]: DEBUG nova.objects.instance [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lazy-loading 'resources' on Instance uuid 78457b6e-547c-4134-bf25-371b71693dc1 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-284024118',display_name='tempest-TestServerVolumeAttachmentScenario-server-284024118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-284024118',id=45,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5RoRk669ttuI5VtMXiPeVYgay7SJqqV4p/PD2myMk+TtzMm5+l0XKQOwsP6vLQP37DT03OO0ikxZp7GBmHj2qRNRxfuvojrZcAScYuyx+yfIVQh+j7w2A7iL7Ibq9Yqw==',key_name='tempest-keypair-1401671269',keypairs=<?>,launch_index=0,launched_at=2023-11-18T19:02:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81d0a7206e6b44e5bc69a7114367fd3d',ramdisk_id='',reservation_id='r-xvuckoj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-835258081',owner_user_name='tempest-TestServerVolumeAttachmentScenario-835258081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T19:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f6b2cabb1247d69e650a6ed73b6dd4',uuid=78457b6e-547c-4134-bf25-371b71693dc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "address": "fa:16:3e:f0:af:d1", "network": {"id": "cc92e7ba-2619-4498-848c-b3b8870560fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1221693540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d0a7206e6b44e5bc69a7114367fd3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c77aab-54", "ovs_interfaceid": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Converting VIF {"id": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "address": "fa:16:3e:f0:af:d1", "network": {"id": "cc92e7ba-2619-4498-848c-b3b8870560fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1221693540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d0a7206e6b44e5bc69a7114367fd3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c77aab-54", "ovs_interfaceid": "e6c77aab-5452-4fd1-b0c2-836b4ab7096a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:af:d1,bridge_name='br-int',has_traffic_filtering=True,id=e6c77aab-5452-4fd1-b0c2-836b4ab7096a,network=Network(cc92e7ba-2619-4498-848c-b3b8870560fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c77aab-54') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG os_vif [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:af:d1,bridge_name='br-int',has_traffic_filtering=True,id=e6c77aab-5452-4fd1-b0c2-836b4ab7096a,network=Network(cc92e7ba-2619-4498-848c-b3b8870560fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c77aab-54') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6c77aab-54, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ef8347f-1dd5-4a04-b351-c4157287f1dd) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:05:50 user nova-compute[74692]: INFO os_vif [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:af:d1,bridge_name='br-int',has_traffic_filtering=True,id=e6c77aab-5452-4fd1-b0c2-836b4ab7096a,network=Network(cc92e7ba-2619-4498-848c-b3b8870560fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c77aab-54')
Nov 18 19:05:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Deleting instance files /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1_del
Nov 18 19:05:50 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Deletion of /opt/stack/data/nova/instances/78457b6e-547c-4134-bf25-371b71693dc1_del complete
Nov 18 19:05:50 user nova-compute[74692]: INFO nova.compute.manager [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 18 19:05:50 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 19:05:50 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 19:05:51 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:05:51 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Took 0.71 seconds to deallocate network for instance.
Nov 18 19:05:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-7d54a16f-36c4-4b74-8750-868a8728af9a req-79fe93ce-1298-4069-9cdd-6e2e80b23ddf service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Received event network-vif-deleted-e6c77aab-5452-4fd1-b0c2-836b4ab7096a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:05:51 user nova-compute[74692]: INFO nova.compute.manager [req-7d54a16f-36c4-4b74-8750-868a8728af9a req-79fe93ce-1298-4069-9cdd-6e2e80b23ddf service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Neutron deleted interface e6c77aab-5452-4fd1-b0c2-836b4ab7096a; detaching it from the instance and deleting it from the info cache
Nov 18 19:05:51 user nova-compute[74692]: DEBUG nova.network.neutron [req-7d54a16f-36c4-4b74-8750-868a8728af9a req-79fe93ce-1298-4069-9cdd-6e2e80b23ddf service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:05:51 user nova-compute[74692]: DEBUG nova.compute.manager [req-7d54a16f-36c4-4b74-8750-868a8728af9a req-79fe93ce-1298-4069-9cdd-6e2e80b23ddf service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Detach interface failed, port_id=e6c77aab-5452-4fd1-b0c2-836b4ab7096a, reason: Instance 78457b6e-547c-4134-bf25-371b71693dc1 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 19:05:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:05:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:05:51 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:05:51 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:05:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:05:51 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Deleted allocations for instance 78457b6e-547c-4134-bf25-371b71693dc1
Nov 18 19:05:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-297d082c-3a2b-4193-8b38-4fa75b4435da tempest-TestServerVolumeAttachmentScenario-835258081 tempest-TestServerVolumeAttachmentScenario-835258081-project-member] Lock "78457b6e-547c-4134-bf25-371b71693dc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.930s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:05:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-6a60524f-2d18-4228-8109-dc5e1fee3ee0 req-fe50b6d4-1c4a-4cb3-bc5a-189b47fe8633 service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Received event network-vif-plugged-e6c77aab-5452-4fd1-b0c2-836b4ab7096a {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:05:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6a60524f-2d18-4228-8109-dc5e1fee3ee0 req-fe50b6d4-1c4a-4cb3-bc5a-189b47fe8633 service nova] Acquiring lock "78457b6e-547c-4134-bf25-371b71693dc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:05:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6a60524f-2d18-4228-8109-dc5e1fee3ee0 req-fe50b6d4-1c4a-4cb3-bc5a-189b47fe8633 service nova] Lock "78457b6e-547c-4134-bf25-371b71693dc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:05:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-6a60524f-2d18-4228-8109-dc5e1fee3ee0 req-fe50b6d4-1c4a-4cb3-bc5a-189b47fe8633 service nova] Lock "78457b6e-547c-4134-bf25-371b71693dc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:05:52 user nova-compute[74692]: DEBUG nova.compute.manager [req-6a60524f-2d18-4228-8109-dc5e1fee3ee0 req-fe50b6d4-1c4a-4cb3-bc5a-189b47fe8633 service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] No waiting events found dispatching network-vif-plugged-e6c77aab-5452-4fd1-b0c2-836b4ab7096a {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:05:52 user nova-compute[74692]: WARNING nova.compute.manager [req-6a60524f-2d18-4228-8109-dc5e1fee3ee0 req-fe50b6d4-1c4a-4cb3-bc5a-189b47fe8633 service nova] [instance: 78457b6e-547c-4134-bf25-371b71693dc1] Received unexpected event network-vif-plugged-e6c77aab-5452-4fd1-b0c2-836b4ab7096a for instance with vm_state deleted and task_state None.
Nov 18 19:05:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:05:59 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce is timed out.
Nov 18 19:05:59 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Successfully detached device vdb from instance 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce from the live domain config.
Nov 18 19:05:59 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:05:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fUCHLzcZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:05:59 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:05:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:05:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:05:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8888383b-77be-472f-8adf-fb0fb8e07638]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:05:59 user nova-compute[74692]: No targets found.
Nov 18 19:05:59 user nova-compute[74692]: iSNS:
Nov 18 19:05:59 user nova-compute[74692]: No targets found.
Nov 18 19:05:59 user nova-compute[74692]: STATIC:
Nov 18 19:05:59 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b
Nov 18 19:05:59 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:05:59 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:05:59 user nova-compute[74692]: FIRMWARE:
Nov 18 19:05:59 user nova-compute[74692]: No targets found.
Nov 18 19:05:59 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:05:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:05:59 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:05:59 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:05:59 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:05:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:05:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:05:59 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a182104-b269-446e-b460-08af01921a40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:05:59 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d77b0e-b913-4d66-a147-23c3ced91d17]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b (non-flash)
Nov 18 19:06:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b (non-flash)
Nov 18 19:06:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c4671360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa4555d-8011-4421-a37e-dc6d37a21b15]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0361aa-fff9-41fd-acf0-f2d05c82ef73]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf28de6b-2d69-43ea-baee-d46674b60200]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d619d48-137d-4779-8145-7191334c6b42]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[936a881a-85e0-40a1-9ca3-65e60aeaf9ec]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbd8a70-ece3-4620-a18a-7da14a070ca3]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b, portal: 172.16.0.220,3260]
Nov 18 19:06:00 user nova-compute[74692]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b, portal: 172.16.0.220,3260] successful.
Nov 18 19:06:00 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0994514b-4d31-44e0-a75a-400e96d2e12b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f600a3-70dc-480a-b73f-e67a9f1682a7]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] <== disconnect_volume: return (313ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:00 user nova-compute[74692]: DEBUG nova.objects.instance [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lazy-loading 'flavor' on Instance uuid 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:06:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-917be88c-31a5-46d5-909d-1a52594b1889 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.625s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-e29805fd-b297-4444-a051-2bb58277bb76 req-e403e1cf-2575-4a05-9d83-ce9b62d931b2 service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Received event network-changed-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:06:01 user nova-compute[74692]: DEBUG nova.compute.manager [req-e29805fd-b297-4444-a051-2bb58277bb76 req-e403e1cf-2575-4a05-9d83-ce9b62d931b2 service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Refreshing instance network info cache due to event network-changed-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:06:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e29805fd-b297-4444-a051-2bb58277bb76 req-e403e1cf-2575-4a05-9d83-ce9b62d931b2 service nova] Acquiring lock "refresh_cache-5b24b127-17d8-4e1e-9384-fdebb3ac312d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:06:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e29805fd-b297-4444-a051-2bb58277bb76 req-e403e1cf-2575-4a05-9d83-ce9b62d931b2 service nova] Acquired lock "refresh_cache-5b24b127-17d8-4e1e-9384-fdebb3ac312d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:06:01 user nova-compute[74692]: DEBUG nova.network.neutron [req-e29805fd-b297-4444-a051-2bb58277bb76 req-e403e1cf-2575-4a05-9d83-ce9b62d931b2 service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Refreshing network info cache for port ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:06:02 user nova-compute[74692]: DEBUG nova.network.neutron [req-e29805fd-b297-4444-a051-2bb58277bb76 req-e403e1cf-2575-4a05-9d83-ce9b62d931b2 service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Updated VIF entry in instance network info cache for port ef90c059-3bb9-4d7f-ba03-7e015eb13bb8. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:06:02 user nova-compute[74692]: DEBUG nova.network.neutron [req-e29805fd-b297-4444-a051-2bb58277bb76 req-e403e1cf-2575-4a05-9d83-ce9b62d931b2 service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Updating instance_info_cache with network_info: [{"id": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "address": "fa:16:3e:a0:bb:5c", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef90c059-3b", "ovs_interfaceid": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:06:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e29805fd-b297-4444-a051-2bb58277bb76 req-e403e1cf-2575-4a05-9d83-ce9b62d931b2 service nova] Releasing lock "refresh_cache-5b24b127-17d8-4e1e-9384-fdebb3ac312d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:06:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG nova.objects.instance [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'flavor' on Instance uuid 5b24b127-17d8-4e1e-9384-fdebb3ac312d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:06:05 user nova-compute[74692]: INFO nova.compute.manager [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Attaching volume 59058966-85df-4e51-8c68-8fcf9967e7a5 to /dev/vdb
Nov 18 19:06:05 user nova-compute[74692]: DEBUG os_brick.utils [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e21100e-cc19-4c6d-981f-f181db271e1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70e9873-0144-49a3-8f6a-76936a14e440]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad39fa17-c052-4d0c-b73a-5912e8722d98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4961b12c-3450-48bd-93f6-b58977e200a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:06:05 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 19:06:05 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5567a325-5f74-4378-98a9-d30bfd8ed09b]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG os_brick.utils [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:06:05 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Updating existing volume attachment record: 19887310-eade-47c7-bfdf-ee4038c523f1 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 19:06:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 19:06:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DViJryLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:06:10 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:06:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:06:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:06:11 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:06:11 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9af815-7bc8-49e8-aebe-af23837bc31c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 19:06:11 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3645bfc-a8ad-4c97-aa15-5641db783c1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5] added
Nov 18 19:06:11 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9170352-f0c5-4cee-9e73-66c4ee440f25]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33b1462-a193-4660-82f1-d8355536aa47]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DViJryLE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DViJryLE" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fffa29-fc62-4c05-a87d-a07f1aa64d4b]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DViJryLE'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c6cbf4-94ff-4d2d-b09d-16f12c5c5181]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f2b65a-2a87-416f-819b-8c61d2e95a3e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:06:11 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:06:11 user nova-compute[74692]:  {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:06:11 user nova-compute[74692]: WARNING os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 19:06:11 user nova-compute[74692]: 
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f60207-9846-457a-af39-54a28126bd4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5, portal: 172.16.0.220,3260]
Nov 18 19:06:11 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5, portal: 172.16.0.220,3260] successful.
Nov 18 19:06:11 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[466f9993-06b3-40bb-9e86-19e01d7a4e45]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[661529ef-2b20-44b1-ad60-aed5cc41d459]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 (non-flash)
Nov 18 19:06:11 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 (non-flash)
Nov 18 19:06:11 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c8a321-d86f-4fd8-baa7-1e2a1f1ab610]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:11 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:06:12 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:06:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DViJryLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 19:06:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:06:12 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '26632313532323537', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:06:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632313532323537', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 19:06:12 user nova-compute[74692]: DEBUG nova.objects.instance [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'flavor' on Instance uuid 5b24b127-17d8-4e1e-9384-fdebb3ac312d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:06:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 19:06:12 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:06:12 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:06:12 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:06:12 user nova-compute[74692]:   <serial>59058966-85df-4e51-8c68-8fcf9967e7a5</serial>
Nov 18 19:06:12 user nova-compute[74692]: </disk>
Nov 18 19:06:12 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 19:06:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:06:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:06:12 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] No VIF found with MAC fa:16:3e:a0:bb:5c, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:06:12 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-dfe3eb81-e240-4640-9a21-1a9f7f8c5b6b tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.112s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:06:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:06:13 user nova-compute[74692]: INFO nova.compute.manager [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Detaching volume 59058966-85df-4e51-8c68-8fcf9967e7a5
Nov 18 19:06:13 user nova-compute[74692]: INFO nova.virt.block_device [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Attempting to driver detach volume 59058966-85df-4e51-8c68-8fcf9967e7a5 from mountpoint /dev/vdb
Nov 18 19:06:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Attempting to detach device vdb from instance 5b24b127-17d8-4e1e-9384-fdebb3ac312d from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 19:06:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:06:13 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:06:13 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:06:13 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:06:13 user nova-compute[74692]:   <serial>59058966-85df-4e51-8c68-8fcf9967e7a5</serial>
Nov 18 19:06:13 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:06:13 user nova-compute[74692]: </disk>
Nov 18 19:06:13 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:06:13 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Successfully detached device vdb from instance 5b24b127-17d8-4e1e-9384-fdebb3ac312d from the persistent domain config.
Nov 18 19:06:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b24b127-17d8-4e1e-9384-fdebb3ac312d from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 19:06:13 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:06:13 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:06:13 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:06:13 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:06:13 user nova-compute[74692]:   <serial>59058966-85df-4e51-8c68-8fcf9967e7a5</serial>
Nov 18 19:06:13 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:06:13 user nova-compute[74692]: </disk>
Nov 18 19:06:13 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:06:14 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b24b127-17d8-4e1e-9384-fdebb3ac312d {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 19:06:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:06:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:06:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:06:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:06:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:06:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquiring lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquiring lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:33 user nova-compute[74692]: INFO nova.compute.manager [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Terminating instance
Nov 18 19:06:33 user nova-compute[74692]: DEBUG nova.compute.manager [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-5a6601d0-8dff-45df-abe5-f6520fa6255d req-ff3b8eee-521c-48e3-b779-d7693c94801f service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Received event network-vif-unplugged-065590c8-71bb-4202-af01-656d23704cb9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5a6601d0-8dff-45df-abe5-f6520fa6255d req-ff3b8eee-521c-48e3-b779-d7693c94801f service nova] Acquiring lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5a6601d0-8dff-45df-abe5-f6520fa6255d req-ff3b8eee-521c-48e3-b779-d7693c94801f service nova] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5a6601d0-8dff-45df-abe5-f6520fa6255d req-ff3b8eee-521c-48e3-b779-d7693c94801f service nova] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-5a6601d0-8dff-45df-abe5-f6520fa6255d req-ff3b8eee-521c-48e3-b779-d7693c94801f service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] No waiting events found dispatching network-vif-unplugged-065590c8-71bb-4202-af01-656d23704cb9 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG nova.compute.manager [req-5a6601d0-8dff-45df-abe5-f6520fa6255d req-ff3b8eee-521c-48e3-b779-d7693c94801f service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Received event network-vif-unplugged-065590c8-71bb-4202-af01-656d23704cb9 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "a17bb53e-b230-4d23-931a-5b59aa3ad311" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG nova.compute.manager [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:33 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Instance destroyed successfully.
Nov 18 19:06:33 user nova-compute[74692]: DEBUG nova.objects.instance [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lazy-loading 'resources' on Instance uuid 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-168899072',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-168899072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1688990',id=47,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFRFJMmEIzwnmsaSAjA3wy2/w35oxDkTJZfNfJzCfMNZWoMGtYhO8z51g2IylyV8FEceVkYxhut8entOc8Ced5G/5NrIBH++sQXj4wx4IStFsG6pM8gzwwAU8Fuf/Rb0Q==',key_name='tempest-keypair-1265193666',keypairs=<?>,launch_index=0,launched_at=2023-11-18T19:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94cdb51828ce4e47b876798b91b4c970',ramdisk_id='',reservation_id='r-di8jdeh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-176979081',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T19:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c661ecd6f1344268389f2ffc0f80efc',uuid=3fa99ece-b7fa-4518-ae01-c3d0b2d243ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "065590c8-71bb-4202-af01-656d23704cb9", "address": "fa:16:3e:da:b3:8c", "network": {"id": "841612ef-9562-4cd0-8707-6df7c5be44c9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1767401438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94cdb51828ce4e47b876798b91b4c970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065590c8-71", "ovs_interfaceid": "065590c8-71bb-4202-af01-656d23704cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Converting VIF {"id": "065590c8-71bb-4202-af01-656d23704cb9", "address": "fa:16:3e:da:b3:8c", "network": {"id": "841612ef-9562-4cd0-8707-6df7c5be44c9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1767401438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94cdb51828ce4e47b876798b91b4c970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065590c8-71", "ovs_interfaceid": "065590c8-71bb-4202-af01-656d23704cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:b3:8c,bridge_name='br-int',has_traffic_filtering=True,id=065590c8-71bb-4202-af01-656d23704cb9,network=Network(841612ef-9562-4cd0-8707-6df7c5be44c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065590c8-71') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG os_vif [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:b3:8c,bridge_name='br-int',has_traffic_filtering=True,id=065590c8-71bb-4202-af01-656d23704cb9,network=Network(841612ef-9562-4cd0-8707-6df7c5be44c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065590c8-71') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap065590c8-71, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7376d00f-92b0-4033-995f-dbd51b8bf88b) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:06:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:06:33 user nova-compute[74692]: INFO os_vif [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:b3:8c,bridge_name='br-int',has_traffic_filtering=True,id=065590c8-71bb-4202-af01-656d23704cb9,network=Network(841612ef-9562-4cd0-8707-6df7c5be44c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065590c8-71')
Nov 18 19:06:33 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Deleting instance files /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce_del
Nov 18 19:06:33 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Deletion of /opt/stack/data/nova/instances/3fa99ece-b7fa-4518-ae01-c3d0b2d243ce_del complete
Nov 18 19:06:33 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 19:06:33 user nova-compute[74692]: INFO nova.compute.claims [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Claim successful on node user
Nov 18 19:06:34 user nova-compute[74692]: INFO nova.compute.manager [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 19:06:34 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5b24b127-17d8-4e1e-9384-fdebb3ac312d is timed out.
Nov 18 19:06:34 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Successfully detached device vdb from instance 5b24b127-17d8-4e1e-9384-fdebb3ac312d from the live domain config.
Nov 18 19:06:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DViJryLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:06:34 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[718b7fc9-28e5-4e9d-98c5-861df837a1d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:06:34 user nova-compute[74692]: No targets found.
Nov 18 19:06:34 user nova-compute[74692]: iSNS:
Nov 18 19:06:34 user nova-compute[74692]: No targets found.
Nov 18 19:06:34 user nova-compute[74692]: STATIC:
Nov 18 19:06:34 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5
Nov 18 19:06:34 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:06:34 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:06:34 user nova-compute[74692]: FIRMWARE:
Nov 18 19:06:34 user nova-compute[74692]: No targets found.
Nov 18 19:06:34 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:06:34 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:06:34 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[089fdb85-8e49-4832-a56c-5fa87f0263ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7723bb-4b7b-4fdb-b5cf-370088632f3f]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 (non-flash)
Nov 18 19:06:34 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 (non-flash)
Nov 18 19:06:34 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a4531bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6653b2a-479d-4357-a115-f8eac49dca06]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac313d6b-f2a4-498c-bbef-268aee68cf3f]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e490805-c99d-4741-81a6-7cab4e81b509]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce3d2fc-fb96-427c-8ae4-175c0d9b955e]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG nova.network.neutron [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[052829d9-f299-4df9-a8c8-9ff3bd2c16ab]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:34 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 19:06:34 user nova-compute[74692]: DEBUG nova.compute.manager [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[403ccf96-fce5-4981-8963-2b825025f7d5]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5, portal: 172.16.0.220,3260]
Nov 18 19:06:34 user nova-compute[74692]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5, portal: 172.16.0.220,3260] successful.
Nov 18 19:06:34 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59058966-85df-4e51-8c68-8fcf9967e7a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5932f377-9640-4e9b-b19f-686fd310e1e3]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] <== disconnect_volume: return (282ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG nova.policy [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f58b7c308c3b4fa7bb4f576048ef7619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a60e439a714bdd8fca1ec43e2a3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 19:06:34 user nova-compute[74692]: INFO nova.virt.block_device [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Booting with volume a5db5828-739b-48f7-a725-000af2ed860a at /dev/vda
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.utils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0590c251-76ef-4405-82a3-9ad4a8874439]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[da11be37-e4ef-4633-8f13-6b6a003c0b05]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f191f70-84a5-4116-ac58-69e0e721f4a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d964cc-01a2-42a7-b93d-eb9ca401668c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:06:34 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 19:06:34 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4a0603-80ef-4834-bc45-a4cf2b59ebe1]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG os_brick.utils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:06:34 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Updating existing volume attachment record: 80e9358c-cc42-4777-be0f-888004ea6bd7 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG nova.network.neutron [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Successfully created port: 6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG nova.objects.instance [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'flavor' on Instance uuid 5b24b127-17d8-4e1e-9384-fdebb3ac312d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f3abd066-a4d0-4842-ac3e-0abf4ab51cd2 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.644s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:06:35 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Took 1.31 seconds to deallocate network for instance.
Nov 18 19:06:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-e4ec3cfa-cfc4-4fe4-a6ae-a95b6c389ac8 req-b5804fef-f641-434b-bfb8-d3915ba760ce service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Received event network-vif-plugged-065590c8-71bb-4202-af01-656d23704cb9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e4ec3cfa-cfc4-4fe4-a6ae-a95b6c389ac8 req-b5804fef-f641-434b-bfb8-d3915ba760ce service nova] Acquiring lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e4ec3cfa-cfc4-4fe4-a6ae-a95b6c389ac8 req-b5804fef-f641-434b-bfb8-d3915ba760ce service nova] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e4ec3cfa-cfc4-4fe4-a6ae-a95b6c389ac8 req-b5804fef-f641-434b-bfb8-d3915ba760ce service nova] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-e4ec3cfa-cfc4-4fe4-a6ae-a95b6c389ac8 req-b5804fef-f641-434b-bfb8-d3915ba760ce service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] No waiting events found dispatching network-vif-plugged-065590c8-71bb-4202-af01-656d23704cb9 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:06:35 user nova-compute[74692]: WARNING nova.compute.manager [req-e4ec3cfa-cfc4-4fe4-a6ae-a95b6c389ac8 req-b5804fef-f641-434b-bfb8-d3915ba760ce service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Received unexpected event network-vif-plugged-065590c8-71bb-4202-af01-656d23704cb9 for instance with vm_state deleted and task_state None.
Nov 18 19:06:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-e4ec3cfa-cfc4-4fe4-a6ae-a95b6c389ac8 req-b5804fef-f641-434b-bfb8-d3915ba760ce service nova] [instance: 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce] Received event network-vif-deleted-065590c8-71bb-4202-af01-656d23704cb9 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:06:35 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Deleted allocations for instance 3fa99ece-b7fa-4518-ae01-c3d0b2d243ce
Nov 18 19:06:35 user nova-compute[74692]: DEBUG nova.network.neutron [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Successfully updated port: 6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "refresh_cache-a17bb53e-b230-4d23-931a-5b59aa3ad311" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquired lock "refresh_cache-a17bb53e-b230-4d23-931a-5b59aa3ad311" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG nova.network.neutron [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-f426d815-94c6-4094-b9ee-201a6f4a1b48 tempest-TestServerVolumeAttachScenarioOldVersion-176979081 tempest-TestServerVolumeAttachScenarioOldVersion-176979081-project-member] Lock "3fa99ece-b7fa-4518-ae01-c3d0b2d243ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.606s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-a95b2132-ff68-406e-8b23-8fcdcc94945c req-5d38cecb-7ef2-41e4-9738-c4d5d2681567 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received event network-changed-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG nova.compute.manager [req-a95b2132-ff68-406e-8b23-8fcdcc94945c req-5d38cecb-7ef2-41e4-9738-c4d5d2681567 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Refreshing instance network info cache due to event network-changed-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a95b2132-ff68-406e-8b23-8fcdcc94945c req-5d38cecb-7ef2-41e4-9738-c4d5d2681567 service nova] Acquiring lock "refresh_cache-a17bb53e-b230-4d23-931a-5b59aa3ad311" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:06:35 user nova-compute[74692]: DEBUG nova.network.neutron [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 19:06:36 user nova-compute[74692]: DEBUG nova.network.neutron [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Updating instance_info_cache with network_info: [{"id": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "address": "fa:16:3e:5b:a1:0a", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7cb59d-71", "ovs_interfaceid": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:06:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Releasing lock "refresh_cache-a17bb53e-b230-4d23-931a-5b59aa3ad311" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:06:36 user nova-compute[74692]: DEBUG nova.compute.manager [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Instance network_info: |[{"id": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "address": "fa:16:3e:5b:a1:0a", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7cb59d-71", "ovs_interfaceid": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 19:06:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a95b2132-ff68-406e-8b23-8fcdcc94945c req-5d38cecb-7ef2-41e4-9738-c4d5d2681567 service nova] Acquired lock "refresh_cache-a17bb53e-b230-4d23-931a-5b59aa3ad311" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:06:36 user nova-compute[74692]: DEBUG nova.network.neutron [req-a95b2132-ff68-406e-8b23-8fcdcc94945c req-5d38cecb-7ef2-41e4-9738-c4d5d2681567 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Refreshing network info cache for port 6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:06:36 user nova-compute[74692]: DEBUG nova.network.neutron [req-a95b2132-ff68-406e-8b23-8fcdcc94945c req-5d38cecb-7ef2-41e4-9738-c4d5d2681567 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Updated VIF entry in instance network info cache for port 6d7cb59d-71a7-40f3-9a9c-cb5e101393ee. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:06:36 user nova-compute[74692]: DEBUG nova.network.neutron [req-a95b2132-ff68-406e-8b23-8fcdcc94945c req-5d38cecb-7ef2-41e4-9738-c4d5d2681567 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Updating instance_info_cache with network_info: [{"id": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "address": "fa:16:3e:5b:a1:0a", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7cb59d-71", "ovs_interfaceid": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:06:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a95b2132-ff68-406e-8b23-8fcdcc94945c req-5d38cecb-7ef2-41e4-9738-c4d5d2681567 service nova] Releasing lock "refresh_cache-a17bb53e-b230-4d23-931a-5b59aa3ad311" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:06:36 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:06:36 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:06:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:06:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:06:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:06:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:37 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:37 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:06:37 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:06:37 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=25.02332305908203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:06:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:06:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:06:37 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 5b24b127-17d8-4e1e-9384-fdebb3ac312d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:06:37 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance a17bb53e-b230-4d23-931a-5b59aa3ad311 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:06:37 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:06:37 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:06:37 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:06:37 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:06:38 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:06:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:39 user nova-compute[74692]: DEBUG nova.compute.manager [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 19:06:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 19:06:39 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Creating image(s)
Nov 18 19:06:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 19:06:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Ensure instance console log exists: /opt/stack/data/nova/instances/a17bb53e-b230-4d23-931a-5b59aa3ad311/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 19:06:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:06:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:06:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Start _get_guest_xml network_info=[{"id": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "address": "fa:16:3e:5b:a1:0a", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7cb59d-71", "ovs_interfaceid": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhtwLfvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a17bb53e-b230-4d23-931a-5b59aa3ad311', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5db5828-739b-48f7-a725-000af2ed860a', 'serial': 'a5db5828-739b-48f7-a725-000af2ed860a'}, 'attachment_id': '80e9358c-cc42-4777-be0f-888004ea6bd7', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 19:06:39 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:06:39 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:06:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 19:06:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 19:06:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 19:06:39 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhtwLfvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:06:40 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:06:40 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:06:40 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74793e4-6e12-4ba5-9ac4-d00f18334f65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 19:06:40 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea1a04d-d15d-435d-b4e5-bd349a52171a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a] added
Nov 18 19:06:40 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d8c11b-3dbf-4dbf-adff-682282171175]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2568960a-f99c-4ab3-af2e-59c35821d414]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AhtwLfvQ {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AhtwLfvQ" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfdacf7-38b3-41e0-879e-e6bba86e4778]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AhtwLfvQ'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcf1477-f35f-4d77-8ec4-0c29a601f41c]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d8f6e0-7b85-442c-8aee-e5decc8db7d2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:06:40 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:06:40 user nova-compute[74692]:  {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:06:40 user nova-compute[74692]: WARNING os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 19:06:40 user nova-compute[74692]: 
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1278bb9-1c3b-402f-a134-8be50c1aa28c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260]
Nov 18 19:06:40 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260] successful.
Nov 18 19:06:40 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e0e76c-26fa-423f-87cd-3697cc97dd8e]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf863ec1-6ad0-4b2c-913f-e816eee06723]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)
Nov 18 19:06:40 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)
Nov 18 19:06:40 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e34b39-27ce-42f8-85f0-a202dc08ea46]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:06:40 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhtwLfvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26232303736346532', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232303736346532', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1907088120',display_name='tempest-TestVolumeBootPattern-server-1907088120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1907088120',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjQDIRpH38DKVgoyK1MoFv+m8f/mGJrL0ooZsg2wAfnTUJxFQk1uOmbgPDnD8Mh28/YfKlfkB/iskJj/3HNMpIea9BHIe4sWpufsnQvUXD1nCH47a4Mgeniq2skzVKHOQ==',key_name='tempest-TestVolumeBootPattern-917877268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-gcseav0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:06:34Z,user_data=None,user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=a17bb53e-b230-4d23-931a-5b59aa3ad311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "address": "fa:16:3e:5b:a1:0a", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7cb59d-71", "ovs_interfaceid": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "address": "fa:16:3e:5b:a1:0a", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7cb59d-71", "ovs_interfaceid": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a1:0a,bridge_name='br-int',has_traffic_filtering=True,id=6d7cb59d-71a7-40f3-9a9c-cb5e101393ee,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d7cb59d-71') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG nova.objects.instance [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lazy-loading 'pci_devices' on Instance uuid a17bb53e-b230-4d23-931a-5b59aa3ad311 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] End _get_guest_xml xml=<domain type="kvm">
Nov 18 19:06:41 user nova-compute[74692]:   <uuid>a17bb53e-b230-4d23-931a-5b59aa3ad311</uuid>
Nov 18 19:06:41 user nova-compute[74692]:   <name>instance-00000031</name>
Nov 18 19:06:41 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 19:06:41 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 19:06:41 user nova-compute[74692]:   <metadata>
Nov 18 19:06:41 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 19:06:41 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 19:06:41 user nova-compute[74692]:       <nova:name>tempest-TestVolumeBootPattern-server-1907088120</nova:name>
Nov 18 19:06:41 user nova-compute[74692]:       <nova:creationTime>2023-11-18 19:06:39</nova:creationTime>
Nov 18 19:06:41 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 19:06:41 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 19:06:41 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 19:06:41 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 19:06:41 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 19:06:41 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 19:06:41 user nova-compute[74692]:       </nova:flavor>
Nov 18 19:06:41 user nova-compute[74692]:       <nova:owner>
Nov 18 19:06:41 user nova-compute[74692]:         <nova:user uuid="f58b7c308c3b4fa7bb4f576048ef7619">tempest-TestVolumeBootPattern-1940625728-project-member</nova:user>
Nov 18 19:06:41 user nova-compute[74692]:         <nova:project uuid="d3a60e439a714bdd8fca1ec43e2a3139">tempest-TestVolumeBootPattern-1940625728</nova:project>
Nov 18 19:06:41 user nova-compute[74692]:       </nova:owner>
Nov 18 19:06:41 user nova-compute[74692]:       <nova:ports>
Nov 18 19:06:41 user nova-compute[74692]:         <nova:port uuid="6d7cb59d-71a7-40f3-9a9c-cb5e101393ee">
Nov 18 19:06:41 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 19:06:41 user nova-compute[74692]:         </nova:port>
Nov 18 19:06:41 user nova-compute[74692]:       </nova:ports>
Nov 18 19:06:41 user nova-compute[74692]:     </nova:instance>
Nov 18 19:06:41 user nova-compute[74692]:   </metadata>
Nov 18 19:06:41 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 19:06:41 user nova-compute[74692]:     <system>
Nov 18 19:06:41 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 19:06:41 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 19:06:41 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 19:06:41 user nova-compute[74692]:       <entry name="serial">a17bb53e-b230-4d23-931a-5b59aa3ad311</entry>
Nov 18 19:06:41 user nova-compute[74692]:       <entry name="uuid">a17bb53e-b230-4d23-931a-5b59aa3ad311</entry>
Nov 18 19:06:41 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 19:06:41 user nova-compute[74692]:     </system>
Nov 18 19:06:41 user nova-compute[74692]:   </sysinfo>
Nov 18 19:06:41 user nova-compute[74692]:   <os>
Nov 18 19:06:41 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 19:06:41 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 19:06:41 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 19:06:41 user nova-compute[74692]:   </os>
Nov 18 19:06:41 user nova-compute[74692]:   <features>
Nov 18 19:06:41 user nova-compute[74692]:     <acpi/>
Nov 18 19:06:41 user nova-compute[74692]:     <apic/>
Nov 18 19:06:41 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 19:06:41 user nova-compute[74692]:   </features>
Nov 18 19:06:41 user nova-compute[74692]:   <clock offset="utc">
Nov 18 19:06:41 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 19:06:41 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 19:06:41 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 19:06:41 user nova-compute[74692]:   </clock>
Nov 18 19:06:41 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 19:06:41 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 19:06:41 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 19:06:41 user nova-compute[74692]:   </cpu>
Nov 18 19:06:41 user nova-compute[74692]:   <devices>
Nov 18 19:06:41 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 19:06:41 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:06:41 user nova-compute[74692]:       <source dev="/dev/sdb"/>
Nov 18 19:06:41 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 19:06:41 user nova-compute[74692]:       <serial>a5db5828-739b-48f7-a725-000af2ed860a</serial>
Nov 18 19:06:41 user nova-compute[74692]:     </disk>
Nov 18 19:06:41 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 19:06:41 user nova-compute[74692]:       <mac address="fa:16:3e:5b:a1:0a"/>
Nov 18 19:06:41 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:06:41 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 19:06:41 user nova-compute[74692]:       <target dev="tap6d7cb59d-71"/>
Nov 18 19:06:41 user nova-compute[74692]:     </interface>
Nov 18 19:06:41 user nova-compute[74692]:     <serial type="pty">
Nov 18 19:06:41 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/a17bb53e-b230-4d23-931a-5b59aa3ad311/console.log" append="off"/>
Nov 18 19:06:41 user nova-compute[74692]:     </serial>
Nov 18 19:06:41 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 19:06:41 user nova-compute[74692]:     <video>
Nov 18 19:06:41 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:06:41 user nova-compute[74692]:     </video>
Nov 18 19:06:41 user nova-compute[74692]:     <rng model="virtio">
Nov 18 19:06:41 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 19:06:41 user nova-compute[74692]:     </rng>
Nov 18 19:06:41 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 19:06:41 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 19:06:41 user nova-compute[74692]:       <stats period="10"/>
Nov 18 19:06:41 user nova-compute[74692]:     </memballoon>
Nov 18 19:06:41 user nova-compute[74692]:   </devices>
Nov 18 19:06:41 user nova-compute[74692]: </domain>
Nov 18 19:06:41 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1907088120',display_name='tempest-TestVolumeBootPattern-server-1907088120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1907088120',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjQDIRpH38DKVgoyK1MoFv+m8f/mGJrL0ooZsg2wAfnTUJxFQk1uOmbgPDnD8Mh28/YfKlfkB/iskJj/3HNMpIea9BHIe4sWpufsnQvUXD1nCH47a4Mgeniq2skzVKHOQ==',key_name='tempest-TestVolumeBootPattern-917877268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-gcseav0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:06:34Z,user_data=None,user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=a17bb53e-b230-4d23-931a-5b59aa3ad311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "address": "fa:16:3e:5b:a1:0a", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7cb59d-71", "ovs_interfaceid": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "address": "fa:16:3e:5b:a1:0a", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7cb59d-71", "ovs_interfaceid": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a1:0a,bridge_name='br-int',has_traffic_filtering=True,id=6d7cb59d-71a7-40f3-9a9c-cb5e101393ee,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d7cb59d-71') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG os_vif [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a1:0a,bridge_name='br-int',has_traffic_filtering=True,id=6d7cb59d-71a7-40f3-9a9c-cb5e101393ee,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d7cb59d-71') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cbb5ee3-f934-5a79-ab1e-0866e4aed5be', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d7cb59d-71, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d7cb59d-71, col_values=(('qos', UUID('3bd9b84d-c7f3-4ed3-9136-f691fabd8ed2')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d7cb59d-71, col_values=(('external_ids', {'iface-id': '6d7cb59d-71a7-40f3-9a9c-cb5e101393ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:a1:0a', 'vm-uuid': 'a17bb53e-b230-4d23-931a-5b59aa3ad311'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:41 user nova-compute[74692]: INFO os_vif [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a1:0a,bridge_name='br-int',has_traffic_filtering=True,id=6d7cb59d-71a7-40f3-9a9c-cb5e101393ee,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d7cb59d-71')
Nov 18 19:06:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:06:41 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] No VIF found with MAC fa:16:3e:5b:a1:0a, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:06:42 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:06:42 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:06:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-a1c342a1-69c4-4520-b08a-559ac0629975 req-27114b49-5999-4a6e-9a97-9ea939d6c680 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received event network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:06:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a1c342a1-69c4-4520-b08a-559ac0629975 req-27114b49-5999-4a6e-9a97-9ea939d6c680 service nova] Acquiring lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:06:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a1c342a1-69c4-4520-b08a-559ac0629975 req-27114b49-5999-4a6e-9a97-9ea939d6c680 service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:06:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-a1c342a1-69c4-4520-b08a-559ac0629975 req-27114b49-5999-4a6e-9a97-9ea939d6c680 service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:42 user nova-compute[74692]: DEBUG nova.compute.manager [req-a1c342a1-69c4-4520-b08a-559ac0629975 req-27114b49-5999-4a6e-9a97-9ea939d6c680 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] No waiting events found dispatching network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:06:42 user nova-compute[74692]: WARNING nova.compute.manager [req-a1c342a1-69c4-4520-b08a-559ac0629975 req-27114b49-5999-4a6e-9a97-9ea939d6c680 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received unexpected event network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee for instance with vm_state building and task_state spawning.
Nov 18 19:06:42 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:06:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:44 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:06:44 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:06:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-301d85dc-84f6-4877-a936-1e448a5699ce req-aa99891e-2a15-49a3-bc1f-797933627c3e service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received event network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:06:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-301d85dc-84f6-4877-a936-1e448a5699ce req-aa99891e-2a15-49a3-bc1f-797933627c3e service nova] Acquiring lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:06:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-301d85dc-84f6-4877-a936-1e448a5699ce req-aa99891e-2a15-49a3-bc1f-797933627c3e service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:06:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-301d85dc-84f6-4877-a936-1e448a5699ce req-aa99891e-2a15-49a3-bc1f-797933627c3e service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-301d85dc-84f6-4877-a936-1e448a5699ce req-aa99891e-2a15-49a3-bc1f-797933627c3e service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] No waiting events found dispatching network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:06:44 user nova-compute[74692]: WARNING nova.compute.manager [req-301d85dc-84f6-4877-a936-1e448a5699ce req-aa99891e-2a15-49a3-bc1f-797933627c3e service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received unexpected event network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee for instance with vm_state building and task_state spawning.
Nov 18 19:06:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 19:06:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 19:06:45 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Instance spawned successfully.
Nov 18 19:06:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 19:06:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:06:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:06:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:06:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:06:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:06:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:06:45 user nova-compute[74692]: INFO nova.compute.manager [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 18 19:06:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 19:06:45 user nova-compute[74692]: INFO nova.compute.manager [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Took 11.39 seconds to build instance.
Nov 18 19:06:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-079619e3-ad69-46f8-97b3-8cbd9dad19cf tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.487s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:06:45 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:06:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:06:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-5b24b127-17d8-4e1e-9384-fdebb3ac312d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:06:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-5b24b127-17d8-4e1e-9384-fdebb3ac312d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:06:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:06:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Updating instance_info_cache with network_info: [{"id": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "address": "fa:16:3e:a0:bb:5c", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef90c059-3b", "ovs_interfaceid": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:06:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-5b24b127-17d8-4e1e-9384-fdebb3ac312d" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:06:46 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:06:47 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:06:47 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:06:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:48 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:06:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:06:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:07:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:07:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:07:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:07:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:07:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:07:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:07:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:07:03 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:07:03 user nova-compute[74692]: INFO nova.compute.manager [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Terminating instance
Nov 18 19:07:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 19:07:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-342b66ed-ccd1-4aea-9320-669c1321dc50 req-1137b685-09fa-40df-8e2a-03f0c0b391e5 service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Received event network-vif-unplugged-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-342b66ed-ccd1-4aea-9320-669c1321dc50 req-1137b685-09fa-40df-8e2a-03f0c0b391e5 service nova] Acquiring lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-342b66ed-ccd1-4aea-9320-669c1321dc50 req-1137b685-09fa-40df-8e2a-03f0c0b391e5 service nova] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-342b66ed-ccd1-4aea-9320-669c1321dc50 req-1137b685-09fa-40df-8e2a-03f0c0b391e5 service nova] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-342b66ed-ccd1-4aea-9320-669c1321dc50 req-1137b685-09fa-40df-8e2a-03f0c0b391e5 service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] No waiting events found dispatching network-vif-unplugged-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG nova.compute.manager [req-342b66ed-ccd1-4aea-9320-669c1321dc50 req-1137b685-09fa-40df-8e2a-03f0c0b391e5 service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Received event network-vif-unplugged-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 19:07:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Instance destroyed successfully.
Nov 18 19:07:04 user nova-compute[74692]: DEBUG nova.objects.instance [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lazy-loading 'resources' on Instance uuid 5b24b127-17d8-4e1e-9384-fdebb3ac312d {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-451458097',display_name='tempest-AttachVolumeNegativeTest-server-451458097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-451458097',id=48,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5u5/ZAHHJWAQWuDvvFv/Bz/uTIKQEAcrciKhgqcQIOYxDSDO5Ibx7cHl7eYU2LSLL8kGQbgXqecsThGXmJVltzBR6KpkIXjKO7J0BMNB/jTGRn6xQqB3gKVTrNQfw3Ow==',key_name='tempest-keypair-1590893607',keypairs=<?>,launch_index=0,launched_at=2023-11-18T19:04:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7475e741034a4302b0ab193f1b6c67d2',ramdisk_id='',reservation_id='r-toamwy5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-542263902',owner_user_name='tempest-AttachVolumeNegativeTest-542263902-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T19:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='def7f7c9ff4f4a29a840ace22d509755',uuid=5b24b127-17d8-4e1e-9384-fdebb3ac312d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "address": "fa:16:3e:a0:bb:5c", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef90c059-3b", "ovs_interfaceid": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converting VIF {"id": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "address": "fa:16:3e:a0:bb:5c", "network": {"id": "9d51fd41-c7aa-446d-9fe3-317b298ff0a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-617324462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7475e741034a4302b0ab193f1b6c67d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef90c059-3b", "ovs_interfaceid": "ef90c059-3bb9-4d7f-ba03-7e015eb13bb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:bb:5c,bridge_name='br-int',has_traffic_filtering=True,id=ef90c059-3bb9-4d7f-ba03-7e015eb13bb8,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef90c059-3b') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG os_vif [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:bb:5c,bridge_name='br-int',has_traffic_filtering=True,id=ef90c059-3bb9-4d7f-ba03-7e015eb13bb8,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef90c059-3b') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef90c059-3b, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f7dc313-353f-4e42-bc0b-89ebc6ebe722) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:07:04 user nova-compute[74692]: INFO os_vif [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:bb:5c,bridge_name='br-int',has_traffic_filtering=True,id=ef90c059-3bb9-4d7f-ba03-7e015eb13bb8,network=Network(9d51fd41-c7aa-446d-9fe3-317b298ff0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef90c059-3b')
Nov 18 19:07:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Deleting instance files /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d_del
Nov 18 19:07:04 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Deletion of /opt/stack/data/nova/instances/5b24b127-17d8-4e1e-9384-fdebb3ac312d_del complete
Nov 18 19:07:04 user nova-compute[74692]: INFO nova.compute.manager [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 18 19:07:04 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 19:07:04 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 19:07:05 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:07:05 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Took 0.66 seconds to deallocate network for instance.
Nov 18 19:07:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:07:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:07:05 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:07:05 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:07:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:07:05 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Deleted allocations for instance 5b24b127-17d8-4e1e-9384-fdebb3ac312d
Nov 18 19:07:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-29587535-9ee0-485a-a883-1e0b28e4ca90 tempest-AttachVolumeNegativeTest-542263902 tempest-AttachVolumeNegativeTest-542263902-project-member] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.070s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:07:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-420ae9c6-5789-4121-b171-8414fb53872e req-72a4888a-2bf1-40ea-9356-531bba45f7db service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Received event network-vif-plugged-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:07:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-420ae9c6-5789-4121-b171-8414fb53872e req-72a4888a-2bf1-40ea-9356-531bba45f7db service nova] Acquiring lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:07:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-420ae9c6-5789-4121-b171-8414fb53872e req-72a4888a-2bf1-40ea-9356-531bba45f7db service nova] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:07:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-420ae9c6-5789-4121-b171-8414fb53872e req-72a4888a-2bf1-40ea-9356-531bba45f7db service nova] Lock "5b24b127-17d8-4e1e-9384-fdebb3ac312d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:07:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-420ae9c6-5789-4121-b171-8414fb53872e req-72a4888a-2bf1-40ea-9356-531bba45f7db service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] No waiting events found dispatching network-vif-plugged-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:07:06 user nova-compute[74692]: WARNING nova.compute.manager [req-420ae9c6-5789-4121-b171-8414fb53872e req-72a4888a-2bf1-40ea-9356-531bba45f7db service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Received unexpected event network-vif-plugged-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 for instance with vm_state deleted and task_state None.
Nov 18 19:07:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-420ae9c6-5789-4121-b171-8414fb53872e req-72a4888a-2bf1-40ea-9356-531bba45f7db service nova] [instance: 5b24b127-17d8-4e1e-9384-fdebb3ac312d] Received event network-vif-deleted-ef90c059-3bb9-4d7f-ba03-7e015eb13bb8 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:07:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:07:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:36 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:07:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:07:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:07:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:07:36 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:07:37 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:07:37 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:07:37 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:07:37 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8874MB free_disk=25.040401458740234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:07:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:07:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:07:37 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance a17bb53e-b230-4d23-931a-5b59aa3ad311 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:07:37 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:07:37 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:07:37 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:07:37 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:07:37 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:07:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:07:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:43 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:07:43 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:07:43 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:07:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:44 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:07:45 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:07:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:07:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Didn't find any instances for network info cache update. {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 19:07:46 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:07:48 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:07:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:49 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:07:50 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:07:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:07:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Acquiring lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:22 user nova-compute[74692]: DEBUG nova.compute.manager [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 19:08:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 19:08:22 user nova-compute[74692]: INFO nova.compute.claims [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Claim successful on node user
Nov 18 19:08:23 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG nova.network.neutron [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 19:08:23 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 19:08:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG nova.policy [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '481eb0e796bd4acf8ab79a29d5d7b01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895325ccd1d94431b30fd7e946891c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG nova.compute.manager [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 19:08:23 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Creating image(s)
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Acquiring lock "/opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "/opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "/opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk 1073741824" returned: 0 in 0.068s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG nova.network.neutron [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Successfully created port: 53061922-339a-4cc1-b231-3b6addc610ef {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 19:08:23 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Cannot resize image /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Ensure instance console log exists: /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.network.neutron [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Successfully updated port: 53061922-339a-4cc1-b231-3b6addc610ef {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Acquiring lock "refresh_cache-85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Acquired lock "refresh_cache-85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.network.neutron [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-0279a20b-f2c1-4f1a-bfe8-1f34d2c6750c req-a2ca92fd-f79f-4790-b45b-a5ff6e5344de service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Received event network-changed-53061922-339a-4cc1-b231-3b6addc610ef {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-0279a20b-f2c1-4f1a-bfe8-1f34d2c6750c req-a2ca92fd-f79f-4790-b45b-a5ff6e5344de service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Refreshing instance network info cache due to event network-changed-53061922-339a-4cc1-b231-3b6addc610ef. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0279a20b-f2c1-4f1a-bfe8-1f34d2c6750c req-a2ca92fd-f79f-4790-b45b-a5ff6e5344de service nova] Acquiring lock "refresh_cache-85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.network.neutron [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.network.neutron [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Updating instance_info_cache with network_info: [{"id": "53061922-339a-4cc1-b231-3b6addc610ef", "address": "fa:16:3e:0c:fc:6b", "network": {"id": "95576350-13b9-42e4-beef-5a1ba86ef01b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1535183423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895325ccd1d94431b30fd7e946891c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53061922-33", "ovs_interfaceid": "53061922-339a-4cc1-b231-3b6addc610ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Releasing lock "refresh_cache-85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.compute.manager [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Instance network_info: |[{"id": "53061922-339a-4cc1-b231-3b6addc610ef", "address": "fa:16:3e:0c:fc:6b", "network": {"id": "95576350-13b9-42e4-beef-5a1ba86ef01b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1535183423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895325ccd1d94431b30fd7e946891c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53061922-33", "ovs_interfaceid": "53061922-339a-4cc1-b231-3b6addc610ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0279a20b-f2c1-4f1a-bfe8-1f34d2c6750c req-a2ca92fd-f79f-4790-b45b-a5ff6e5344de service nova] Acquired lock "refresh_cache-85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.network.neutron [req-0279a20b-f2c1-4f1a-bfe8-1f34d2c6750c req-a2ca92fd-f79f-4790-b45b-a5ff6e5344de service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Refreshing network info cache for port 53061922-339a-4cc1-b231-3b6addc610ef {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Start _get_guest_xml network_info=[{"id": "53061922-339a-4cc1-b231-3b6addc610ef", "address": "fa:16:3e:0c:fc:6b", "network": {"id": "95576350-13b9-42e4-beef-5a1ba86ef01b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1535183423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895325ccd1d94431b30fd7e946891c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53061922-33", "ovs_interfaceid": "53061922-339a-4cc1-b231-3b6addc610ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 19:08:24 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:08:24 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1602231573',display_name='tempest-VolumesActionsTest-instance-1602231573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1602231573',id=50,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='895325ccd1d94431b30fd7e946891c35',ramdisk_id='',reservation_id='r-5al9oo6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-486468935',owner_user_name='tempest-VolumesActionsTest-486468935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:08:23Z,user_data=None,user_id='481eb0e796bd4acf8ab79a29d5d7b01d',uuid=85aa6b8c-0823-4393-ab64-a68b8e0ef2bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53061922-339a-4cc1-b231-3b6addc610ef", "address": "fa:16:3e:0c:fc:6b", "network": {"id": "95576350-13b9-42e4-beef-5a1ba86ef01b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1535183423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895325ccd1d94431b30fd7e946891c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53061922-33", "ovs_interfaceid": "53061922-339a-4cc1-b231-3b6addc610ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Converting VIF {"id": "53061922-339a-4cc1-b231-3b6addc610ef", "address": "fa:16:3e:0c:fc:6b", "network": {"id": "95576350-13b9-42e4-beef-5a1ba86ef01b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1535183423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895325ccd1d94431b30fd7e946891c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53061922-33", "ovs_interfaceid": "53061922-339a-4cc1-b231-3b6addc610ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:fc:6b,bridge_name='br-int',has_traffic_filtering=True,id=53061922-339a-4cc1-b231-3b6addc610ef,network=Network(95576350-13b9-42e4-beef-5a1ba86ef01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53061922-33') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.objects.instance [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lazy-loading 'pci_devices' on Instance uuid 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] End _get_guest_xml xml=<domain type="kvm">
Nov 18 19:08:24 user nova-compute[74692]:   <uuid>85aa6b8c-0823-4393-ab64-a68b8e0ef2bf</uuid>
Nov 18 19:08:24 user nova-compute[74692]:   <name>instance-00000032</name>
Nov 18 19:08:24 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 19:08:24 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 19:08:24 user nova-compute[74692]:   <metadata>
Nov 18 19:08:24 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 19:08:24 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 19:08:24 user nova-compute[74692]:       <nova:name>tempest-VolumesActionsTest-instance-1602231573</nova:name>
Nov 18 19:08:24 user nova-compute[74692]:       <nova:creationTime>2023-11-18 19:08:24</nova:creationTime>
Nov 18 19:08:24 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 19:08:24 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 19:08:24 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 19:08:24 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 19:08:24 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 19:08:24 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 19:08:24 user nova-compute[74692]:       </nova:flavor>
Nov 18 19:08:24 user nova-compute[74692]:       <nova:owner>
Nov 18 19:08:24 user nova-compute[74692]:         <nova:user uuid="481eb0e796bd4acf8ab79a29d5d7b01d">tempest-VolumesActionsTest-486468935-project-member</nova:user>
Nov 18 19:08:24 user nova-compute[74692]:         <nova:project uuid="895325ccd1d94431b30fd7e946891c35">tempest-VolumesActionsTest-486468935</nova:project>
Nov 18 19:08:24 user nova-compute[74692]:       </nova:owner>
Nov 18 19:08:24 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 19:08:24 user nova-compute[74692]:       <nova:ports>
Nov 18 19:08:24 user nova-compute[74692]:         <nova:port uuid="53061922-339a-4cc1-b231-3b6addc610ef">
Nov 18 19:08:24 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 18 19:08:24 user nova-compute[74692]:         </nova:port>
Nov 18 19:08:24 user nova-compute[74692]:       </nova:ports>
Nov 18 19:08:24 user nova-compute[74692]:     </nova:instance>
Nov 18 19:08:24 user nova-compute[74692]:   </metadata>
Nov 18 19:08:24 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 19:08:24 user nova-compute[74692]:     <system>
Nov 18 19:08:24 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 19:08:24 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 19:08:24 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 19:08:24 user nova-compute[74692]:       <entry name="serial">85aa6b8c-0823-4393-ab64-a68b8e0ef2bf</entry>
Nov 18 19:08:24 user nova-compute[74692]:       <entry name="uuid">85aa6b8c-0823-4393-ab64-a68b8e0ef2bf</entry>
Nov 18 19:08:24 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 19:08:24 user nova-compute[74692]:     </system>
Nov 18 19:08:24 user nova-compute[74692]:   </sysinfo>
Nov 18 19:08:24 user nova-compute[74692]:   <os>
Nov 18 19:08:24 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 19:08:24 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 19:08:24 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 19:08:24 user nova-compute[74692]:   </os>
Nov 18 19:08:24 user nova-compute[74692]:   <features>
Nov 18 19:08:24 user nova-compute[74692]:     <acpi/>
Nov 18 19:08:24 user nova-compute[74692]:     <apic/>
Nov 18 19:08:24 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 19:08:24 user nova-compute[74692]:   </features>
Nov 18 19:08:24 user nova-compute[74692]:   <clock offset="utc">
Nov 18 19:08:24 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 19:08:24 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 19:08:24 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 19:08:24 user nova-compute[74692]:   </clock>
Nov 18 19:08:24 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 19:08:24 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 19:08:24 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 19:08:24 user nova-compute[74692]:   </cpu>
Nov 18 19:08:24 user nova-compute[74692]:   <devices>
Nov 18 19:08:24 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 19:08:24 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 19:08:24 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk"/>
Nov 18 19:08:24 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 19:08:24 user nova-compute[74692]:     </disk>
Nov 18 19:08:24 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 19:08:24 user nova-compute[74692]:       <mac address="fa:16:3e:0c:fc:6b"/>
Nov 18 19:08:24 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:08:24 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 19:08:24 user nova-compute[74692]:       <target dev="tap53061922-33"/>
Nov 18 19:08:24 user nova-compute[74692]:     </interface>
Nov 18 19:08:24 user nova-compute[74692]:     <serial type="pty">
Nov 18 19:08:24 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/console.log" append="off"/>
Nov 18 19:08:24 user nova-compute[74692]:     </serial>
Nov 18 19:08:24 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 19:08:24 user nova-compute[74692]:     <video>
Nov 18 19:08:24 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:08:24 user nova-compute[74692]:     </video>
Nov 18 19:08:24 user nova-compute[74692]:     <rng model="virtio">
Nov 18 19:08:24 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 19:08:24 user nova-compute[74692]:     </rng>
Nov 18 19:08:24 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 19:08:24 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 19:08:24 user nova-compute[74692]:       <stats period="10"/>
Nov 18 19:08:24 user nova-compute[74692]:     </memballoon>
Nov 18 19:08:24 user nova-compute[74692]:   </devices>
Nov 18 19:08:24 user nova-compute[74692]: </domain>
Nov 18 19:08:24 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1602231573',display_name='tempest-VolumesActionsTest-instance-1602231573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1602231573',id=50,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='895325ccd1d94431b30fd7e946891c35',ramdisk_id='',reservation_id='r-5al9oo6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-486468935',owner_user_name='tempest-VolumesActionsTest-486468935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:08:23Z,user_data=None,user_id='481eb0e796bd4acf8ab79a29d5d7b01d',uuid=85aa6b8c-0823-4393-ab64-a68b8e0ef2bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53061922-339a-4cc1-b231-3b6addc610ef", "address": "fa:16:3e:0c:fc:6b", "network": {"id": "95576350-13b9-42e4-beef-5a1ba86ef01b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1535183423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895325ccd1d94431b30fd7e946891c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53061922-33", "ovs_interfaceid": "53061922-339a-4cc1-b231-3b6addc610ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Converting VIF {"id": "53061922-339a-4cc1-b231-3b6addc610ef", "address": "fa:16:3e:0c:fc:6b", "network": {"id": "95576350-13b9-42e4-beef-5a1ba86ef01b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1535183423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895325ccd1d94431b30fd7e946891c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53061922-33", "ovs_interfaceid": "53061922-339a-4cc1-b231-3b6addc610ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:fc:6b,bridge_name='br-int',has_traffic_filtering=True,id=53061922-339a-4cc1-b231-3b6addc610ef,network=Network(95576350-13b9-42e4-beef-5a1ba86ef01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53061922-33') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG os_vif [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:fc:6b,bridge_name='br-int',has_traffic_filtering=True,id=53061922-339a-4cc1-b231-3b6addc610ef,network=Network(95576350-13b9-42e4-beef-5a1ba86ef01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53061922-33') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '635e2dcf-239e-5c26-9811-29a5c78997cf', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53061922-33, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53061922-33, col_values=(('qos', UUID('74f49ce6-3b78-426e-8dc0-3f4d28a67c13')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53061922-33, col_values=(('external_ids', {'iface-id': '53061922-339a-4cc1-b231-3b6addc610ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:fc:6b', 'vm-uuid': '85aa6b8c-0823-4393-ab64-a68b8e0ef2bf'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:24 user nova-compute[74692]: INFO os_vif [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:fc:6b,bridge_name='br-int',has_traffic_filtering=True,id=53061922-339a-4cc1-b231-3b6addc610ef,network=Network(95576350-13b9-42e4-beef-5a1ba86ef01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53061922-33')
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:08:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] No VIF found with MAC fa:16:3e:0c:fc:6b, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:08:25 user nova-compute[74692]: DEBUG nova.network.neutron [req-0279a20b-f2c1-4f1a-bfe8-1f34d2c6750c req-a2ca92fd-f79f-4790-b45b-a5ff6e5344de service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Updated VIF entry in instance network info cache for port 53061922-339a-4cc1-b231-3b6addc610ef. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:08:25 user nova-compute[74692]: DEBUG nova.network.neutron [req-0279a20b-f2c1-4f1a-bfe8-1f34d2c6750c req-a2ca92fd-f79f-4790-b45b-a5ff6e5344de service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Updating instance_info_cache with network_info: [{"id": "53061922-339a-4cc1-b231-3b6addc610ef", "address": "fa:16:3e:0c:fc:6b", "network": {"id": "95576350-13b9-42e4-beef-5a1ba86ef01b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1535183423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895325ccd1d94431b30fd7e946891c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53061922-33", "ovs_interfaceid": "53061922-339a-4cc1-b231-3b6addc610ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:08:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0279a20b-f2c1-4f1a-bfe8-1f34d2c6750c req-a2ca92fd-f79f-4790-b45b-a5ff6e5344de service nova] Releasing lock "refresh_cache-85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:08:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-490acfeb-532e-4c16-8b02-172be768e174 req-21357aab-5bc2-4dcf-baf8-5f40f52b2c37 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received event network-changed-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:08:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-490acfeb-532e-4c16-8b02-172be768e174 req-21357aab-5bc2-4dcf-baf8-5f40f52b2c37 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Refreshing instance network info cache due to event network-changed-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:08:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-490acfeb-532e-4c16-8b02-172be768e174 req-21357aab-5bc2-4dcf-baf8-5f40f52b2c37 service nova] Acquiring lock "refresh_cache-a17bb53e-b230-4d23-931a-5b59aa3ad311" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:08:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-490acfeb-532e-4c16-8b02-172be768e174 req-21357aab-5bc2-4dcf-baf8-5f40f52b2c37 service nova] Acquired lock "refresh_cache-a17bb53e-b230-4d23-931a-5b59aa3ad311" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:08:25 user nova-compute[74692]: DEBUG nova.network.neutron [req-490acfeb-532e-4c16-8b02-172be768e174 req-21357aab-5bc2-4dcf-baf8-5f40f52b2c37 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Refreshing network info cache for port 6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG nova.network.neutron [req-490acfeb-532e-4c16-8b02-172be768e174 req-21357aab-5bc2-4dcf-baf8-5f40f52b2c37 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Updated VIF entry in instance network info cache for port 6d7cb59d-71a7-40f3-9a9c-cb5e101393ee. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG nova.network.neutron [req-490acfeb-532e-4c16-8b02-172be768e174 req-21357aab-5bc2-4dcf-baf8-5f40f52b2c37 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Updating instance_info_cache with network_info: [{"id": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "address": "fa:16:3e:5b:a1:0a", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7cb59d-71", "ovs_interfaceid": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-490acfeb-532e-4c16-8b02-172be768e174 req-21357aab-5bc2-4dcf-baf8-5f40f52b2c37 service nova] Releasing lock "refresh_cache-a17bb53e-b230-4d23-931a-5b59aa3ad311" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "a17bb53e-b230-4d23-931a-5b59aa3ad311" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:26 user nova-compute[74692]: INFO nova.compute.manager [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Terminating instance
Nov 18 19:08:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG nova.compute.manager [req-ada8c0af-64cc-4e49-9104-15e1b591f42b req-e80b73db-aeac-4f97-951f-dc3f04a8fb39 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received event network-vif-unplugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ada8c0af-64cc-4e49-9104-15e1b591f42b req-e80b73db-aeac-4f97-951f-dc3f04a8fb39 service nova] Acquiring lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ada8c0af-64cc-4e49-9104-15e1b591f42b req-e80b73db-aeac-4f97-951f-dc3f04a8fb39 service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-ada8c0af-64cc-4e49-9104-15e1b591f42b req-e80b73db-aeac-4f97-951f-dc3f04a8fb39 service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG nova.compute.manager [req-ada8c0af-64cc-4e49-9104-15e1b591f42b req-e80b73db-aeac-4f97-951f-dc3f04a8fb39 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] No waiting events found dispatching network-vif-unplugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG nova.compute.manager [req-ada8c0af-64cc-4e49-9104-15e1b591f42b req-e80b73db-aeac-4f97-951f-dc3f04a8fb39 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received event network-vif-unplugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:27 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Instance destroyed successfully.
Nov 18 19:08:27 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lazy-loading 'resources' on Instance uuid a17bb53e-b230-4d23-931a-5b59aa3ad311 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1907088120',display_name='tempest-TestVolumeBootPattern-server-1907088120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1907088120',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjQDIRpH38DKVgoyK1MoFv+m8f/mGJrL0ooZsg2wAfnTUJxFQk1uOmbgPDnD8Mh28/YfKlfkB/iskJj/3HNMpIea9BHIe4sWpufsnQvUXD1nCH47a4Mgeniq2skzVKHOQ==',key_name='tempest-TestVolumeBootPattern-917877268',keypairs=<?>,launch_index=0,launched_at=2023-11-18T19:06:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-gcseav0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T19:06:45Z,user_data=None,user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=a17bb53e-b230-4d23-931a-5b59aa3ad311,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "address": "fa:16:3e:5b:a1:0a", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7cb59d-71", "ovs_interfaceid": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "address": "fa:16:3e:5b:a1:0a", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7cb59d-71", "ovs_interfaceid": "6d7cb59d-71a7-40f3-9a9c-cb5e101393ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a1:0a,bridge_name='br-int',has_traffic_filtering=True,id=6d7cb59d-71a7-40f3-9a9c-cb5e101393ee,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d7cb59d-71') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_vif [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a1:0a,bridge_name='br-int',has_traffic_filtering=True,id=6d7cb59d-71a7-40f3-9a9c-cb5e101393ee,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d7cb59d-71') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d7cb59d-71, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3bd9b84d-c7f3-4ed3-9136-f691fabd8ed2) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:27 user nova-compute[74692]: INFO os_vif [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a1:0a,bridge_name='br-int',has_traffic_filtering=True,id=6d7cb59d-71a7-40f3-9a9c-cb5e101393ee,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d7cb59d-71')
Nov 18 19:08:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhtwLfvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:08:27 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0736dc8b-fb85-4c3d-b9b5-b50e0f8305d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:08:27 user nova-compute[74692]: No targets found.
Nov 18 19:08:27 user nova-compute[74692]: iSNS:
Nov 18 19:08:27 user nova-compute[74692]: No targets found.
Nov 18 19:08:27 user nova-compute[74692]: STATIC:
Nov 18 19:08:27 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a
Nov 18 19:08:27 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:08:27 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:08:27 user nova-compute[74692]: FIRMWARE:
Nov 18 19:08:27 user nova-compute[74692]: No targets found.
Nov 18 19:08:27 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:08:27 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:08:27 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b27ab4e-a3ce-4336-a57c-65fd4b4cf430]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3c787b-e419-41a7-ba69-7eeed3e01956]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)
Nov 18 19:08:27 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)
Nov 18 19:08:27 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a45ad870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[957ee641-7483-432c-9a48-d5d406247f15]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.039s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c33d81e-f26e-4e55-a173-e4393981154b]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed30aa3-dbc6-4a7b-9cb8-8fcb1e499de5]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[df46be82-45a7-4468-85f6-40a5da74113d]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2e653459-b20764e2236f8f59', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2e653459', '/dev/disk/by-id/scsi-26232303736346532') {{(pid=84932) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf5fedb-029c-4c68-ac3c-4baf53f77819]: (4, None) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[17739ec2-bdd4-4bcd-9783-6cc13c6a1c2c]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cae491-4474-4010-a208-d4416d08dfa4]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260]
Nov 18 19:08:27 user nova-compute[74692]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260] successful.
Nov 18 19:08:27 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe73c70-d072-42d4-b38d-bbf0cac699b6]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== disconnect_volume: return (347ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:08:27 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Deleting instance files /opt/stack/data/nova/instances/a17bb53e-b230-4d23-931a-5b59aa3ad311_del
Nov 18 19:08:27 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Deletion of /opt/stack/data/nova/instances/a17bb53e-b230-4d23-931a-5b59aa3ad311_del complete
Nov 18 19:08:27 user nova-compute[74692]: INFO nova.compute.manager [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-f39d1375-b98a-4793-b9c0-485a56b16480 req-927ae134-bc40-45d9-989b-c0341e509fbe service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Received event network-vif-plugged-53061922-339a-4cc1-b231-3b6addc610ef {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f39d1375-b98a-4793-b9c0-485a56b16480 req-927ae134-bc40-45d9-989b-c0341e509fbe service nova] Acquiring lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f39d1375-b98a-4793-b9c0-485a56b16480 req-927ae134-bc40-45d9-989b-c0341e509fbe service nova] Lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f39d1375-b98a-4793-b9c0-485a56b16480 req-927ae134-bc40-45d9-989b-c0341e509fbe service nova] Lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-f39d1375-b98a-4793-b9c0-485a56b16480 req-927ae134-bc40-45d9-989b-c0341e509fbe service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] No waiting events found dispatching network-vif-plugged-53061922-339a-4cc1-b231-3b6addc610ef {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:08:27 user nova-compute[74692]: WARNING nova.compute.manager [req-f39d1375-b98a-4793-b9c0-485a56b16480 req-927ae134-bc40-45d9-989b-c0341e509fbe service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Received unexpected event network-vif-plugged-53061922-339a-4cc1-b231-3b6addc610ef for instance with vm_state building and task_state spawning.
Nov 18 19:08:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-f39d1375-b98a-4793-b9c0-485a56b16480 req-927ae134-bc40-45d9-989b-c0341e509fbe service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Received event network-vif-plugged-53061922-339a-4cc1-b231-3b6addc610ef {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f39d1375-b98a-4793-b9c0-485a56b16480 req-927ae134-bc40-45d9-989b-c0341e509fbe service nova] Acquiring lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f39d1375-b98a-4793-b9c0-485a56b16480 req-927ae134-bc40-45d9-989b-c0341e509fbe service nova] Lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f39d1375-b98a-4793-b9c0-485a56b16480 req-927ae134-bc40-45d9-989b-c0341e509fbe service nova] Lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-f39d1375-b98a-4793-b9c0-485a56b16480 req-927ae134-bc40-45d9-989b-c0341e509fbe service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] No waiting events found dispatching network-vif-plugged-53061922-339a-4cc1-b231-3b6addc610ef {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:08:27 user nova-compute[74692]: WARNING nova.compute.manager [req-f39d1375-b98a-4793-b9c0-485a56b16480 req-927ae134-bc40-45d9-989b-c0341e509fbe service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Received unexpected event network-vif-plugged-53061922-339a-4cc1-b231-3b6addc610ef for instance with vm_state building and task_state spawning.
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:08:28 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Took 0.79 seconds to deallocate network for instance.
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-17b5f6d1-f5f0-4049-87e5-4402c6fdba46 req-513bf926-0f0e-4559-8220-c86e4349de1e service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received event network-vif-deleted-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:08:28 user nova-compute[74692]: INFO nova.compute.manager [req-17b5f6d1-f5f0-4049-87e5-4402c6fdba46 req-513bf926-0f0e-4559-8220-c86e4349de1e service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Neutron deleted interface 6d7cb59d-71a7-40f3-9a9c-cb5e101393ee; detaching it from the instance and deleting it from the info cache
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.network.neutron [req-17b5f6d1-f5f0-4049-87e5-4402c6fdba46 req-513bf926-0f0e-4559-8220-c86e4349de1e service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-17b5f6d1-f5f0-4049-87e5-4402c6fdba46 req-513bf926-0f0e-4559-8220-c86e4349de1e service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Detach interface failed, port_id=6d7cb59d-71a7-40f3-9a9c-cb5e101393ee, reason: Instance a17bb53e-b230-4d23-931a-5b59aa3ad311 could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 19:08:28 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Instance spawned successfully.
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:28 user nova-compute[74692]: INFO nova.compute.manager [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.compute.manager [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 19:08:28 user nova-compute[74692]: INFO nova.compute.manager [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Took 5.74 seconds to build instance.
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-737b2010-4bad-43f1-9fed-00346ebdeb4e tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.968s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received event network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] Acquiring lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] No waiting events found dispatching network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:08:28 user nova-compute[74692]: WARNING nova.compute.manager [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received unexpected event network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee for instance with vm_state active and task_state deleting.
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received event network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] Acquiring lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] No waiting events found dispatching network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:08:28 user nova-compute[74692]: WARNING nova.compute.manager [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received unexpected event network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee for instance with vm_state active and task_state deleting.
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received event network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] Acquiring lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] No waiting events found dispatching network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:08:28 user nova-compute[74692]: WARNING nova.compute.manager [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received unexpected event network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee for instance with vm_state active and task_state deleting.
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received event network-vif-unplugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] Acquiring lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] No waiting events found dispatching network-vif-unplugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received event network-vif-unplugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received event network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] Acquiring lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:28 user nova-compute[74692]: DEBUG nova.compute.manager [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] No waiting events found dispatching network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:08:28 user nova-compute[74692]: WARNING nova.compute.manager [req-8112235d-c761-49d6-b1a4-c580c12a334a req-5b95e2da-7de7-4718-9270-cca0ac76e1c6 service nova] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Received unexpected event network-vif-plugged-6d7cb59d-71a7-40f3-9a9c-cb5e101393ee for instance with vm_state active and task_state deleting.
Nov 18 19:08:29 user nova-compute[74692]: INFO nova.compute.manager [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: a17bb53e-b230-4d23-931a-5b59aa3ad311] Took 0.85 seconds to detach 1 volumes for instance.
Nov 18 19:08:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:29 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:08:29 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:08:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:29 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Deleted allocations for instance a17bb53e-b230-4d23-931a-5b59aa3ad311
Nov 18 19:08:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3ee3a876-3e93-499e-905b-0957b8653d14 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "a17bb53e-b230-4d23-931a-5b59aa3ad311" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.238s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:37 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:08:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:37 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:08:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:08:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:08:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:38 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:08:38 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:08:38 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8902MB free_disk=25.036365509033203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:08:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:08:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:08:38 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:08:38 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:08:38 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:08:38 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:08:38 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:08:38 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:08:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:08:41 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:08:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:43 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:08:43 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:08:45 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:08:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:08:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 19:08:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:08:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:08:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:08:46 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:08:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Updating instance_info_cache with network_info: [{"id": "53061922-339a-4cc1-b231-3b6addc610ef", "address": "fa:16:3e:0c:fc:6b", "network": {"id": "95576350-13b9-42e4-beef-5a1ba86ef01b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1535183423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895325ccd1d94431b30fd7e946891c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53061922-33", "ovs_interfaceid": "53061922-339a-4cc1-b231-3b6addc610ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:08:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:08:46 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:08:46 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:08:46 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:08:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:47 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:08:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:48 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:08:51 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:08:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:52 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:08:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:08:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:12 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:09:17 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:09:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:09:18 user nova-compute[74692]: DEBUG nova.compute.manager [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 19:09:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:09:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:09:18 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 19:09:18 user nova-compute[74692]: INFO nova.compute.claims [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Claim successful on node user
Nov 18 19:09:18 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:09:18 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:09:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:09:18 user nova-compute[74692]: DEBUG nova.compute.manager [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 19:09:18 user nova-compute[74692]: DEBUG nova.compute.manager [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 19:09:18 user nova-compute[74692]: DEBUG nova.network.neutron [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 19:09:18 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 19:09:18 user nova-compute[74692]: DEBUG nova.compute.manager [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 19:09:18 user nova-compute[74692]: INFO nova.virt.block_device [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Booting with volume a5db5828-739b-48f7-a725-000af2ed860a at /dev/vda
Nov 18 19:09:18 user nova-compute[74692]: DEBUG nova.policy [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f58b7c308c3b4fa7bb4f576048ef7619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a60e439a714bdd8fca1ec43e2a3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG os_brick.utils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5e12f5-ac48-462a-8fd5-1c207120a684]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffa359c-f642-48a3-bf04-362ce50b9341]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c200e06b-33df-467b-815e-3535afb82fc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b6dbc7-2ed8-4e69-96f1-fbb2ac761c54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:09:19 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 19:09:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b42d187-df71-4140-90c4-9b5539be65cd]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG os_brick.utils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Updating existing volume attachment record: 86e803d5-1a90-4c74-9e59-39441e128b55 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:19 user nova-compute[74692]: DEBUG nova.network.neutron [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Successfully created port: 1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Successfully updated port: 1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquired lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-eeb96cd9-7985-4f88-8d41-d68f38b45aaa req-c5b87ab9-bad3-428d-a0b1-e380d84f40fa service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Received event network-changed-1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-eeb96cd9-7985-4f88-8d41-d68f38b45aaa req-c5b87ab9-bad3-428d-a0b1-e380d84f40fa service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Refreshing instance network info cache due to event network-changed-1c68d810-1609-47df-90c2-d2897b89809e. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eeb96cd9-7985-4f88-8d41-d68f38b45aaa req-c5b87ab9-bad3-428d-a0b1-e380d84f40fa service nova] Acquiring lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Updating instance_info_cache with network_info: [{"id": "1c68d810-1609-47df-90c2-d2897b89809e", "address": "fa:16:3e:bd:53:d7", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c68d810-16", "ovs_interfaceid": "1c68d810-1609-47df-90c2-d2897b89809e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Releasing lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Instance network_info: |[{"id": "1c68d810-1609-47df-90c2-d2897b89809e", "address": "fa:16:3e:bd:53:d7", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c68d810-16", "ovs_interfaceid": "1c68d810-1609-47df-90c2-d2897b89809e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eeb96cd9-7985-4f88-8d41-d68f38b45aaa req-c5b87ab9-bad3-428d-a0b1-e380d84f40fa service nova] Acquired lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-eeb96cd9-7985-4f88-8d41-d68f38b45aaa req-c5b87ab9-bad3-428d-a0b1-e380d84f40fa service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Refreshing network info cache for port 1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-eeb96cd9-7985-4f88-8d41-d68f38b45aaa req-c5b87ab9-bad3-428d-a0b1-e380d84f40fa service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Updated VIF entry in instance network info cache for port 1c68d810-1609-47df-90c2-d2897b89809e. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-eeb96cd9-7985-4f88-8d41-d68f38b45aaa req-c5b87ab9-bad3-428d-a0b1-e380d84f40fa service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Updating instance_info_cache with network_info: [{"id": "1c68d810-1609-47df-90c2-d2897b89809e", "address": "fa:16:3e:bd:53:d7", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c68d810-16", "ovs_interfaceid": "1c68d810-1609-47df-90c2-d2897b89809e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:09:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eeb96cd9-7985-4f88-8d41-d68f38b45aaa req-c5b87ab9-bad3-428d-a0b1-e380d84f40fa service nova] Releasing lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:09:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.compute.manager [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 19:09:24 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Creating image(s)
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Ensure instance console log exists: /opt/stack/data/nova/instances/44be4077-1065-4f5d-b6e1-9f71e4cd8791/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Start _get_guest_xml network_info=[{"id": "1c68d810-1609-47df-90c2-d2897b89809e", "address": "fa:16:3e:bd:53:d7", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c68d810-16", "ovs_interfaceid": "1c68d810-1609-47df-90c2-d2897b89809e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhtwLfvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '44be4077-1065-4f5d-b6e1-9f71e4cd8791', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5db5828-739b-48f7-a725-000af2ed860a', 'serial': 'a5db5828-739b-48f7-a725-000af2ed860a'}, 'attachment_id': '86e803d5-1a90-4c74-9e59-39441e128b55', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 19:09:24 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:09:24 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhtwLfvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:09:24 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:09:24 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:09:24 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90d3a10-f69f-4d8d-85fa-386b3c543f4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 19:09:24 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db64e9d-a49f-4de3-9c8d-0e7bd78cd5d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a] added
Nov 18 19:09:24 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4caa9a-70bc-48c5-83ef-49efc0cc9d48]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20070e2-4863-4882-afb3-d2d2614cf016]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AhtwLfvQ {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AhtwLfvQ" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f103ebef-fe77-4255-99f9-909c6f7aef51]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AhtwLfvQ'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9864f109-8333-4271-b346-4dfe5b2104b4]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfea3f0-279c-4175-a6f5-9595038c6f6a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:09:24 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:09:24 user nova-compute[74692]:  {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:09:24 user nova-compute[74692]: WARNING os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 19:09:24 user nova-compute[74692]: 
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28d7e5e-355b-426d-bf59-1066b315839e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260]
Nov 18 19:09:24 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260] successful.
Nov 18 19:09:24 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed7856a-4b52-4972-a08e-043d3c9d54df]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde5d996-961b-4566-8d33-f0639f3f783b]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)
Nov 18 19:09:24 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)
Nov 18 19:09:24 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.235s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01d7b4d-19f1-463f-888c-22d903bbcefd]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:09:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhtwLfvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.263s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== connect_volume: return (1264ms) {'type': 'block', 'scsi_wwn': '26232303736346532', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232303736346532', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1405426127',display_name='tempest-TestVolumeBootPattern-server-1405426127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1405426127',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjQDIRpH38DKVgoyK1MoFv+m8f/mGJrL0ooZsg2wAfnTUJxFQk1uOmbgPDnD8Mh28/YfKlfkB/iskJj/3HNMpIea9BHIe4sWpufsnQvUXD1nCH47a4Mgeniq2skzVKHOQ==',key_name='tempest-TestVolumeBootPattern-917877268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-f818n9cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:09:19Z,user_data=None,user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=44be4077-1065-4f5d-b6e1-9f71e4cd8791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c68d810-1609-47df-90c2-d2897b89809e", "address": "fa:16:3e:bd:53:d7", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c68d810-16", "ovs_interfaceid": "1c68d810-1609-47df-90c2-d2897b89809e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "1c68d810-1609-47df-90c2-d2897b89809e", "address": "fa:16:3e:bd:53:d7", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c68d810-16", "ovs_interfaceid": "1c68d810-1609-47df-90c2-d2897b89809e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:53:d7,bridge_name='br-int',has_traffic_filtering=True,id=1c68d810-1609-47df-90c2-d2897b89809e,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c68d810-16') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG nova.objects.instance [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lazy-loading 'pci_devices' on Instance uuid 44be4077-1065-4f5d-b6e1-9f71e4cd8791 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] End _get_guest_xml xml=<domain type="kvm">
Nov 18 19:09:25 user nova-compute[74692]:   <uuid>44be4077-1065-4f5d-b6e1-9f71e4cd8791</uuid>
Nov 18 19:09:25 user nova-compute[74692]:   <name>instance-00000033</name>
Nov 18 19:09:25 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 19:09:25 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 19:09:25 user nova-compute[74692]:   <metadata>
Nov 18 19:09:25 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 19:09:25 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 19:09:25 user nova-compute[74692]:       <nova:name>tempest-TestVolumeBootPattern-server-1405426127</nova:name>
Nov 18 19:09:25 user nova-compute[74692]:       <nova:creationTime>2023-11-18 19:09:24</nova:creationTime>
Nov 18 19:09:25 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 19:09:25 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 19:09:25 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 19:09:25 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 19:09:25 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 19:09:25 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 19:09:25 user nova-compute[74692]:       </nova:flavor>
Nov 18 19:09:25 user nova-compute[74692]:       <nova:owner>
Nov 18 19:09:25 user nova-compute[74692]:         <nova:user uuid="f58b7c308c3b4fa7bb4f576048ef7619">tempest-TestVolumeBootPattern-1940625728-project-member</nova:user>
Nov 18 19:09:25 user nova-compute[74692]:         <nova:project uuid="d3a60e439a714bdd8fca1ec43e2a3139">tempest-TestVolumeBootPattern-1940625728</nova:project>
Nov 18 19:09:25 user nova-compute[74692]:       </nova:owner>
Nov 18 19:09:25 user nova-compute[74692]:       <nova:ports>
Nov 18 19:09:25 user nova-compute[74692]:         <nova:port uuid="1c68d810-1609-47df-90c2-d2897b89809e">
Nov 18 19:09:25 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 18 19:09:25 user nova-compute[74692]:         </nova:port>
Nov 18 19:09:25 user nova-compute[74692]:       </nova:ports>
Nov 18 19:09:25 user nova-compute[74692]:     </nova:instance>
Nov 18 19:09:25 user nova-compute[74692]:   </metadata>
Nov 18 19:09:25 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 19:09:25 user nova-compute[74692]:     <system>
Nov 18 19:09:25 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 19:09:25 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 19:09:25 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 19:09:25 user nova-compute[74692]:       <entry name="serial">44be4077-1065-4f5d-b6e1-9f71e4cd8791</entry>
Nov 18 19:09:25 user nova-compute[74692]:       <entry name="uuid">44be4077-1065-4f5d-b6e1-9f71e4cd8791</entry>
Nov 18 19:09:25 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 19:09:25 user nova-compute[74692]:     </system>
Nov 18 19:09:25 user nova-compute[74692]:   </sysinfo>
Nov 18 19:09:25 user nova-compute[74692]:   <os>
Nov 18 19:09:25 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 19:09:25 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 19:09:25 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 19:09:25 user nova-compute[74692]:   </os>
Nov 18 19:09:25 user nova-compute[74692]:   <features>
Nov 18 19:09:25 user nova-compute[74692]:     <acpi/>
Nov 18 19:09:25 user nova-compute[74692]:     <apic/>
Nov 18 19:09:25 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 19:09:25 user nova-compute[74692]:   </features>
Nov 18 19:09:25 user nova-compute[74692]:   <clock offset="utc">
Nov 18 19:09:25 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 19:09:25 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 19:09:25 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 19:09:25 user nova-compute[74692]:   </clock>
Nov 18 19:09:25 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 19:09:25 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 19:09:25 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 19:09:25 user nova-compute[74692]:   </cpu>
Nov 18 19:09:25 user nova-compute[74692]:   <devices>
Nov 18 19:09:25 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 19:09:25 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:09:25 user nova-compute[74692]:       <source dev="/dev/sdb"/>
Nov 18 19:09:25 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 19:09:25 user nova-compute[74692]:       <serial>a5db5828-739b-48f7-a725-000af2ed860a</serial>
Nov 18 19:09:25 user nova-compute[74692]:     </disk>
Nov 18 19:09:25 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 19:09:25 user nova-compute[74692]:       <mac address="fa:16:3e:bd:53:d7"/>
Nov 18 19:09:25 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:09:25 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 19:09:25 user nova-compute[74692]:       <target dev="tap1c68d810-16"/>
Nov 18 19:09:25 user nova-compute[74692]:     </interface>
Nov 18 19:09:25 user nova-compute[74692]:     <serial type="pty">
Nov 18 19:09:25 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/44be4077-1065-4f5d-b6e1-9f71e4cd8791/console.log" append="off"/>
Nov 18 19:09:25 user nova-compute[74692]:     </serial>
Nov 18 19:09:25 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 19:09:25 user nova-compute[74692]:     <video>
Nov 18 19:09:25 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:09:25 user nova-compute[74692]:     </video>
Nov 18 19:09:25 user nova-compute[74692]:     <rng model="virtio">
Nov 18 19:09:25 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 19:09:25 user nova-compute[74692]:     </rng>
Nov 18 19:09:25 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 19:09:25 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 19:09:25 user nova-compute[74692]:       <stats period="10"/>
Nov 18 19:09:25 user nova-compute[74692]:     </memballoon>
Nov 18 19:09:25 user nova-compute[74692]:   </devices>
Nov 18 19:09:25 user nova-compute[74692]: </domain>
Nov 18 19:09:25 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1405426127',display_name='tempest-TestVolumeBootPattern-server-1405426127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1405426127',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjQDIRpH38DKVgoyK1MoFv+m8f/mGJrL0ooZsg2wAfnTUJxFQk1uOmbgPDnD8Mh28/YfKlfkB/iskJj/3HNMpIea9BHIe4sWpufsnQvUXD1nCH47a4Mgeniq2skzVKHOQ==',key_name='tempest-TestVolumeBootPattern-917877268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-f818n9cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:09:19Z,user_data=None,user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=44be4077-1065-4f5d-b6e1-9f71e4cd8791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c68d810-1609-47df-90c2-d2897b89809e", "address": "fa:16:3e:bd:53:d7", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c68d810-16", "ovs_interfaceid": "1c68d810-1609-47df-90c2-d2897b89809e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "1c68d810-1609-47df-90c2-d2897b89809e", "address": "fa:16:3e:bd:53:d7", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c68d810-16", "ovs_interfaceid": "1c68d810-1609-47df-90c2-d2897b89809e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:53:d7,bridge_name='br-int',has_traffic_filtering=True,id=1c68d810-1609-47df-90c2-d2897b89809e,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c68d810-16') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG os_vif [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:53:d7,bridge_name='br-int',has_traffic_filtering=True,id=1c68d810-1609-47df-90c2-d2897b89809e,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c68d810-16') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69f2e253-94f6-5a2c-a4df-03c75595d019', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c68d810-16, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c68d810-16, col_values=(('qos', UUID('033ebd5a-e544-4c34-871f-0b63c194347a')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c68d810-16, col_values=(('external_ids', {'iface-id': '1c68d810-1609-47df-90c2-d2897b89809e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:53:d7', 'vm-uuid': '44be4077-1065-4f5d-b6e1-9f71e4cd8791'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:09:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:09:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:26 user nova-compute[74692]: INFO os_vif [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:53:d7,bridge_name='br-int',has_traffic_filtering=True,id=1c68d810-1609-47df-90c2-d2897b89809e,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c68d810-16')
Nov 18 19:09:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:09:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] No VIF found with MAC fa:16:3e:bd:53:d7, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:09:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-c5f93019-bf31-4dea-8921-311d12b803c0 req-77675b0c-6a61-4055-b3d6-0d53cbafc1e3 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Received event network-vif-plugged-1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:09:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c5f93019-bf31-4dea-8921-311d12b803c0 req-77675b0c-6a61-4055-b3d6-0d53cbafc1e3 service nova] Acquiring lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:09:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c5f93019-bf31-4dea-8921-311d12b803c0 req-77675b0c-6a61-4055-b3d6-0d53cbafc1e3 service nova] Lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:09:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c5f93019-bf31-4dea-8921-311d12b803c0 req-77675b0c-6a61-4055-b3d6-0d53cbafc1e3 service nova] Lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:09:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-c5f93019-bf31-4dea-8921-311d12b803c0 req-77675b0c-6a61-4055-b3d6-0d53cbafc1e3 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] No waiting events found dispatching network-vif-plugged-1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:09:27 user nova-compute[74692]: WARNING nova.compute.manager [req-c5f93019-bf31-4dea-8921-311d12b803c0 req-77675b0c-6a61-4055-b3d6-0d53cbafc1e3 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Received unexpected event network-vif-plugged-1c68d810-1609-47df-90c2-d2897b89809e for instance with vm_state building and task_state spawning.
Nov 18 19:09:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:29 user nova-compute[74692]: DEBUG nova.compute.manager [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 19:09:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 19:09:29 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Instance spawned successfully.
Nov 18 19:09:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 19:09:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-bf0114c0-b7b9-492f-b72d-a0ffcb3f375b req-5c820616-41e1-4319-84c0-55e53f2164d6 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Received event network-vif-plugged-1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:09:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-bf0114c0-b7b9-492f-b72d-a0ffcb3f375b req-5c820616-41e1-4319-84c0-55e53f2164d6 service nova] Acquiring lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:09:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-bf0114c0-b7b9-492f-b72d-a0ffcb3f375b req-5c820616-41e1-4319-84c0-55e53f2164d6 service nova] Lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:09:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-bf0114c0-b7b9-492f-b72d-a0ffcb3f375b req-5c820616-41e1-4319-84c0-55e53f2164d6 service nova] Lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:09:29 user nova-compute[74692]: DEBUG nova.compute.manager [req-bf0114c0-b7b9-492f-b72d-a0ffcb3f375b req-5c820616-41e1-4319-84c0-55e53f2164d6 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] No waiting events found dispatching network-vif-plugged-1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:09:29 user nova-compute[74692]: WARNING nova.compute.manager [req-bf0114c0-b7b9-492f-b72d-a0ffcb3f375b req-5c820616-41e1-4319-84c0-55e53f2164d6 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Received unexpected event network-vif-plugged-1c68d810-1609-47df-90c2-d2897b89809e for instance with vm_state building and task_state spawning.
Nov 18 19:09:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:09:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:09:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:09:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:09:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:09:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:09:29 user nova-compute[74692]: INFO nova.compute.manager [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 18 19:09:29 user nova-compute[74692]: DEBUG nova.compute.manager [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 19:09:29 user nova-compute[74692]: INFO nova.compute.manager [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Took 11.42 seconds to build instance.
Nov 18 19:09:29 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-8871d36d-a574-45d0-b7ee-7f987c7466ea tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.522s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:09:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:34 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:09:35 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:09:35 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 19:09:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:37 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:09:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:09:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:09:37 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:09:37 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:09:38 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:09:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:09:38 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:09:38 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:09:38 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:09:38 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8766MB free_disk=25.00689697265625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:09:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:09:38 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:09:39 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:09:39 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 44be4077-1065-4f5d-b6e1-9f71e4cd8791 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:09:39 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:09:39 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:09:39 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:09:39 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:09:39 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:09:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:09:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:09:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:45 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:09:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:09:45 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:09:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:09:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 19:09:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:09:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:09:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:09:46 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:09:46 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Updating instance_info_cache with network_info: [{"id": "53061922-339a-4cc1-b231-3b6addc610ef", "address": "fa:16:3e:0c:fc:6b", "network": {"id": "95576350-13b9-42e4-beef-5a1ba86ef01b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1535183423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895325ccd1d94431b30fd7e946891c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53061922-33", "ovs_interfaceid": "53061922-339a-4cc1-b231-3b6addc610ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:09:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:09:46 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:09:47 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:09:47 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:09:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:48 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:09:48 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:09:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:51 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:09:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:53 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:09:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:09:59 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:09:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 19:09:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] There are 0 instances to clean {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 19:10:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:10:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:10:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:10:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:10:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:10:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Acquiring lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:10:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:10:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Acquiring lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:10:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:10:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:10:19 user nova-compute[74692]: INFO nova.compute.manager [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Terminating instance
Nov 18 19:10:19 user nova-compute[74692]: DEBUG nova.compute.manager [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 19:10:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-4f63b858-8087-41ab-acf5-af4222293401 req-36d82dc2-56d3-44b9-9c96-110d0556c69d service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Received event network-vif-unplugged-53061922-339a-4cc1-b231-3b6addc610ef {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:10:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4f63b858-8087-41ab-acf5-af4222293401 req-36d82dc2-56d3-44b9-9c96-110d0556c69d service nova] Acquiring lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:10:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4f63b858-8087-41ab-acf5-af4222293401 req-36d82dc2-56d3-44b9-9c96-110d0556c69d service nova] Lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:10:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-4f63b858-8087-41ab-acf5-af4222293401 req-36d82dc2-56d3-44b9-9c96-110d0556c69d service nova] Lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:10:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-4f63b858-8087-41ab-acf5-af4222293401 req-36d82dc2-56d3-44b9-9c96-110d0556c69d service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] No waiting events found dispatching network-vif-unplugged-53061922-339a-4cc1-b231-3b6addc610ef {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:10:19 user nova-compute[74692]: DEBUG nova.compute.manager [req-4f63b858-8087-41ab-acf5-af4222293401 req-36d82dc2-56d3-44b9-9c96-110d0556c69d service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Received event network-vif-unplugged-53061922-339a-4cc1-b231-3b6addc610ef for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Instance destroyed successfully.
Nov 18 19:10:20 user nova-compute[74692]: DEBUG nova.objects.instance [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lazy-loading 'resources' on Instance uuid 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1602231573',display_name='tempest-VolumesActionsTest-instance-1602231573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1602231573',id=50,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T19:08:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='895325ccd1d94431b30fd7e946891c35',ramdisk_id='',reservation_id='r-5al9oo6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-486468935',owner_user_name='tempest-VolumesActionsTest-486468935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T19:08:29Z,user_data=None,user_id='481eb0e796bd4acf8ab79a29d5d7b01d',uuid=85aa6b8c-0823-4393-ab64-a68b8e0ef2bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53061922-339a-4cc1-b231-3b6addc610ef", "address": "fa:16:3e:0c:fc:6b", "network": {"id": "95576350-13b9-42e4-beef-5a1ba86ef01b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1535183423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895325ccd1d94431b30fd7e946891c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53061922-33", "ovs_interfaceid": "53061922-339a-4cc1-b231-3b6addc610ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Converting VIF {"id": "53061922-339a-4cc1-b231-3b6addc610ef", "address": "fa:16:3e:0c:fc:6b", "network": {"id": "95576350-13b9-42e4-beef-5a1ba86ef01b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1535183423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895325ccd1d94431b30fd7e946891c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53061922-33", "ovs_interfaceid": "53061922-339a-4cc1-b231-3b6addc610ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:fc:6b,bridge_name='br-int',has_traffic_filtering=True,id=53061922-339a-4cc1-b231-3b6addc610ef,network=Network(95576350-13b9-42e4-beef-5a1ba86ef01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53061922-33') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG os_vif [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:fc:6b,bridge_name='br-int',has_traffic_filtering=True,id=53061922-339a-4cc1-b231-3b6addc610ef,network=Network(95576350-13b9-42e4-beef-5a1ba86ef01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53061922-33') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53061922-33, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74f49ce6-3b78-426e-8dc0-3f4d28a67c13) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:20 user nova-compute[74692]: INFO os_vif [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:fc:6b,bridge_name='br-int',has_traffic_filtering=True,id=53061922-339a-4cc1-b231-3b6addc610ef,network=Network(95576350-13b9-42e4-beef-5a1ba86ef01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53061922-33')
Nov 18 19:10:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Deleting instance files /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf_del
Nov 18 19:10:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Deletion of /opt/stack/data/nova/instances/85aa6b8c-0823-4393-ab64-a68b8e0ef2bf_del complete
Nov 18 19:10:20 user nova-compute[74692]: INFO nova.compute.manager [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 18 19:10:20 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:10:20 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Took 0.48 seconds to deallocate network for instance.
Nov 18 19:10:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-93356608-325b-4416-a4b7-0cf9eb017da1 req-55ee3bcb-57c9-4bfd-902e-55a415691a7c service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Received event network-vif-deleted-53061922-339a-4cc1-b231-3b6addc610ef {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:10:20 user nova-compute[74692]: INFO nova.compute.manager [req-93356608-325b-4416-a4b7-0cf9eb017da1 req-55ee3bcb-57c9-4bfd-902e-55a415691a7c service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Neutron deleted interface 53061922-339a-4cc1-b231-3b6addc610ef; detaching it from the instance and deleting it from the info cache
Nov 18 19:10:20 user nova-compute[74692]: DEBUG nova.network.neutron [req-93356608-325b-4416-a4b7-0cf9eb017da1 req-55ee3bcb-57c9-4bfd-902e-55a415691a7c service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG nova.compute.manager [req-93356608-325b-4416-a4b7-0cf9eb017da1 req-55ee3bcb-57c9-4bfd-902e-55a415691a7c service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Detach interface failed, port_id=53061922-339a-4cc1-b231-3b6addc610ef, reason: Instance 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf could not be found. {{(pid=74692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:10:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:10:21 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:10:21 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:10:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:10:21 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Deleted allocations for instance 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf
Nov 18 19:10:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a7914b07-ae4e-41b4-8fbe-6200a90d140a tempest-VolumesActionsTest-486468935 tempest-VolumesActionsTest-486468935-project-member] Lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.649s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:10:21 user nova-compute[74692]: DEBUG nova.compute.manager [req-c8fa150e-5ff6-4283-a761-d2eed476c3ac req-71bcfd40-dd6b-499c-8888-47a2983c816a service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Received event network-vif-plugged-53061922-339a-4cc1-b231-3b6addc610ef {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:10:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c8fa150e-5ff6-4283-a761-d2eed476c3ac req-71bcfd40-dd6b-499c-8888-47a2983c816a service nova] Acquiring lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:10:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c8fa150e-5ff6-4283-a761-d2eed476c3ac req-71bcfd40-dd6b-499c-8888-47a2983c816a service nova] Lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:10:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-c8fa150e-5ff6-4283-a761-d2eed476c3ac req-71bcfd40-dd6b-499c-8888-47a2983c816a service nova] Lock "85aa6b8c-0823-4393-ab64-a68b8e0ef2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:10:21 user nova-compute[74692]: DEBUG nova.compute.manager [req-c8fa150e-5ff6-4283-a761-d2eed476c3ac req-71bcfd40-dd6b-499c-8888-47a2983c816a service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] No waiting events found dispatching network-vif-plugged-53061922-339a-4cc1-b231-3b6addc610ef {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:10:21 user nova-compute[74692]: WARNING nova.compute.manager [req-c8fa150e-5ff6-4283-a761-d2eed476c3ac req-71bcfd40-dd6b-499c-8888-47a2983c816a service nova] [instance: 85aa6b8c-0823-4393-ab64-a68b8e0ef2bf] Received unexpected event network-vif-plugged-53061922-339a-4cc1-b231-3b6addc610ef for instance with vm_state deleted and task_state None.
Nov 18 19:10:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:10:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:10:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:10:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8934MB free_disk=25.033798217773438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 44be4077-1065-4f5d-b6e1-9f71e4cd8791 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing inventories for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating ProviderTree inventory for provider 582be55c-ee9f-496e-b354-5900b8401d2c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating inventory in ProviderTree for provider 582be55c-ee9f-496e-b354-5900b8401d2c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing aggregate associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, aggregates: None {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing trait associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:10:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:10:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:45 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:10:45 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:10:45 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:10:47 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:10:47 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:10:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:10:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:10:48 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:10:48 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Updating instance_info_cache with network_info: [{"id": "1c68d810-1609-47df-90c2-d2897b89809e", "address": "fa:16:3e:bd:53:d7", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c68d810-16", "ovs_interfaceid": "1c68d810-1609-47df-90c2-d2897b89809e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:10:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:10:48 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:10:48 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:10:48 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:10:49 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:10:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:10:50 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:10:53 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:10:53 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:10:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:11:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:11:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:11:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:11:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:11:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-fc7018d4-986d-4bbe-8fd2-acd34f501936 req-dcb4af3e-b660-4632-80af-0ee2261cdcd1 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Received event network-changed-1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:11:09 user nova-compute[74692]: DEBUG nova.compute.manager [req-fc7018d4-986d-4bbe-8fd2-acd34f501936 req-dcb4af3e-b660-4632-80af-0ee2261cdcd1 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Refreshing instance network info cache due to event network-changed-1c68d810-1609-47df-90c2-d2897b89809e. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:11:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fc7018d4-986d-4bbe-8fd2-acd34f501936 req-dcb4af3e-b660-4632-80af-0ee2261cdcd1 service nova] Acquiring lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:11:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fc7018d4-986d-4bbe-8fd2-acd34f501936 req-dcb4af3e-b660-4632-80af-0ee2261cdcd1 service nova] Acquired lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:11:09 user nova-compute[74692]: DEBUG nova.network.neutron [req-fc7018d4-986d-4bbe-8fd2-acd34f501936 req-dcb4af3e-b660-4632-80af-0ee2261cdcd1 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Refreshing network info cache for port 1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:11:10 user nova-compute[74692]: DEBUG nova.network.neutron [req-fc7018d4-986d-4bbe-8fd2-acd34f501936 req-dcb4af3e-b660-4632-80af-0ee2261cdcd1 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Updated VIF entry in instance network info cache for port 1c68d810-1609-47df-90c2-d2897b89809e. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:11:10 user nova-compute[74692]: DEBUG nova.network.neutron [req-fc7018d4-986d-4bbe-8fd2-acd34f501936 req-dcb4af3e-b660-4632-80af-0ee2261cdcd1 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Updating instance_info_cache with network_info: [{"id": "1c68d810-1609-47df-90c2-d2897b89809e", "address": "fa:16:3e:bd:53:d7", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c68d810-16", "ovs_interfaceid": "1c68d810-1609-47df-90c2-d2897b89809e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:11:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-fc7018d4-986d-4bbe-8fd2-acd34f501936 req-dcb4af3e-b660-4632-80af-0ee2261cdcd1 service nova] Releasing lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:11:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 19:11:16 user nova-compute[74692]: INFO nova.compute.claims [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Claim successful on node user
Nov 18 19:11:16 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.201s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 19:11:16 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 19:11:16 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 19:11:16 user nova-compute[74692]: INFO nova.virt.block_device [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Booting with volume 77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb at /dev/vda
Nov 18 19:11:16 user nova-compute[74692]: DEBUG nova.policy [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f58b7c308c3b4fa7bb4f576048ef7619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a60e439a714bdd8fca1ec43e2a3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG os_brick.utils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[43750ca7-1a92-4e30-be6b-0ed8528f3f93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c20a75-68ce-4f52-be11-f4fef55970d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6ceffc-4ac1-49ca-882a-9f2d99a13f61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[33516f3a-78a2-453e-8dea-0b197d3831ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:11:16 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 19:11:16 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed12d4d-abc9-4c14-9be9-f0ce3854dce1]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG os_brick.utils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:11:16 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Updating existing volume attachment record: 1d75c3c8-fec0-428b-8412-0b2ab0067f40 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 19:11:17 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Successfully created port: 1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 19:11:18 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Successfully updated port: 1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 19:11:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "refresh_cache-d3460a6b-c845-40e2-9b1e-47aa8ea853ba" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:11:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquired lock "refresh_cache-d3460a6b-c845-40e2-9b1e-47aa8ea853ba" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:11:18 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 19:11:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-56af6124-9109-460c-bb33-06c9a0896bcc req-8a00cfa2-b597-491e-825b-46dbb695d00a service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Received event network-changed-1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:11:18 user nova-compute[74692]: DEBUG nova.compute.manager [req-56af6124-9109-460c-bb33-06c9a0896bcc req-8a00cfa2-b597-491e-825b-46dbb695d00a service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Refreshing instance network info cache due to event network-changed-1eb699ae-9396-40f2-b1bd-baf807686e76. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:11:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-56af6124-9109-460c-bb33-06c9a0896bcc req-8a00cfa2-b597-491e-825b-46dbb695d00a service nova] Acquiring lock "refresh_cache-d3460a6b-c845-40e2-9b1e-47aa8ea853ba" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:11:18 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 19:11:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:18 user nova-compute[74692]: DEBUG nova.network.neutron [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Updating instance_info_cache with network_info: [{"id": "1eb699ae-9396-40f2-b1bd-baf807686e76", "address": "fa:16:3e:5f:70:08", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb699ae-93", "ovs_interfaceid": "1eb699ae-9396-40f2-b1bd-baf807686e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:11:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Releasing lock "refresh_cache-d3460a6b-c845-40e2-9b1e-47aa8ea853ba" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:11:18 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Instance network_info: |[{"id": "1eb699ae-9396-40f2-b1bd-baf807686e76", "address": "fa:16:3e:5f:70:08", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb699ae-93", "ovs_interfaceid": "1eb699ae-9396-40f2-b1bd-baf807686e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 19:11:18 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-56af6124-9109-460c-bb33-06c9a0896bcc req-8a00cfa2-b597-491e-825b-46dbb695d00a service nova] Acquired lock "refresh_cache-d3460a6b-c845-40e2-9b1e-47aa8ea853ba" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:11:18 user nova-compute[74692]: DEBUG nova.network.neutron [req-56af6124-9109-460c-bb33-06c9a0896bcc req-8a00cfa2-b597-491e-825b-46dbb695d00a service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Refreshing network info cache for port 1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:11:19 user nova-compute[74692]: DEBUG nova.network.neutron [req-56af6124-9109-460c-bb33-06c9a0896bcc req-8a00cfa2-b597-491e-825b-46dbb695d00a service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Updated VIF entry in instance network info cache for port 1eb699ae-9396-40f2-b1bd-baf807686e76. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:11:19 user nova-compute[74692]: DEBUG nova.network.neutron [req-56af6124-9109-460c-bb33-06c9a0896bcc req-8a00cfa2-b597-491e-825b-46dbb695d00a service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Updating instance_info_cache with network_info: [{"id": "1eb699ae-9396-40f2-b1bd-baf807686e76", "address": "fa:16:3e:5f:70:08", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb699ae-93", "ovs_interfaceid": "1eb699ae-9396-40f2-b1bd-baf807686e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:11:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-56af6124-9109-460c-bb33-06c9a0896bcc req-8a00cfa2-b597-491e-825b-46dbb695d00a service nova] Releasing lock "refresh_cache-d3460a6b-c845-40e2-9b1e-47aa8ea853ba" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:11:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 19:11:22 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Creating image(s)
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Did not create local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Ensure instance console log exists: /opt/stack/data/nova/instances/d3460a6b-c845-40e2-9b1e-47aa8ea853ba/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Start _get_guest_xml network_info=[{"id": "1eb699ae-9396-40f2-b1bd-baf807686e76", "address": "fa:16:3e:5f:70:08", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb699ae-93", "ovs_interfaceid": "1eb699ae-9396-40f2-b1bd-baf807686e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmkuRVap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3460a6b-c845-40e2-9b1e-47aa8ea853ba', 'attached_at': '', 'detached_at': '', 'volume_id': '77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb', 'serial': '77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb'}, 'attachment_id': '1d75c3c8-fec0-428b-8412-0b2ab0067f40', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 19:11:22 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:11:22 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmkuRVap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:11:22 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:11:22 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:11:22 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c416b26-6992-4ec8-b30e-b8fd6405d04b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 19:11:22 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e4464e-67c7-4171-9881-fff3f0632dfd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb] added
Nov 18 19:11:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b9d576-1b6e-436d-8270-f1d00bd8eca7]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b171c5a2-6a35-4dd4-8201-849628d817a6]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UmkuRVap {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UmkuRVap" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7565f8a4-78db-4016-be4e-6c8f9db111d4]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UmkuRVap'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa55cad-da22-49ca-8be1-0e6bcd5097aa]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[344898cc-9a19-463a-bd49-ebddc887b7db]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)
Nov 18 19:11:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)
Nov 18 19:11:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a86b2e7-051c-4393-b0a5-fdc359b5b92a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb, portal: 172.16.0.220,3260]
Nov 18 19:11:22 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb, portal: 172.16.0.220,3260] successful.
Nov 18 19:11:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3226178e-2686-4391-b9e6-64d841918967]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[73927069-370b-40ca-ae4b-af13f79aea1e]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)
Nov 18 19:11:22 user nova-compute[74692]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb (non-flash)
Nov 18 19:11:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)
Nov 18 19:11:22 user nova-compute[74692]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb (non-flash)
Nov 18 19:11:22 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac10121c-8d9c-4ec3-a330-811231aaf4fc]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:11:22 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmkuRVap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26538313265373164', 'path': '/dev/sdc'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538313265373164', 'path': '/dev/sdc'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1936584394',display_name='tempest-TestVolumeBootPattern-server-1936584394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1936584394',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjQDIRpH38DKVgoyK1MoFv+m8f/mGJrL0ooZsg2wAfnTUJxFQk1uOmbgPDnD8Mh28/YfKlfkB/iskJj/3HNMpIea9BHIe4sWpufsnQvUXD1nCH47a4Mgeniq2skzVKHOQ==',key_name='tempest-TestVolumeBootPattern-917877268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-u8zi98a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:11:17Z,user_data=None,user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=d3460a6b-c845-40e2-9b1e-47aa8ea853ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1eb699ae-9396-40f2-b1bd-baf807686e76", "address": "fa:16:3e:5f:70:08", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb699ae-93", "ovs_interfaceid": "1eb699ae-9396-40f2-b1bd-baf807686e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "1eb699ae-9396-40f2-b1bd-baf807686e76", "address": "fa:16:3e:5f:70:08", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb699ae-93", "ovs_interfaceid": "1eb699ae-9396-40f2-b1bd-baf807686e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:70:08,bridge_name='br-int',has_traffic_filtering=True,id=1eb699ae-9396-40f2-b1bd-baf807686e76,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb699ae-93') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lazy-loading 'pci_devices' on Instance uuid d3460a6b-c845-40e2-9b1e-47aa8ea853ba {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] End _get_guest_xml xml=<domain type="kvm">
Nov 18 19:11:23 user nova-compute[74692]:   <uuid>d3460a6b-c845-40e2-9b1e-47aa8ea853ba</uuid>
Nov 18 19:11:23 user nova-compute[74692]:   <name>instance-00000034</name>
Nov 18 19:11:23 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 19:11:23 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 19:11:23 user nova-compute[74692]:   <metadata>
Nov 18 19:11:23 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 19:11:23 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 19:11:23 user nova-compute[74692]:       <nova:name>tempest-TestVolumeBootPattern-server-1936584394</nova:name>
Nov 18 19:11:23 user nova-compute[74692]:       <nova:creationTime>2023-11-18 19:11:22</nova:creationTime>
Nov 18 19:11:23 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 19:11:23 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 19:11:23 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 19:11:23 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 19:11:23 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 19:11:23 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 19:11:23 user nova-compute[74692]:       </nova:flavor>
Nov 18 19:11:23 user nova-compute[74692]:       <nova:owner>
Nov 18 19:11:23 user nova-compute[74692]:         <nova:user uuid="f58b7c308c3b4fa7bb4f576048ef7619">tempest-TestVolumeBootPattern-1940625728-project-member</nova:user>
Nov 18 19:11:23 user nova-compute[74692]:         <nova:project uuid="d3a60e439a714bdd8fca1ec43e2a3139">tempest-TestVolumeBootPattern-1940625728</nova:project>
Nov 18 19:11:23 user nova-compute[74692]:       </nova:owner>
Nov 18 19:11:23 user nova-compute[74692]:       <nova:ports>
Nov 18 19:11:23 user nova-compute[74692]:         <nova:port uuid="1eb699ae-9396-40f2-b1bd-baf807686e76">
Nov 18 19:11:23 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 19:11:23 user nova-compute[74692]:         </nova:port>
Nov 18 19:11:23 user nova-compute[74692]:       </nova:ports>
Nov 18 19:11:23 user nova-compute[74692]:     </nova:instance>
Nov 18 19:11:23 user nova-compute[74692]:   </metadata>
Nov 18 19:11:23 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 19:11:23 user nova-compute[74692]:     <system>
Nov 18 19:11:23 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 19:11:23 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 19:11:23 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 19:11:23 user nova-compute[74692]:       <entry name="serial">d3460a6b-c845-40e2-9b1e-47aa8ea853ba</entry>
Nov 18 19:11:23 user nova-compute[74692]:       <entry name="uuid">d3460a6b-c845-40e2-9b1e-47aa8ea853ba</entry>
Nov 18 19:11:23 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 19:11:23 user nova-compute[74692]:     </system>
Nov 18 19:11:23 user nova-compute[74692]:   </sysinfo>
Nov 18 19:11:23 user nova-compute[74692]:   <os>
Nov 18 19:11:23 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 19:11:23 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 19:11:23 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 19:11:23 user nova-compute[74692]:   </os>
Nov 18 19:11:23 user nova-compute[74692]:   <features>
Nov 18 19:11:23 user nova-compute[74692]:     <acpi/>
Nov 18 19:11:23 user nova-compute[74692]:     <apic/>
Nov 18 19:11:23 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 19:11:23 user nova-compute[74692]:   </features>
Nov 18 19:11:23 user nova-compute[74692]:   <clock offset="utc">
Nov 18 19:11:23 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 19:11:23 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 19:11:23 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 19:11:23 user nova-compute[74692]:   </clock>
Nov 18 19:11:23 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 19:11:23 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 19:11:23 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 19:11:23 user nova-compute[74692]:   </cpu>
Nov 18 19:11:23 user nova-compute[74692]:   <devices>
Nov 18 19:11:23 user nova-compute[74692]:     <disk type="block" device="disk">
Nov 18 19:11:23 user nova-compute[74692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:11:23 user nova-compute[74692]:       <source dev="/dev/sdc"/>
Nov 18 19:11:23 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 19:11:23 user nova-compute[74692]:       <serial>77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb</serial>
Nov 18 19:11:23 user nova-compute[74692]:     </disk>
Nov 18 19:11:23 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 19:11:23 user nova-compute[74692]:       <mac address="fa:16:3e:5f:70:08"/>
Nov 18 19:11:23 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:11:23 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 19:11:23 user nova-compute[74692]:       <target dev="tap1eb699ae-93"/>
Nov 18 19:11:23 user nova-compute[74692]:     </interface>
Nov 18 19:11:23 user nova-compute[74692]:     <serial type="pty">
Nov 18 19:11:23 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/d3460a6b-c845-40e2-9b1e-47aa8ea853ba/console.log" append="off"/>
Nov 18 19:11:23 user nova-compute[74692]:     </serial>
Nov 18 19:11:23 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 19:11:23 user nova-compute[74692]:     <video>
Nov 18 19:11:23 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:11:23 user nova-compute[74692]:     </video>
Nov 18 19:11:23 user nova-compute[74692]:     <rng model="virtio">
Nov 18 19:11:23 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 19:11:23 user nova-compute[74692]:     </rng>
Nov 18 19:11:23 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 19:11:23 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 19:11:23 user nova-compute[74692]:       <stats period="10"/>
Nov 18 19:11:23 user nova-compute[74692]:     </memballoon>
Nov 18 19:11:23 user nova-compute[74692]:   </devices>
Nov 18 19:11:23 user nova-compute[74692]: </domain>
Nov 18 19:11:23 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1936584394',display_name='tempest-TestVolumeBootPattern-server-1936584394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1936584394',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjQDIRpH38DKVgoyK1MoFv+m8f/mGJrL0ooZsg2wAfnTUJxFQk1uOmbgPDnD8Mh28/YfKlfkB/iskJj/3HNMpIea9BHIe4sWpufsnQvUXD1nCH47a4Mgeniq2skzVKHOQ==',key_name='tempest-TestVolumeBootPattern-917877268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-u8zi98a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:11:17Z,user_data=None,user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=d3460a6b-c845-40e2-9b1e-47aa8ea853ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1eb699ae-9396-40f2-b1bd-baf807686e76", "address": "fa:16:3e:5f:70:08", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb699ae-93", "ovs_interfaceid": "1eb699ae-9396-40f2-b1bd-baf807686e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "1eb699ae-9396-40f2-b1bd-baf807686e76", "address": "fa:16:3e:5f:70:08", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb699ae-93", "ovs_interfaceid": "1eb699ae-9396-40f2-b1bd-baf807686e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:70:08,bridge_name='br-int',has_traffic_filtering=True,id=1eb699ae-9396-40f2-b1bd-baf807686e76,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb699ae-93') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG os_vif [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:70:08,bridge_name='br-int',has_traffic_filtering=True,id=1eb699ae-9396-40f2-b1bd-baf807686e76,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb699ae-93') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49a9e243-792b-5716-8426-ca282b7bba7e', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1eb699ae-93, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1eb699ae-93, col_values=(('qos', UUID('52d29a90-89d3-466e-aa94-8e4951a4129b')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1eb699ae-93, col_values=(('external_ids', {'iface-id': '1eb699ae-9396-40f2-b1bd-baf807686e76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:70:08', 'vm-uuid': 'd3460a6b-c845-40e2-9b1e-47aa8ea853ba'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:23 user nova-compute[74692]: INFO os_vif [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:70:08,bridge_name='br-int',has_traffic_filtering=True,id=1eb699ae-9396-40f2-b1bd-baf807686e76,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb699ae-93')
Nov 18 19:11:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:11:23 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] No VIF found with MAC fa:16:3e:5f:70:08, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:11:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-5323b5fb-3650-4f08-bfed-5ec917f067a4 req-681acf3e-26b1-47db-b6a9-34a37d9a9dc1 service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Received event network-vif-plugged-1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:11:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5323b5fb-3650-4f08-bfed-5ec917f067a4 req-681acf3e-26b1-47db-b6a9-34a37d9a9dc1 service nova] Acquiring lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:11:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5323b5fb-3650-4f08-bfed-5ec917f067a4 req-681acf3e-26b1-47db-b6a9-34a37d9a9dc1 service nova] Lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:11:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-5323b5fb-3650-4f08-bfed-5ec917f067a4 req-681acf3e-26b1-47db-b6a9-34a37d9a9dc1 service nova] Lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:11:25 user nova-compute[74692]: DEBUG nova.compute.manager [req-5323b5fb-3650-4f08-bfed-5ec917f067a4 req-681acf3e-26b1-47db-b6a9-34a37d9a9dc1 service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] No waiting events found dispatching network-vif-plugged-1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:11:25 user nova-compute[74692]: WARNING nova.compute.manager [req-5323b5fb-3650-4f08-bfed-5ec917f067a4 req-681acf3e-26b1-47db-b6a9-34a37d9a9dc1 service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Received unexpected event network-vif-plugged-1eb699ae-9396-40f2-b1bd-baf807686e76 for instance with vm_state building and task_state spawning.
Nov 18 19:11:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:27 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 19:11:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 19:11:27 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Instance spawned successfully.
Nov 18 19:11:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 19:11:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:11:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:11:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:11:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:11:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:11:27 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:11:27 user nova-compute[74692]: INFO nova.compute.manager [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 18 19:11:27 user nova-compute[74692]: DEBUG nova.compute.manager [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 19:11:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-e4dfe3dc-fb11-48c2-a768-28ffb4482f77 req-b70cc613-cead-4fae-9ab8-21751414d9db service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Received event network-vif-plugged-1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:11:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e4dfe3dc-fb11-48c2-a768-28ffb4482f77 req-b70cc613-cead-4fae-9ab8-21751414d9db service nova] Acquiring lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:11:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e4dfe3dc-fb11-48c2-a768-28ffb4482f77 req-b70cc613-cead-4fae-9ab8-21751414d9db service nova] Lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:11:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-e4dfe3dc-fb11-48c2-a768-28ffb4482f77 req-b70cc613-cead-4fae-9ab8-21751414d9db service nova] Lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:11:27 user nova-compute[74692]: DEBUG nova.compute.manager [req-e4dfe3dc-fb11-48c2-a768-28ffb4482f77 req-b70cc613-cead-4fae-9ab8-21751414d9db service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] No waiting events found dispatching network-vif-plugged-1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:11:27 user nova-compute[74692]: WARNING nova.compute.manager [req-e4dfe3dc-fb11-48c2-a768-28ffb4482f77 req-b70cc613-cead-4fae-9ab8-21751414d9db service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Received unexpected event network-vif-plugged-1eb699ae-9396-40f2-b1bd-baf807686e76 for instance with vm_state building and task_state spawning.
Nov 18 19:11:27 user nova-compute[74692]: INFO nova.compute.manager [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Took 11.46 seconds to build instance.
Nov 18 19:11:27 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c18ce861-233e-41a4-88d7-560ba0f2d614 tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.565s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:11:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:11:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:11:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:11:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:11:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:11:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:11:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:11:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:11:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:11:39 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:11:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:11:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:11:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:11:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:11:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8780MB free_disk=25.02326202392578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:11:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:11:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:11:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 44be4077-1065-4f5d-b6e1-9f71e4cd8791 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:11:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d3460a6b-c845-40e2-9b1e-47aa8ea853ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:11:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:11:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:11:40 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:11:40 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:11:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:11:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:11:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:47 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:11:47 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:11:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:49 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:11:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:11:49 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 19:11:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:11:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:11:50 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:11:50 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid 44be4077-1065-4f5d-b6e1-9f71e4cd8791 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:11:50 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Updating instance_info_cache with network_info: [{"id": "1c68d810-1609-47df-90c2-d2897b89809e", "address": "fa:16:3e:bd:53:d7", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c68d810-16", "ovs_interfaceid": "1c68d810-1609-47df-90c2-d2897b89809e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:11:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:11:50 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:11:50 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:11:50 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:11:51 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:11:51 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:11:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:54 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:11:54 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:11:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:11:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:12:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:12:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:12:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:12:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:12:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:12:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:12:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:12:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:12:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:12:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:12:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:12:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:12:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:12:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:12:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:12:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:12:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:12:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:12:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:12:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:12:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:12:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:12:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:12:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:12:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:12:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:12:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:12:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:12:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:12:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:12:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:12:39 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:12:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:12:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:12:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:12:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:12:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8902MB free_disk=25.02065658569336GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:12:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:12:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:12:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 44be4077-1065-4f5d-b6e1-9f71e4cd8791 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:12:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance d3460a6b-c845-40e2-9b1e-47aa8ea853ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:12:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:12:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:12:40 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:12:40 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:12:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:12:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:12:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:12:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:12:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:12:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:12:47 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:12:47 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:12:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:12:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:12:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:12:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:12:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:12:49 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:12:51 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:12:51 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:12:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-d3460a6b-c845-40e2-9b1e-47aa8ea853ba" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:12:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-d3460a6b-c845-40e2-9b1e-47aa8ea853ba" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:12:52 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:12:52 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Updating instance_info_cache with network_info: [{"id": "1eb699ae-9396-40f2-b1bd-baf807686e76", "address": "fa:16:3e:5f:70:08", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb699ae-93", "ovs_interfaceid": "1eb699ae-9396-40f2-b1bd-baf807686e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:12:52 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-d3460a6b-c845-40e2-9b1e-47aa8ea853ba" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:12:52 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:12:52 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:12:52 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:12:52 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:12:52 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:12:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:12:55 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:12:56 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:12:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:13:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:13:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:13:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:13:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:13:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:07 user nova-compute[74692]: DEBUG nova.compute.manager [req-95cd62c6-d505-4f39-b96c-b3a20c3f9c56 req-0769f647-73d9-420d-8643-520ab9af7a66 service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Received event network-changed-1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:13:07 user nova-compute[74692]: DEBUG nova.compute.manager [req-95cd62c6-d505-4f39-b96c-b3a20c3f9c56 req-0769f647-73d9-420d-8643-520ab9af7a66 service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Refreshing instance network info cache due to event network-changed-1eb699ae-9396-40f2-b1bd-baf807686e76. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:13:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-95cd62c6-d505-4f39-b96c-b3a20c3f9c56 req-0769f647-73d9-420d-8643-520ab9af7a66 service nova] Acquiring lock "refresh_cache-d3460a6b-c845-40e2-9b1e-47aa8ea853ba" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:13:07 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-95cd62c6-d505-4f39-b96c-b3a20c3f9c56 req-0769f647-73d9-420d-8643-520ab9af7a66 service nova] Acquired lock "refresh_cache-d3460a6b-c845-40e2-9b1e-47aa8ea853ba" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:13:07 user nova-compute[74692]: DEBUG nova.network.neutron [req-95cd62c6-d505-4f39-b96c-b3a20c3f9c56 req-0769f647-73d9-420d-8643-520ab9af7a66 service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Refreshing network info cache for port 1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:13:08 user nova-compute[74692]: DEBUG nova.network.neutron [req-95cd62c6-d505-4f39-b96c-b3a20c3f9c56 req-0769f647-73d9-420d-8643-520ab9af7a66 service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Updated VIF entry in instance network info cache for port 1eb699ae-9396-40f2-b1bd-baf807686e76. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:13:08 user nova-compute[74692]: DEBUG nova.network.neutron [req-95cd62c6-d505-4f39-b96c-b3a20c3f9c56 req-0769f647-73d9-420d-8643-520ab9af7a66 service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Updating instance_info_cache with network_info: [{"id": "1eb699ae-9396-40f2-b1bd-baf807686e76", "address": "fa:16:3e:5f:70:08", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb699ae-93", "ovs_interfaceid": "1eb699ae-9396-40f2-b1bd-baf807686e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:13:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-95cd62c6-d505-4f39-b96c-b3a20c3f9c56 req-0769f647-73d9-420d-8643-520ab9af7a66 service nova] Releasing lock "refresh_cache-d3460a6b-c845-40e2-9b1e-47aa8ea853ba" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:13:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:08 user nova-compute[74692]: DEBUG nova.compute.manager [req-380c8dbf-7ed3-4acb-8fd7-b3c599266024 req-826d0267-273d-4ca0-9ea1-6b0f6e3b8f36 service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Received event network-changed-1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:13:08 user nova-compute[74692]: DEBUG nova.compute.manager [req-380c8dbf-7ed3-4acb-8fd7-b3c599266024 req-826d0267-273d-4ca0-9ea1-6b0f6e3b8f36 service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Refreshing instance network info cache due to event network-changed-1eb699ae-9396-40f2-b1bd-baf807686e76. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:13:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-380c8dbf-7ed3-4acb-8fd7-b3c599266024 req-826d0267-273d-4ca0-9ea1-6b0f6e3b8f36 service nova] Acquiring lock "refresh_cache-d3460a6b-c845-40e2-9b1e-47aa8ea853ba" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:13:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-380c8dbf-7ed3-4acb-8fd7-b3c599266024 req-826d0267-273d-4ca0-9ea1-6b0f6e3b8f36 service nova] Acquired lock "refresh_cache-d3460a6b-c845-40e2-9b1e-47aa8ea853ba" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:13:08 user nova-compute[74692]: DEBUG nova.network.neutron [req-380c8dbf-7ed3-4acb-8fd7-b3c599266024 req-826d0267-273d-4ca0-9ea1-6b0f6e3b8f36 service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Refreshing network info cache for port 1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:13:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:13:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:13:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:13:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:13:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:13:08 user nova-compute[74692]: INFO nova.compute.manager [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Terminating instance
Nov 18 19:13:08 user nova-compute[74692]: DEBUG nova.compute.manager [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG nova.network.neutron [req-380c8dbf-7ed3-4acb-8fd7-b3c599266024 req-826d0267-273d-4ca0-9ea1-6b0f6e3b8f36 service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Updated VIF entry in instance network info cache for port 1eb699ae-9396-40f2-b1bd-baf807686e76. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG nova.network.neutron [req-380c8dbf-7ed3-4acb-8fd7-b3c599266024 req-826d0267-273d-4ca0-9ea1-6b0f6e3b8f36 service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Updating instance_info_cache with network_info: [{"id": "1eb699ae-9396-40f2-b1bd-baf807686e76", "address": "fa:16:3e:5f:70:08", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb699ae-93", "ovs_interfaceid": "1eb699ae-9396-40f2-b1bd-baf807686e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-380c8dbf-7ed3-4acb-8fd7-b3c599266024 req-826d0267-273d-4ca0-9ea1-6b0f6e3b8f36 service nova] Releasing lock "refresh_cache-d3460a6b-c845-40e2-9b1e-47aa8ea853ba" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:13:09 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Instance destroyed successfully.
Nov 18 19:13:09 user nova-compute[74692]: DEBUG nova.objects.instance [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lazy-loading 'resources' on Instance uuid d3460a6b-c845-40e2-9b1e-47aa8ea853ba {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1936584394',display_name='tempest-TestVolumeBootPattern-server-1936584394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1936584394',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjQDIRpH38DKVgoyK1MoFv+m8f/mGJrL0ooZsg2wAfnTUJxFQk1uOmbgPDnD8Mh28/YfKlfkB/iskJj/3HNMpIea9BHIe4sWpufsnQvUXD1nCH47a4Mgeniq2skzVKHOQ==',key_name='tempest-TestVolumeBootPattern-917877268',keypairs=<?>,launch_index=0,launched_at=2023-11-18T19:11:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-u8zi98a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T19:11:28Z,user_data=None,user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=d3460a6b-c845-40e2-9b1e-47aa8ea853ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1eb699ae-9396-40f2-b1bd-baf807686e76", "address": "fa:16:3e:5f:70:08", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb699ae-93", "ovs_interfaceid": "1eb699ae-9396-40f2-b1bd-baf807686e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "1eb699ae-9396-40f2-b1bd-baf807686e76", "address": "fa:16:3e:5f:70:08", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb699ae-93", "ovs_interfaceid": "1eb699ae-9396-40f2-b1bd-baf807686e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:70:08,bridge_name='br-int',has_traffic_filtering=True,id=1eb699ae-9396-40f2-b1bd-baf807686e76,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb699ae-93') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG os_vif [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:70:08,bridge_name='br-int',has_traffic_filtering=True,id=1eb699ae-9396-40f2-b1bd-baf807686e76,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb699ae-93') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1eb699ae-93, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52d29a90-89d3-466e-aa94-8e4951a4129b) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:13:09 user nova-compute[74692]: INFO os_vif [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:70:08,bridge_name='br-int',has_traffic_filtering=True,id=1eb699ae-9396-40f2-b1bd-baf807686e76,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb699ae-93')
Nov 18 19:13:09 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmkuRVap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:13:09 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:13:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2031f8e-354a-4960-89ee-2c95cbcf039a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:13:09 user nova-compute[74692]: No targets found.
Nov 18 19:13:09 user nova-compute[74692]: iSNS:
Nov 18 19:13:09 user nova-compute[74692]: No targets found.
Nov 18 19:13:09 user nova-compute[74692]: STATIC:
Nov 18 19:13:09 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb
Nov 18 19:13:09 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:13:09 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:13:09 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a
Nov 18 19:13:09 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:13:09 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:13:09 user nova-compute[74692]: FIRMWARE:
Nov 18 19:13:09 user nova-compute[74692]: No targets found.
Nov 18 19:13:09 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:13:09 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:13:09 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fb4ea4-8966-4605-b4cc-499b43faaa6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf0d5f7-b10d-4dcf-886b-4e10df9f695e]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)
Nov 18 19:13:09 user nova-compute[74692]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb (non-flash)
Nov 18 19:13:09 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)
Nov 18 19:13:09 user nova-compute[74692]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb (non-flash)
Nov 18 19:13:09 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41d5a91990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb'): ({'sdc'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Removing single pathed devices sdc {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5c1460-0639-49e4-abef-f29bdda06079]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed011c0-6fc4-4ad8-8a72-9237e8ca3b9a]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flushing IO for device /dev/sdc {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5487259c-b2fc-4747-aa6a-fe59eebf1d50]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:13:09 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5554d7-ae7f-4543-a28e-bcd0f6125299]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] SCSI volumes sdc have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4384f2-2a82-4c26-87c8-d4908c3236d7]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81b959a-6ead-44f2-9b52-6f0f6cc85f9e]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb, portal: 172.16.0.220,3260]
Nov 18 19:13:10 user nova-compute[74692]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb, portal: 172.16.0.220,3260] successful.
Nov 18 19:13:10 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b1f1c4-61fd-4ada-8090-9d93c3b2e0cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81e040f-1a9f-4fef-bbcc-8a00e0c8e22e]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== disconnect_volume: return (324ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:13:10 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Deleting instance files /opt/stack/data/nova/instances/d3460a6b-c845-40e2-9b1e-47aa8ea853ba_del
Nov 18 19:13:10 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Deletion of /opt/stack/data/nova/instances/d3460a6b-c845-40e2-9b1e-47aa8ea853ba_del complete
Nov 18 19:13:10 user nova-compute[74692]: INFO nova.compute.manager [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:13:10 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Took 0.41 seconds to deallocate network for instance.
Nov 18 19:13:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-192ab740-c497-4bba-bf26-ce33cc107e42 req-e215947c-4c49-4a66-909c-653c3fc4018e service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Received event network-vif-deleted-1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ca797a3-8dcb-4028-b0c1-fbfba5eb877f req-2479d448-9fc6-471f-af7e-dbc2755de76b service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Received event network-vif-unplugged-1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ca797a3-8dcb-4028-b0c1-fbfba5eb877f req-2479d448-9fc6-471f-af7e-dbc2755de76b service nova] Acquiring lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ca797a3-8dcb-4028-b0c1-fbfba5eb877f req-2479d448-9fc6-471f-af7e-dbc2755de76b service nova] Lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ca797a3-8dcb-4028-b0c1-fbfba5eb877f req-2479d448-9fc6-471f-af7e-dbc2755de76b service nova] Lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ca797a3-8dcb-4028-b0c1-fbfba5eb877f req-2479d448-9fc6-471f-af7e-dbc2755de76b service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] No waiting events found dispatching network-vif-unplugged-1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ca797a3-8dcb-4028-b0c1-fbfba5eb877f req-2479d448-9fc6-471f-af7e-dbc2755de76b service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Received event network-vif-unplugged-1eb699ae-9396-40f2-b1bd-baf807686e76 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ca797a3-8dcb-4028-b0c1-fbfba5eb877f req-2479d448-9fc6-471f-af7e-dbc2755de76b service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Received event network-vif-plugged-1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ca797a3-8dcb-4028-b0c1-fbfba5eb877f req-2479d448-9fc6-471f-af7e-dbc2755de76b service nova] Acquiring lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ca797a3-8dcb-4028-b0c1-fbfba5eb877f req-2479d448-9fc6-471f-af7e-dbc2755de76b service nova] Lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7ca797a3-8dcb-4028-b0c1-fbfba5eb877f req-2479d448-9fc6-471f-af7e-dbc2755de76b service nova] Lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:13:10 user nova-compute[74692]: DEBUG nova.compute.manager [req-7ca797a3-8dcb-4028-b0c1-fbfba5eb877f req-2479d448-9fc6-471f-af7e-dbc2755de76b service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] No waiting events found dispatching network-vif-plugged-1eb699ae-9396-40f2-b1bd-baf807686e76 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:13:10 user nova-compute[74692]: WARNING nova.compute.manager [req-7ca797a3-8dcb-4028-b0c1-fbfba5eb877f req-2479d448-9fc6-471f-af7e-dbc2755de76b service nova] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Received unexpected event network-vif-plugged-1eb699ae-9396-40f2-b1bd-baf807686e76 for instance with vm_state active and task_state deleting.
Nov 18 19:13:11 user nova-compute[74692]: INFO nova.compute.manager [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: d3460a6b-c845-40e2-9b1e-47aa8ea853ba] Took 0.76 seconds to detach 1 volumes for instance.
Nov 18 19:13:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:13:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:13:11 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:13:11 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:13:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:13:11 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Deleted allocations for instance d3460a6b-c845-40e2-9b1e-47aa8ea853ba
Nov 18 19:13:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-7d84f87d-0b31-48ed-938d-7fa5f1b9d23f tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "d3460a6b-c845-40e2-9b1e-47aa8ea853ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.761s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:13:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:19 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:29 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:34 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:39 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:13:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:13:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:13:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:13:39 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:13:40 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 19:13:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:13:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:13:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=25.019771575927734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:13:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:13:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:13:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance 44be4077-1065-4f5d-b6e1-9f71e4cd8791 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:13:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:13:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:13:40 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:13:40 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:13:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:13:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:13:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:48 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:13:48 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:13:49 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:52 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:13:52 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:13:53 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:13:53 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:13:53 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 19:13:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:13:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:13:54 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:13:54 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid 44be4077-1065-4f5d-b6e1-9f71e4cd8791 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:13:54 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Updating instance_info_cache with network_info: [{"id": "1c68d810-1609-47df-90c2-d2897b89809e", "address": "fa:16:3e:bd:53:d7", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c68d810-16", "ovs_interfaceid": "1c68d810-1609-47df-90c2-d2897b89809e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:13:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:13:54 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:13:54 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:13:54 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:13:54 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:13:55 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:13:56 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:13:59 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-0886682c-a05c-4393-a4c8-8c2176bc9387 req-9c0e24d5-6fbc-471f-b4b9-5681aabe1a04 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Received event network-changed-1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:14:05 user nova-compute[74692]: DEBUG nova.compute.manager [req-0886682c-a05c-4393-a4c8-8c2176bc9387 req-9c0e24d5-6fbc-471f-b4b9-5681aabe1a04 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Refreshing instance network info cache due to event network-changed-1c68d810-1609-47df-90c2-d2897b89809e. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:14:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0886682c-a05c-4393-a4c8-8c2176bc9387 req-9c0e24d5-6fbc-471f-b4b9-5681aabe1a04 service nova] Acquiring lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:14:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0886682c-a05c-4393-a4c8-8c2176bc9387 req-9c0e24d5-6fbc-471f-b4b9-5681aabe1a04 service nova] Acquired lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:14:05 user nova-compute[74692]: DEBUG nova.network.neutron [req-0886682c-a05c-4393-a4c8-8c2176bc9387 req-9c0e24d5-6fbc-471f-b4b9-5681aabe1a04 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Refreshing network info cache for port 1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:14:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:14:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:14:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:14:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:14:05 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:14:05 user nova-compute[74692]: INFO nova.compute.manager [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Terminating instance
Nov 18 19:14:05 user nova-compute[74692]: DEBUG nova.compute.manager [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 19:14:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:06 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Instance destroyed successfully.
Nov 18 19:14:06 user nova-compute[74692]: DEBUG nova.objects.instance [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lazy-loading 'resources' on Instance uuid 44be4077-1065-4f5d-b6e1-9f71e4cd8791 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1405426127',display_name='tempest-TestVolumeBootPattern-server-1405426127',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1405426127',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjQDIRpH38DKVgoyK1MoFv+m8f/mGJrL0ooZsg2wAfnTUJxFQk1uOmbgPDnD8Mh28/YfKlfkB/iskJj/3HNMpIea9BHIe4sWpufsnQvUXD1nCH47a4Mgeniq2skzVKHOQ==',key_name='tempest-TestVolumeBootPattern-917877268',keypairs=<?>,launch_index=0,launched_at=2023-11-18T19:09:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3a60e439a714bdd8fca1ec43e2a3139',ramdisk_id='',reservation_id='r-f818n9cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1940625728',owner_user_name='tempest-TestVolumeBootPattern-1940625728-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T19:09:30Z,user_data=None,user_id='f58b7c308c3b4fa7bb4f576048ef7619',uuid=44be4077-1065-4f5d-b6e1-9f71e4cd8791,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c68d810-1609-47df-90c2-d2897b89809e", "address": "fa:16:3e:bd:53:d7", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c68d810-16", "ovs_interfaceid": "1c68d810-1609-47df-90c2-d2897b89809e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converting VIF {"id": "1c68d810-1609-47df-90c2-d2897b89809e", "address": "fa:16:3e:bd:53:d7", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c68d810-16", "ovs_interfaceid": "1c68d810-1609-47df-90c2-d2897b89809e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:53:d7,bridge_name='br-int',has_traffic_filtering=True,id=1c68d810-1609-47df-90c2-d2897b89809e,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c68d810-16') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_vif [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:53:d7,bridge_name='br-int',has_traffic_filtering=True,id=1c68d810-1609-47df-90c2-d2897b89809e,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c68d810-16') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c68d810-16, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=033ebd5a-e544-4c34-871f-0b63c194347a) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-471d9943-7f75-4616-8928-ef135d5323e9 req-39db3e1b-2c11-4eff-9be3-ff51a4a5a850 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Received event network-vif-unplugged-1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-471d9943-7f75-4616-8928-ef135d5323e9 req-39db3e1b-2c11-4eff-9be3-ff51a4a5a850 service nova] Acquiring lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-471d9943-7f75-4616-8928-ef135d5323e9 req-39db3e1b-2c11-4eff-9be3-ff51a4a5a850 service nova] Lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-471d9943-7f75-4616-8928-ef135d5323e9 req-39db3e1b-2c11-4eff-9be3-ff51a4a5a850 service nova] Lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-471d9943-7f75-4616-8928-ef135d5323e9 req-39db3e1b-2c11-4eff-9be3-ff51a4a5a850 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] No waiting events found dispatching network-vif-unplugged-1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG nova.compute.manager [req-471d9943-7f75-4616-8928-ef135d5323e9 req-39db3e1b-2c11-4eff-9be3-ff51a4a5a850 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Received event network-vif-unplugged-1c68d810-1609-47df-90c2-d2897b89809e for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 19:14:06 user nova-compute[74692]: INFO os_vif [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:53:d7,bridge_name='br-int',has_traffic_filtering=True,id=1c68d810-1609-47df-90c2-d2897b89809e,network=Network(323b602f-828e-4949-a94a-5d007a595ddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c68d810-16')
Nov 18 19:14:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhtwLfvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:14:06 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d08bac1-77bf-427b-bb9c-b6745ca044ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:14:06 user nova-compute[74692]: No targets found.
Nov 18 19:14:06 user nova-compute[74692]: iSNS:
Nov 18 19:14:06 user nova-compute[74692]: No targets found.
Nov 18 19:14:06 user nova-compute[74692]: STATIC:
Nov 18 19:14:06 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a
Nov 18 19:14:06 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:14:06 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:14:06 user nova-compute[74692]: FIRMWARE:
Nov 18 19:14:06 user nova-compute[74692]: No targets found.
Nov 18 19:14:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:14:06 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:14:06 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[519c4d0f-13b8-4f49-8243-b9e03399586a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaf6f0a-4647-4e24-abb0-2e512fd08a8e]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)
Nov 18 19:14:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a (non-flash)
Nov 18 19:14:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c45f5870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0ac249-836a-4f06-acfd-8c83a871423f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8481c45-7895-4168-8143-d09674c98391]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[288f1252-b8c2-416d-a4eb-cb4e224b331f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6f2f8e-6d37-4ac7-825b-2ea70072fb9e]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2e653459-b20764e2236f8f59', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2e653459', '/dev/disk/by-id/scsi-26232303736346532') {{(pid=84932) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce33076-df52-444b-80c6-b35e1c9a6cb8]: (4, None) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e202141-6fac-4612-a552-ca56cee08212]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG nova.network.neutron [req-0886682c-a05c-4393-a4c8-8c2176bc9387 req-9c0e24d5-6fbc-471f-b4b9-5681aabe1a04 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Updated VIF entry in instance network info cache for port 1c68d810-1609-47df-90c2-d2897b89809e. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG nova.network.neutron [req-0886682c-a05c-4393-a4c8-8c2176bc9387 req-9c0e24d5-6fbc-471f-b4b9-5681aabe1a04 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Updating instance_info_cache with network_info: [{"id": "1c68d810-1609-47df-90c2-d2897b89809e", "address": "fa:16:3e:bd:53:d7", "network": {"id": "323b602f-828e-4949-a94a-5d007a595ddc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1415591675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a60e439a714bdd8fca1ec43e2a3139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c68d810-16", "ovs_interfaceid": "1c68d810-1609-47df-90c2-d2897b89809e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-0886682c-a05c-4393-a4c8-8c2176bc9387 req-9c0e24d5-6fbc-471f-b4b9-5681aabe1a04 service nova] Releasing lock "refresh_cache-44be4077-1065-4f5d-b6e1-9f71e4cd8791" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e54dd1-e6f2-43d6-ac7d-d4456e075493]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260]
Nov 18 19:14:06 user nova-compute[74692]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a, portal: 172.16.0.220,3260] successful.
Nov 18 19:14:06 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5db5828-739b-48f7-a725-000af2ed860a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dbd2b5-9acf-467f-94af-b9b2f45573c9]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] <== disconnect_volume: return (306ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:14:06 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Deleting instance files /opt/stack/data/nova/instances/44be4077-1065-4f5d-b6e1-9f71e4cd8791_del
Nov 18 19:14:06 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Deletion of /opt/stack/data/nova/instances/44be4077-1065-4f5d-b6e1-9f71e4cd8791_del complete
Nov 18 19:14:06 user nova-compute[74692]: INFO nova.compute.manager [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 18 19:14:06 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 19:14:06 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 19:14:07 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:14:07 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Took 0.37 seconds to deallocate network for instance.
Nov 18 19:14:08 user nova-compute[74692]: INFO nova.compute.manager [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Took 0.78 seconds to detach 1 volumes for instance.
Nov 18 19:14:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:14:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:14:08 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:14:08 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:14:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:14:08 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Deleted allocations for instance 44be4077-1065-4f5d-b6e1-9f71e4cd8791
Nov 18 19:14:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28185873-9cfc-4003-9ca8-2c2ba2517d9c tempest-TestVolumeBootPattern-1940625728 tempest-TestVolumeBootPattern-1940625728-project-member] Lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.632s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:14:08 user nova-compute[74692]: DEBUG nova.compute.manager [req-d5732595-8e36-41cc-8d04-ca75e3e8b7cd req-d887aa7d-46d0-435f-bef9-7b151a0c5181 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Received event network-vif-plugged-1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:14:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d5732595-8e36-41cc-8d04-ca75e3e8b7cd req-d887aa7d-46d0-435f-bef9-7b151a0c5181 service nova] Acquiring lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:14:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d5732595-8e36-41cc-8d04-ca75e3e8b7cd req-d887aa7d-46d0-435f-bef9-7b151a0c5181 service nova] Lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:14:08 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-d5732595-8e36-41cc-8d04-ca75e3e8b7cd req-d887aa7d-46d0-435f-bef9-7b151a0c5181 service nova] Lock "44be4077-1065-4f5d-b6e1-9f71e4cd8791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:14:08 user nova-compute[74692]: DEBUG nova.compute.manager [req-d5732595-8e36-41cc-8d04-ca75e3e8b7cd req-d887aa7d-46d0-435f-bef9-7b151a0c5181 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] No waiting events found dispatching network-vif-plugged-1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:14:08 user nova-compute[74692]: WARNING nova.compute.manager [req-d5732595-8e36-41cc-8d04-ca75e3e8b7cd req-d887aa7d-46d0-435f-bef9-7b151a0c5181 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Received unexpected event network-vif-plugged-1c68d810-1609-47df-90c2-d2897b89809e for instance with vm_state deleted and task_state None.
Nov 18 19:14:08 user nova-compute[74692]: DEBUG nova.compute.manager [req-d5732595-8e36-41cc-8d04-ca75e3e8b7cd req-d887aa7d-46d0-435f-bef9-7b151a0c5181 service nova] [instance: 44be4077-1065-4f5d-b6e1-9f71e4cd8791] Received event network-vif-deleted-1c68d810-1609-47df-90c2-d2897b89809e {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:14:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:14:36 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:14:39 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:14:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:14:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:14:39 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:14:39 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:14:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:14:40 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:14:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=9124MB free_disk=25.01891326904297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:14:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:14:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:14:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:14:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:14:40 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:14:40 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:14:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:14:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:14:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:14:43 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:14:43 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 19:14:45 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:14:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:14:47 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:14:47 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:14:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:14:52 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:14:52 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:14:53 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:14:53 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:14:54 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:14:54 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:14:54 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 19:14:54 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Didn't find any instances for network info cache update. {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 19:14:55 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:14:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:14:56 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:14:56 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:14:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:15:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:15:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:15:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:15:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:15:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:15:11 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:15:11 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 19:15:11 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] There are 0 instances to clean {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 19:15:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:15:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:15:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:15:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:15:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:15:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:15:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:15:26 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:15:31 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:15:36 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:15:40 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:15:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:15:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:15:40 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:15:40 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:15:41 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:15:41 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:15:41 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=9268MB free_disk=25.009029388427734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing inventories for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating ProviderTree inventory for provider 582be55c-ee9f-496e-b354-5900b8401d2c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating inventory in ProviderTree for provider 582be55c-ee9f-496e-b354-5900b8401d2c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing aggregate associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, aggregates: None {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing trait associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:15:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:15:46 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:15:48 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:15:48 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:15:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:15:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:15:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:15:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:15:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:15:51 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:15:53 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:15:54 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:15:54 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:15:54 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 19:15:54 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Didn't find any instances for network info cache update. {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 19:15:54 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:15:55 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:15:56 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:15:57 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:15:57 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:15:57 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:16:01 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:02 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:04 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:06 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:07 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:11 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:14 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:16 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:16:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:16:19 user nova-compute[74692]: DEBUG nova.compute.manager [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Starting instance... {{(pid=74692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 19:16:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:16:19 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:16:19 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 19:16:19 user nova-compute[74692]: INFO nova.compute.claims [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Claim successful on node user
Nov 18 19:16:20 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Start building networks asynchronously for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Allocating IP information in the background. {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG nova.network.neutron [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] allocate_for_instance() {{(pid=74692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 19:16:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 19:16:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Start building block device mappings for instance. {{(pid=74692) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG nova.compute.manager [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Start spawning the instance on the hypervisor. {{(pid=74692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Creating instance directory {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 19:16:20 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Creating image(s)
Nov 18 19:16:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "/opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "/opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG nova.policy [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a560f1448bd14686ae3862f8387508bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4701ace4033e4412bdd28fe34e82835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74692) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.217s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.228s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk 1073741824 {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701,backing_fmt=raw /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk 1073741824" returned: 0 in 0.065s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "6a94b3b2d60897f024d763f2dd4230a6419cd701" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:16:20 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:16:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a94b3b2d60897f024d763f2dd4230a6419cd701 --force-share --output=json" returned: 0 in 0.196s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:16:21 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk. size=1073741824 {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 19:16:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:16:21 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:16:21 user nova-compute[74692]: DEBUG nova.virt.disk.api [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Cannot resize image /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk to a smaller size. {{(pid=74692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 19:16:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Created local disks {{(pid=74692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 19:16:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Ensure instance console log exists: /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/console.log {{(pid=74692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 19:16:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:16:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:16:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:16:21 user nova-compute[74692]: DEBUG nova.network.neutron [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Successfully created port: 234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 19:16:21 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.network.neutron [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Successfully updated port: 234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquired lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.network.neutron [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Building network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.network.neutron [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Instance cache missing network info. {{(pid=74692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.compute.manager [req-eeb0db11-e8b4-4470-8a96-1c681af007ba req-63ffed4a-f74c-4d9c-b8c5-df6e6a0ed331 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received event network-changed-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.compute.manager [req-eeb0db11-e8b4-4470-8a96-1c681af007ba req-63ffed4a-f74c-4d9c-b8c5-df6e6a0ed331 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Refreshing instance network info cache due to event network-changed-234d58d1-e9a4-49c1-ba9f-41b529c97785. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eeb0db11-e8b4-4470-8a96-1c681af007ba req-63ffed4a-f74c-4d9c-b8c5-df6e6a0ed331 service nova] Acquiring lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.network.neutron [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updating instance_info_cache with network_info: [{"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Releasing lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.compute.manager [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Instance network_info: |[{"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eeb0db11-e8b4-4470-8a96-1c681af007ba req-63ffed4a-f74c-4d9c-b8c5-df6e6a0ed331 service nova] Acquired lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.network.neutron [req-eeb0db11-e8b4-4470-8a96-1c681af007ba req-63ffed4a-f74c-4d9c-b8c5-df6e6a0ed331 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Refreshing network info cache for port 234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Start _get_guest_xml network_info=[{"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '503b14b1-1e1e-41a7-a748-0e4d907ae048'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 19:16:22 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:16:22 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] CPU controller missing on host. {{(pid=74692) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.host [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] CPU controller found on host. {{(pid=74692) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T18:24:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T18:24:30Z,direct_url=<?>,disk_format='qcow2',id=503b14b1-1e1e-41a7-a748-0e4d907ae048,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4acc30afb1f4558a41fd76dac906b70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T18:24:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Flavor limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Image limits 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Flavor pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Image pref 0:0:0 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Got 1 possible topologies {{(pid=74692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.hardware [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-813974990',display_name='tempest-SnapshotDataIntegrityTests-server-813974990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-813974990',id=53,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkndiswWdxhV/SynkyAw/x8UF0cLt2FiGywQwAzD8zFiSw/hsPP/8rYA7XzDBqvEvMD+/n1vmipBEx79h8b9fJWOBB+pklP8EjbbN82rSBxVTgvma17vNdMPgnRO+a1vw==',key_name='tempest-keypair-187648696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4701ace4033e4412bdd28fe34e82835a',ramdisk_id='',reservation_id='r-8fpcujwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1806138183',owner_user_name='tempest-SnapshotDataIntegrityTests-1806138183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a560f1448bd14686ae3862f8387508bd',uuid=b5582510-fe7f-4d4f-8c24-ec89438f8e77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Converting VIF {"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:31:e6,bridge_name='br-int',has_traffic_filtering=True,id=234d58d1-e9a4-49c1-ba9f-41b529c97785,network=Network(9e422f4b-0d40-4d77-8af6-c26586f383e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap234d58d1-e9') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.objects.instance [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lazy-loading 'pci_devices' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] End _get_guest_xml xml=<domain type="kvm">
Nov 18 19:16:22 user nova-compute[74692]:   <uuid>b5582510-fe7f-4d4f-8c24-ec89438f8e77</uuid>
Nov 18 19:16:22 user nova-compute[74692]:   <name>instance-00000035</name>
Nov 18 19:16:22 user nova-compute[74692]:   <memory>524288</memory>
Nov 18 19:16:22 user nova-compute[74692]:   <vcpu>1</vcpu>
Nov 18 19:16:22 user nova-compute[74692]:   <metadata>
Nov 18 19:16:22 user nova-compute[74692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 19:16:22 user nova-compute[74692]:       <nova:package version="0.0.0"/>
Nov 18 19:16:22 user nova-compute[74692]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-813974990</nova:name>
Nov 18 19:16:22 user nova-compute[74692]:       <nova:creationTime>2023-11-18 19:16:22</nova:creationTime>
Nov 18 19:16:22 user nova-compute[74692]:       <nova:flavor name="m1.tiny">
Nov 18 19:16:22 user nova-compute[74692]:         <nova:memory>512</nova:memory>
Nov 18 19:16:22 user nova-compute[74692]:         <nova:disk>1</nova:disk>
Nov 18 19:16:22 user nova-compute[74692]:         <nova:swap>0</nova:swap>
Nov 18 19:16:22 user nova-compute[74692]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 19:16:22 user nova-compute[74692]:         <nova:vcpus>1</nova:vcpus>
Nov 18 19:16:22 user nova-compute[74692]:       </nova:flavor>
Nov 18 19:16:22 user nova-compute[74692]:       <nova:owner>
Nov 18 19:16:22 user nova-compute[74692]:         <nova:user uuid="a560f1448bd14686ae3862f8387508bd">tempest-SnapshotDataIntegrityTests-1806138183-project-member</nova:user>
Nov 18 19:16:22 user nova-compute[74692]:         <nova:project uuid="4701ace4033e4412bdd28fe34e82835a">tempest-SnapshotDataIntegrityTests-1806138183</nova:project>
Nov 18 19:16:22 user nova-compute[74692]:       </nova:owner>
Nov 18 19:16:22 user nova-compute[74692]:       <nova:root type="image" uuid="503b14b1-1e1e-41a7-a748-0e4d907ae048"/>
Nov 18 19:16:22 user nova-compute[74692]:       <nova:ports>
Nov 18 19:16:22 user nova-compute[74692]:         <nova:port uuid="234d58d1-e9a4-49c1-ba9f-41b529c97785">
Nov 18 19:16:22 user nova-compute[74692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 19:16:22 user nova-compute[74692]:         </nova:port>
Nov 18 19:16:22 user nova-compute[74692]:       </nova:ports>
Nov 18 19:16:22 user nova-compute[74692]:     </nova:instance>
Nov 18 19:16:22 user nova-compute[74692]:   </metadata>
Nov 18 19:16:22 user nova-compute[74692]:   <sysinfo type="smbios">
Nov 18 19:16:22 user nova-compute[74692]:     <system>
Nov 18 19:16:22 user nova-compute[74692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 19:16:22 user nova-compute[74692]:       <entry name="product">OpenStack Nova</entry>
Nov 18 19:16:22 user nova-compute[74692]:       <entry name="version">0.0.0</entry>
Nov 18 19:16:22 user nova-compute[74692]:       <entry name="serial">b5582510-fe7f-4d4f-8c24-ec89438f8e77</entry>
Nov 18 19:16:22 user nova-compute[74692]:       <entry name="uuid">b5582510-fe7f-4d4f-8c24-ec89438f8e77</entry>
Nov 18 19:16:22 user nova-compute[74692]:       <entry name="family">Virtual Machine</entry>
Nov 18 19:16:22 user nova-compute[74692]:     </system>
Nov 18 19:16:22 user nova-compute[74692]:   </sysinfo>
Nov 18 19:16:22 user nova-compute[74692]:   <os>
Nov 18 19:16:22 user nova-compute[74692]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 19:16:22 user nova-compute[74692]:     <boot dev="hd"/>
Nov 18 19:16:22 user nova-compute[74692]:     <smbios mode="sysinfo"/>
Nov 18 19:16:22 user nova-compute[74692]:   </os>
Nov 18 19:16:22 user nova-compute[74692]:   <features>
Nov 18 19:16:22 user nova-compute[74692]:     <acpi/>
Nov 18 19:16:22 user nova-compute[74692]:     <apic/>
Nov 18 19:16:22 user nova-compute[74692]:     <vmcoreinfo/>
Nov 18 19:16:22 user nova-compute[74692]:   </features>
Nov 18 19:16:22 user nova-compute[74692]:   <clock offset="utc">
Nov 18 19:16:22 user nova-compute[74692]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 19:16:22 user nova-compute[74692]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 19:16:22 user nova-compute[74692]:     <timer name="hpet" present="no"/>
Nov 18 19:16:22 user nova-compute[74692]:   </clock>
Nov 18 19:16:22 user nova-compute[74692]:   <cpu mode="custom" match="exact">
Nov 18 19:16:22 user nova-compute[74692]:     <model>Nehalem</model>
Nov 18 19:16:22 user nova-compute[74692]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 19:16:22 user nova-compute[74692]:   </cpu>
Nov 18 19:16:22 user nova-compute[74692]:   <devices>
Nov 18 19:16:22 user nova-compute[74692]:     <disk type="file" device="disk">
Nov 18 19:16:22 user nova-compute[74692]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 19:16:22 user nova-compute[74692]:       <source file="/opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk"/>
Nov 18 19:16:22 user nova-compute[74692]:       <target dev="vda" bus="virtio"/>
Nov 18 19:16:22 user nova-compute[74692]:     </disk>
Nov 18 19:16:22 user nova-compute[74692]:     <interface type="ethernet">
Nov 18 19:16:22 user nova-compute[74692]:       <mac address="fa:16:3e:97:31:e6"/>
Nov 18 19:16:22 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:16:22 user nova-compute[74692]:       <mtu size="1442"/>
Nov 18 19:16:22 user nova-compute[74692]:       <target dev="tap234d58d1-e9"/>
Nov 18 19:16:22 user nova-compute[74692]:     </interface>
Nov 18 19:16:22 user nova-compute[74692]:     <serial type="pty">
Nov 18 19:16:22 user nova-compute[74692]:       <log file="/opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/console.log" append="off"/>
Nov 18 19:16:22 user nova-compute[74692]:     </serial>
Nov 18 19:16:22 user nova-compute[74692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 19:16:22 user nova-compute[74692]:     <video>
Nov 18 19:16:22 user nova-compute[74692]:       <model type="virtio"/>
Nov 18 19:16:22 user nova-compute[74692]:     </video>
Nov 18 19:16:22 user nova-compute[74692]:     <rng model="virtio">
Nov 18 19:16:22 user nova-compute[74692]:       <backend model="random">/dev/urandom</backend>
Nov 18 19:16:22 user nova-compute[74692]:     </rng>
Nov 18 19:16:22 user nova-compute[74692]:     <controller type="usb" index="0" model="none"/>
Nov 18 19:16:22 user nova-compute[74692]:     <memballoon model="virtio">
Nov 18 19:16:22 user nova-compute[74692]:       <stats period="10"/>
Nov 18 19:16:22 user nova-compute[74692]:     </memballoon>
Nov 18 19:16:22 user nova-compute[74692]:   </devices>
Nov 18 19:16:22 user nova-compute[74692]: </domain>
Nov 18 19:16:22 user nova-compute[74692]:  {{(pid=74692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-813974990',display_name='tempest-SnapshotDataIntegrityTests-server-813974990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-813974990',id=53,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkndiswWdxhV/SynkyAw/x8UF0cLt2FiGywQwAzD8zFiSw/hsPP/8rYA7XzDBqvEvMD+/n1vmipBEx79h8b9fJWOBB+pklP8EjbbN82rSBxVTgvma17vNdMPgnRO+a1vw==',key_name='tempest-keypair-187648696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4701ace4033e4412bdd28fe34e82835a',ramdisk_id='',reservation_id='r-8fpcujwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1806138183',owner_user_name='tempest-SnapshotDataIntegrityTests-1806138183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T19:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a560f1448bd14686ae3862f8387508bd',uuid=b5582510-fe7f-4d4f-8c24-ec89438f8e77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Converting VIF {"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:31:e6,bridge_name='br-int',has_traffic_filtering=True,id=234d58d1-e9a4-49c1-ba9f-41b529c97785,network=Network(9e422f4b-0d40-4d77-8af6-c26586f383e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap234d58d1-e9') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG os_vif [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:31:e6,bridge_name='br-int',has_traffic_filtering=True,id=234d58d1-e9a4-49c1-ba9f-41b529c97785,network=Network(9e422f4b-0d40-4d77-8af6-c26586f383e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap234d58d1-e9') {{(pid=74692) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eafeb06c-9ea1-5aba-952a-a37fe0376bc0', '_type': 'linux-noop'}}, row=False) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap234d58d1-e9, may_exist=True, interface_attrs={}) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap234d58d1-e9, col_values=(('qos', UUID('8922b2dd-a036-4fb4-bfad-8174384c44ea')),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap234d58d1-e9, col_values=(('external_ids', {'iface-id': '234d58d1-e9a4-49c1-ba9f-41b529c97785', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:31:e6', 'vm-uuid': 'b5582510-fe7f-4d4f-8c24-ec89438f8e77'}),), if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:22 user nova-compute[74692]: INFO os_vif [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:31:e6,bridge_name='br-int',has_traffic_filtering=True,id=234d58d1-e9a4-49c1-ba9f-41b529c97785,network=Network(9e422f4b-0d40-4d77-8af6-c26586f383e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap234d58d1-e9')
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:16:22 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] No VIF found with MAC fa:16:3e:97:31:e6, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:16:23 user nova-compute[74692]: DEBUG nova.network.neutron [req-eeb0db11-e8b4-4470-8a96-1c681af007ba req-63ffed4a-f74c-4d9c-b8c5-df6e6a0ed331 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updated VIF entry in instance network info cache for port 234d58d1-e9a4-49c1-ba9f-41b529c97785. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:16:23 user nova-compute[74692]: DEBUG nova.network.neutron [req-eeb0db11-e8b4-4470-8a96-1c681af007ba req-63ffed4a-f74c-4d9c-b8c5-df6e6a0ed331 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updating instance_info_cache with network_info: [{"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:16:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-eeb0db11-e8b4-4470-8a96-1c681af007ba req-63ffed4a-f74c-4d9c-b8c5-df6e6a0ed331 service nova] Releasing lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:16:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:24 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-86ccfbef-9686-4394-9e7d-cc6a796db7e2 req-80c96cb4-2a8f-4f4c-8036-e61bd4aee0ac service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received event network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:16:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-86ccfbef-9686-4394-9e7d-cc6a796db7e2 req-80c96cb4-2a8f-4f4c-8036-e61bd4aee0ac service nova] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:16:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-86ccfbef-9686-4394-9e7d-cc6a796db7e2 req-80c96cb4-2a8f-4f4c-8036-e61bd4aee0ac service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:16:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-86ccfbef-9686-4394-9e7d-cc6a796db7e2 req-80c96cb4-2a8f-4f4c-8036-e61bd4aee0ac service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:16:24 user nova-compute[74692]: DEBUG nova.compute.manager [req-86ccfbef-9686-4394-9e7d-cc6a796db7e2 req-80c96cb4-2a8f-4f4c-8036-e61bd4aee0ac service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] No waiting events found dispatching network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:16:24 user nova-compute[74692]: WARNING nova.compute.manager [req-86ccfbef-9686-4394-9e7d-cc6a796db7e2 req-80c96cb4-2a8f-4f4c-8036-e61bd4aee0ac service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received unexpected event network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 for instance with vm_state building and task_state spawning.
Nov 18 19:16:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Instance event wait completed in 0 seconds for  {{(pid=74692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 19:16:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Guest created on hypervisor {{(pid=74692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 19:16:26 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Instance spawned successfully.
Nov 18 19:16:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 19:16:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Found default for hw_cdrom_bus of ide {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:16:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Found default for hw_disk_bus of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:16:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Found default for hw_input_bus of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:16:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Found default for hw_pointer_model of None {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:16:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Found default for hw_video_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:16:26 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Found default for hw_vif_model of virtio {{(pid=74692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 19:16:26 user nova-compute[74692]: DEBUG nova.compute.manager [req-62882bee-b2fc-4f7b-b294-4481e8af9cf3 req-ebf7f4b4-7ecd-4f57-b349-a82b89ed5d54 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received event network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:16:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-62882bee-b2fc-4f7b-b294-4481e8af9cf3 req-ebf7f4b4-7ecd-4f57-b349-a82b89ed5d54 service nova] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:16:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-62882bee-b2fc-4f7b-b294-4481e8af9cf3 req-ebf7f4b4-7ecd-4f57-b349-a82b89ed5d54 service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:16:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-62882bee-b2fc-4f7b-b294-4481e8af9cf3 req-ebf7f4b4-7ecd-4f57-b349-a82b89ed5d54 service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:16:26 user nova-compute[74692]: DEBUG nova.compute.manager [req-62882bee-b2fc-4f7b-b294-4481e8af9cf3 req-ebf7f4b4-7ecd-4f57-b349-a82b89ed5d54 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] No waiting events found dispatching network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:16:26 user nova-compute[74692]: WARNING nova.compute.manager [req-62882bee-b2fc-4f7b-b294-4481e8af9cf3 req-ebf7f4b4-7ecd-4f57-b349-a82b89ed5d54 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received unexpected event network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 for instance with vm_state building and task_state spawning.
Nov 18 19:16:26 user nova-compute[74692]: INFO nova.compute.manager [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Took 6.49 seconds to spawn the instance on the hypervisor.
Nov 18 19:16:26 user nova-compute[74692]: DEBUG nova.compute.manager [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Checking state {{(pid=74692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 19:16:26 user nova-compute[74692]: INFO nova.compute.manager [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Took 7.10 seconds to build instance.
Nov 18 19:16:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-847e1bea-b696-4eec-b96f-9c872bcbb36f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.227s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:16:27 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:32 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:37 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:41 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:16:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:16:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:16:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:16:42 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:16:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:16:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:16:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:16:42 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:16:42 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:42 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:16:42 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:16:42 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=24.975475311279297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:16:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:16:42 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:16:43 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:16:43 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:16:43 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:16:43 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:16:43 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:16:43 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:16:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:16:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:47 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:50 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:16:50 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:16:52 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:54 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:16:55 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:16:55 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:16:55 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:16:55 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:16:55 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 19:16:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:16:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:16:56 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:16:56 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:16:56 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updating instance_info_cache with network_info: [{"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:16:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:16:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:16:56 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:16:57 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:16:57 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:16:59 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:16:59 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:17:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:17:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:17:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:17:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:17:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:17:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:17:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:17:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:17:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:17:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:17:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:17:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:17:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:17:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:17:43 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:17:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:17:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:17:43 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:17:43 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:17:44 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:17:44 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:17:44 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:17:44 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:17:44 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:17:44 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:17:44 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=24.964080810546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:17:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:17:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:17:44 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:17:44 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:17:44 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:17:45 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:17:45 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:17:45 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:17:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:17:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:17:51 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:17:51 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:17:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:17:55 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:17:56 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:17:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:17:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 19:17:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:17:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:17:57 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:17:57 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:17:57 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updating instance_info_cache with network_info: [{"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:17:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:17:57 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:17:57 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:17:57 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:17:57 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:17:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:17:59 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:18:00 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:18:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:18:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:18:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:18:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:18:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:11 user nova-compute[74692]: DEBUG nova.compute.manager [req-7cd0f80a-f96f-4084-8c59-407b4768abff req-a6affb82-c14d-4a0c-8bfb-ffade86644c7 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received event network-changed-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:18:11 user nova-compute[74692]: DEBUG nova.compute.manager [req-7cd0f80a-f96f-4084-8c59-407b4768abff req-a6affb82-c14d-4a0c-8bfb-ffade86644c7 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Refreshing instance network info cache due to event network-changed-234d58d1-e9a4-49c1-ba9f-41b529c97785. {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 19:18:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7cd0f80a-f96f-4084-8c59-407b4768abff req-a6affb82-c14d-4a0c-8bfb-ffade86644c7 service nova] Acquiring lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:18:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7cd0f80a-f96f-4084-8c59-407b4768abff req-a6affb82-c14d-4a0c-8bfb-ffade86644c7 service nova] Acquired lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:18:11 user nova-compute[74692]: DEBUG nova.network.neutron [req-7cd0f80a-f96f-4084-8c59-407b4768abff req-a6affb82-c14d-4a0c-8bfb-ffade86644c7 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Refreshing network info cache for port 234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 19:18:11 user nova-compute[74692]: DEBUG nova.network.neutron [req-7cd0f80a-f96f-4084-8c59-407b4768abff req-a6affb82-c14d-4a0c-8bfb-ffade86644c7 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updated VIF entry in instance network info cache for port 234d58d1-e9a4-49c1-ba9f-41b529c97785. {{(pid=74692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 19:18:11 user nova-compute[74692]: DEBUG nova.network.neutron [req-7cd0f80a-f96f-4084-8c59-407b4768abff req-a6affb82-c14d-4a0c-8bfb-ffade86644c7 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updating instance_info_cache with network_info: [{"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:18:11 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-7cd0f80a-f96f-4084-8c59-407b4768abff req-a6affb82-c14d-4a0c-8bfb-ffade86644c7 service nova] Releasing lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:18:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:18:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:18:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.007s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:18:13 user nova-compute[74692]: DEBUG nova.objects.instance [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lazy-loading 'flavor' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:18:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:18:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:18:13 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:18:13 user nova-compute[74692]: INFO nova.compute.manager [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Attaching volume 3b955022-9ef2-47fc-a168-72290b31ba4d to /dev/vdb
Nov 18 19:18:14 user nova-compute[74692]: DEBUG os_brick.utils [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a1a3e6-a15c-44ad-bafd-0c21f3a54158]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d027822f-b73d-4415-ab52-5d1a112aeedd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef27dc1-1fb2-45db-b80d-ce1b7b8e36d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[99449e1b-afb9-43d3-9d7a-20aef6b71384]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:18:14 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 19:18:14 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[111263b6-4c08-4ebb-8a36-f5c21222f25a]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG os_brick.utils [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:18:14 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updating existing volume attachment record: 69abe168-9f7f-4ffe-9dbe-814cda3605cd {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 19:18:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IZpwsGPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:18:19 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:18:19 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:18:19 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f15e21-b4ae-49e0-a945-4ab678ebd029]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 19:18:19 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0088c1a8-79a8-4fb4-8f00-054d92281c54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d] added
Nov 18 19:18:19 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaaae19-cef3-48c6-9e8a-f9b15c189c22]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f177e3b-4b03-4cc2-b92d-72e74b4d7435]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IZpwsGPS {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IZpwsGPS" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e7ce21-34ce-4ef4-b954-21f0988aab30]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IZpwsGPS'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74832e8-4bfd-4e19-b828-240ef327a723]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[49210c9f-55d1-42dc-ba38-b9a58d6cf41f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:18:19 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:18:19 user nova-compute[74692]:  {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:18:19 user nova-compute[74692]: WARNING os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 19:18:19 user nova-compute[74692]: 
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddf0e65-971b-4bd2-90e8-19f0c619cb2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d, portal: 172.16.0.220,3260]
Nov 18 19:18:19 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d, portal: 172.16.0.220,3260] successful.
Nov 18 19:18:19 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26da1cf-a7ea-4f39-82b6-69d0c9c906ee]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f435213-4d75-4f04-8be7-3e650f1c3ae8]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d (non-flash)
Nov 18 19:18:19 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d (non-flash)
Nov 18 19:18:19 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a715cfd-feba-474a-8335-5ce29cc0d3ef]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:18:19 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IZpwsGPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 19:18:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:18:20 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23262333437346638', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:18:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262333437346638', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 19:18:20 user nova-compute[74692]: DEBUG nova.objects.instance [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lazy-loading 'flavor' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:18:20 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 19:18:20 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:18:20 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:18:20 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:18:20 user nova-compute[74692]:   <serial>3b955022-9ef2-47fc-a168-72290b31ba4d</serial>
Nov 18 19:18:20 user nova-compute[74692]: </disk>
Nov 18 19:18:20 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 19:18:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:18:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:18:21 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] No VIF found with MAC fa:16:3e:97:31:e6, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:18:21 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-a668ce66-4fee-4004-8784-a274ef2dca5f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.176s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:18:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:18:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:18:32 user nova-compute[74692]: INFO nova.compute.manager [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Detaching volume 3b955022-9ef2-47fc-a168-72290b31ba4d
Nov 18 19:18:32 user nova-compute[74692]: INFO nova.virt.block_device [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Attempting to driver detach volume 3b955022-9ef2-47fc-a168-72290b31ba4d from mountpoint /dev/vdb
Nov 18 19:18:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Attempting to detach device vdb from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 19:18:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:18:32 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:18:32 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:18:32 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:18:32 user nova-compute[74692]:   <serial>3b955022-9ef2-47fc-a168-72290b31ba4d</serial>
Nov 18 19:18:32 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:18:32 user nova-compute[74692]: </disk>
Nov 18 19:18:32 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:18:32 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Successfully detached device vdb from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the persistent domain config.
Nov 18 19:18:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 19:18:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:18:32 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:18:32 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:18:32 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:18:32 user nova-compute[74692]:   <serial>3b955022-9ef2-47fc-a168-72290b31ba4d</serial>
Nov 18 19:18:32 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:18:32 user nova-compute[74692]: </disk>
Nov 18 19:18:32 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:18:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 19:18:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:44 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:18:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:18:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:18:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:18:44 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:18:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:45 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:18:45 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:18:45 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=24.962753295898438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:18:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:18:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:18:45 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:18:45 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:18:45 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:18:45 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:18:45 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:18:45 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:18:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:18:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:18:52 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 is timed out.
Nov 18 19:18:52 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Successfully detached device vdb from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the live domain config.
Nov 18 19:18:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IZpwsGPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:18:52 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4cd677-3666-41e7-b974-1c222684ecfb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:18:52 user nova-compute[74692]: No targets found.
Nov 18 19:18:52 user nova-compute[74692]: iSNS:
Nov 18 19:18:52 user nova-compute[74692]: No targets found.
Nov 18 19:18:52 user nova-compute[74692]: STATIC:
Nov 18 19:18:52 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d
Nov 18 19:18:52 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:18:52 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:18:52 user nova-compute[74692]: FIRMWARE:
Nov 18 19:18:52 user nova-compute[74692]: No targets found.
Nov 18 19:18:52 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:18:52 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:18:52 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e6b87b-91f9-430e-88f2-97867cbc9984]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a969402e-38f4-407d-bda0-4147fdc0c390]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d (non-flash)
Nov 18 19:18:52 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d (non-flash)
Nov 18 19:18:52 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a45e4ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec3d07b-8f35-40be-9e7f-575a86e0fb83]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f637f7f5-16cc-4f19-8fbc-eea089e66ac3]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3c6685-7ba3-4c9f-8d9a-46c2a0d3a5c9]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8d2d5f-101a-403d-8c9f-0654154ad626]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[65762a40-c5f0-4f08-b593-144e2e77fe5a]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa70c9c3-8b4e-4aef-907d-aa067b8255ce]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d, portal: 172.16.0.220,3260]
Nov 18 19:18:52 user nova-compute[74692]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d, portal: 172.16.0.220,3260] successful.
Nov 18 19:18:52 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b955022-9ef2-47fc-a168-72290b31ba4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4451748-4298-471d-9e54-16e3ebb9f443]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] <== disconnect_volume: return (270ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:18:52 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:18:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:18:53 user nova-compute[74692]: DEBUG nova.objects.instance [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lazy-loading 'flavor' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:18:53 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cebda6ae-bcf0-4d85-a268-5eb47d422a81 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.865s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:18:55 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:18:56 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:18:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:18:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 19:18:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:18:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:18:57 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:18:57 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:18:57 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updating instance_info_cache with network_info: [{"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:18:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:18:57 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:18:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:18:58 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:18:58 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:18:59 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:18:59 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:19:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:19:02 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:19:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:19:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:19:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:19:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:19:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:19:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:19:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:19:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:19:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:19:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:19:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:19:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:19:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:19:23 user nova-compute[74692]: DEBUG nova.objects.instance [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lazy-loading 'flavor' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:19:23 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:19:24 user nova-compute[74692]: INFO nova.compute.manager [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Attaching volume 0745695d-3d2b-4f06-95bf-75805e4951fc to /dev/vdb
Nov 18 19:19:24 user nova-compute[74692]: DEBUG os_brick.utils [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1538a69e-4ed7-4d54-84c0-d7db9060f031]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc97ee6-7a31-43ec-a2e0-623ba23d93aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c76da8-eb01-4df4-bbea-1862eee9b991]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f6aa69-1148-4424-8859-495599e30247]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:19:24 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 19:19:24 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0774ca62-56cd-4f51-8b22-87562cf27ec7]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG os_brick.utils [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:19:24 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updating existing volume attachment record: 47ce44c1-98f3-4f6d-ba06-a06ff674a38d {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 19:19:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:19:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEcNnYJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:19:29 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:19:29 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:19:29 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0571d3-6a21-4918-a0dd-c44fe58d1d72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 19:19:29 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc74eb69-abe6-4190-bfe1-230a00aaf074]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc] added
Nov 18 19:19:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d283e2-6e96-4430-a088-67c705d76599]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9fb99d-a415-441a-974c-3c4015da0583]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZEcNnYJq {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZEcNnYJq" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ccbed2-0ea7-4ea4-b8cf-5684ace50211]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZEcNnYJq'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84a689f-bd31-4f05-96a3-913cb7a42fef]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eeba8a-83bb-46fb-aaf7-b819d25c8175]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:19:29 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:19:29 user nova-compute[74692]:  {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:19:29 user nova-compute[74692]: WARNING os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 19:19:29 user nova-compute[74692]: 
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[763844d3-4b16-4c9d-954e-5feae07809b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc, portal: 172.16.0.220,3260]
Nov 18 19:19:29 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc, portal: 172.16.0.220,3260] successful.
Nov 18 19:19:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cba5cc-5d78-4c82-a188-989af95ee1c8]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a83eeb-fb4a-4822-8d4e-03c4669910af]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc (non-flash)
Nov 18 19:19:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc (non-flash)
Nov 18 19:19:29 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a9e3ba-82c2-456e-a0e2-0c0f69d4c855]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:19:29 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEcNnYJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 19:19:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.261s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:19:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] <== connect_volume: return (1263ms) {'type': 'block', 'scsi_wwn': '26361626138353834', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:19:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361626138353834', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 19:19:30 user nova-compute[74692]: DEBUG nova.objects.instance [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lazy-loading 'flavor' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:19:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 19:19:30 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:19:30 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:19:30 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:19:30 user nova-compute[74692]:   <serial>0745695d-3d2b-4f06-95bf-75805e4951fc</serial>
Nov 18 19:19:30 user nova-compute[74692]: </disk>
Nov 18 19:19:30 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 19:19:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:19:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:19:31 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] No VIF found with MAC fa:16:3e:97:31:e6, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:19:31 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-28b20166-8d3b-45bd-9341-3cc7eeed3ce4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.180s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:19:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:19:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:19:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:19:33 user nova-compute[74692]: INFO nova.compute.manager [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Detaching volume 0745695d-3d2b-4f06-95bf-75805e4951fc
Nov 18 19:19:33 user nova-compute[74692]: INFO nova.virt.block_device [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Attempting to driver detach volume 0745695d-3d2b-4f06-95bf-75805e4951fc from mountpoint /dev/vdb
Nov 18 19:19:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Attempting to detach device vdb from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 19:19:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:19:33 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:19:33 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:19:33 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:19:33 user nova-compute[74692]:   <serial>0745695d-3d2b-4f06-95bf-75805e4951fc</serial>
Nov 18 19:19:33 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:19:33 user nova-compute[74692]: </disk>
Nov 18 19:19:33 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:19:33 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Successfully detached device vdb from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the persistent domain config.
Nov 18 19:19:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 19:19:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:19:33 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:19:33 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:19:33 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:19:33 user nova-compute[74692]:   <serial>0745695d-3d2b-4f06-95bf-75805e4951fc</serial>
Nov 18 19:19:33 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:19:33 user nova-compute[74692]: </disk>
Nov 18 19:19:33 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:19:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:19:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 19:19:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:19:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:19:44 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:19:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:19:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:19:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:19:44 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:19:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:45 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:45 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:19:45 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:19:45 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=24.961833953857422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:19:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:19:45 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:19:46 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:19:46 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:19:46 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:19:46 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:19:46 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:19:46 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:19:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:19:46 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:19:46 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 19:19:46 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:19:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:19:53 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 is timed out.
Nov 18 19:19:53 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Successfully detached device vdb from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the live domain config.
Nov 18 19:19:53 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEcNnYJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:19:53 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:19:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7669ffe-63f6-40d6-8e8f-e89bd7691d32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:19:53 user nova-compute[74692]: No targets found.
Nov 18 19:19:53 user nova-compute[74692]: iSNS:
Nov 18 19:19:53 user nova-compute[74692]: No targets found.
Nov 18 19:19:53 user nova-compute[74692]: STATIC:
Nov 18 19:19:53 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc
Nov 18 19:19:53 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:19:53 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:19:53 user nova-compute[74692]: FIRMWARE:
Nov 18 19:19:53 user nova-compute[74692]: No targets found.
Nov 18 19:19:53 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:19:53 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:19:53 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd9a945-9c22-4bd0-8489-d354064e3955]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6183bae0-d25b-44f3-8466-2d4aea71a763]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc (non-flash)
Nov 18 19:19:53 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc (non-flash)
Nov 18 19:19:53 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41d5a91990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b614da70-631c-4db4-90bb-7ffb71267c99]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c3f5b6-2c93-487a-a85d-5ae553ce5580]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe984f71-5c0a-4649-bafc-e70cf73b8b1d]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dc3e10-7b83-4ba2-83ab-0b8d64d0d53b]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:53 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63c2908-d0b0-4b4a-a505-915e0510115e]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff60e1e6-a59a-417b-977c-b9ffc62059b8]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc, portal: 172.16.0.220,3260]
Nov 18 19:19:54 user nova-compute[74692]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc, portal: 172.16.0.220,3260] successful.
Nov 18 19:19:54 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0745695d-3d2b-4f06-95bf-75805e4951fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd2b9b5-6df9-48de-bb8b-817f180a7336]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] <== disconnect_volume: return (271ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG nova.objects.instance [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lazy-loading 'flavor' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:19:54 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-c436c4e3-d5aa-448c-be44-a37342f16aa9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.619s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:19:57 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:19:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:19:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:19:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:19:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:19:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:19:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:19:58 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:19:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:19:58 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 19:19:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:19:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:19:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:19:59 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:19:59 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updating instance_info_cache with network_info: [{"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:19:59 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:19:59 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:19:59 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:19:59 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:19:59 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:20:02 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:20:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:20:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:20:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:20:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:20:13 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:20:13 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Cleaning up deleted instances {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 19:20:13 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] There are 0 instances to clean {{(pid=74692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 19:20:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:20:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:20:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:20:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:20:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:20:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:20:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG nova.objects.instance [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lazy-loading 'flavor' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:20:25 user nova-compute[74692]: INFO nova.compute.manager [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Attaching volume 6f271eb1-f0dd-4b32-a1d0-466756b111fc to /dev/vdb
Nov 18 19:20:25 user nova-compute[74692]: DEBUG os_brick.utils [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51a0432-0783-43cf-8b6f-bc1c7b6ac584]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ea1dc9-f410-4b12-a6fd-40232d877513]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a927f78-f6fd-4a6f-97d3-ec01082e918b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d30fb6-a227-4af5-b7bf-782053e61c85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:20:25 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 19:20:25 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2d17e1-84fd-4871-8c40-523d2fd0be34]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG os_brick.utils [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:20:25 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updating existing volume attachment record: 67b67a4c-bb88-49ce-a7a3-774cd12d5ee3 {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 19:20:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:20:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKUsWzGQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:20:30 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:20:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:20:30 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:20:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:20:30 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 19:20:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[02281edf-e805-4cc8-bc49-bb8ef8d81205]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 19:20:30 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ac2972-e5d2-415d-987a-13d52edc7c3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc] added
Nov 18 19:20:30 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb9b65a-85e5-4749-95de-ce145a7f2a74]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69f2c0d-976e-4040-b1c9-cd2d641453f8]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:20:30 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OKUsWzGQ {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OKUsWzGQ" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d968eba-dbd7-452d-8b69-6e38eb4d1387]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OKUsWzGQ'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fed67be-f9f5-442c-a61a-6e54090a1498]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ef8852-aeb3-4279-a93d-f04c073719d9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:20:31 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:20:31 user nova-compute[74692]:  {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:20:31 user nova-compute[74692]: WARNING os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 19:20:31 user nova-compute[74692]: 
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fe6203-740a-486e-b45f-be1c5ab7c56b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc, portal: 172.16.0.220,3260]
Nov 18 19:20:31 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc, portal: 172.16.0.220,3260] successful.
Nov 18 19:20:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[010cfd05-8b0a-4e27-83e8-208a980be6ef]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[41408580-980c-4ff3-861e-73d87c5b67f1]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc (non-flash)
Nov 18 19:20:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc (non-flash)
Nov 18 19:20:31 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d1de6e-af1e-4ea4-8a8d-ddbf3c55fd18]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:20:31 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKUsWzGQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 19:20:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:20:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '23436373634363763', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:20:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436373634363763', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 19:20:32 user nova-compute[74692]: DEBUG nova.objects.instance [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lazy-loading 'flavor' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:20:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 19:20:32 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:20:32 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:20:32 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:20:32 user nova-compute[74692]:   <serial>6f271eb1-f0dd-4b32-a1d0-466756b111fc</serial>
Nov 18 19:20:32 user nova-compute[74692]: </disk>
Nov 18 19:20:32 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 19:20:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:20:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:20:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] No VIF found with MAC fa:16:3e:97:31:e6, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:20:32 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-fc4883c0-9ac2-4fe8-a281-5200b3a23ce1 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.284s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:20:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:20:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:20:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:20:34 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:20:34 user nova-compute[74692]: INFO nova.compute.manager [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Detaching volume 6f271eb1-f0dd-4b32-a1d0-466756b111fc
Nov 18 19:20:34 user nova-compute[74692]: INFO nova.virt.block_device [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Attempting to driver detach volume 6f271eb1-f0dd-4b32-a1d0-466756b111fc from mountpoint /dev/vdb
Nov 18 19:20:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Attempting to detach device vdb from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 19:20:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:20:34 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:20:34 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:20:34 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:20:34 user nova-compute[74692]:   <serial>6f271eb1-f0dd-4b32-a1d0-466756b111fc</serial>
Nov 18 19:20:34 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:20:34 user nova-compute[74692]: </disk>
Nov 18 19:20:34 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:20:34 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Successfully detached device vdb from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the persistent domain config.
Nov 18 19:20:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 19:20:34 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:20:34 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:20:34 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:20:34 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:20:34 user nova-compute[74692]:   <serial>6f271eb1-f0dd-4b32-a1d0-466756b111fc</serial>
Nov 18 19:20:34 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:20:34 user nova-compute[74692]: </disk>
Nov 18 19:20:34 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:20:35 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 19:20:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:20:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:20:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:20:45 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:20:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:20:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:20:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:20:46 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:20:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:46 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:46 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:20:46 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:20:46 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8963MB free_disk=24.96084976196289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:20:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:20:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:20:46 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:20:46 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:20:46 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:20:46 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing inventories for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 19:20:47 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating ProviderTree inventory for provider 582be55c-ee9f-496e-b354-5900b8401d2c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 19:20:47 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Updating inventory in ProviderTree for provider 582be55c-ee9f-496e-b354-5900b8401d2c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 19:20:47 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing aggregate associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, aggregates: None {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 19:20:47 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Refreshing trait associations for resource provider 582be55c-ee9f-496e-b354-5900b8401d2c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI {{(pid=74692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 19:20:47 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:20:47 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:20:47 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:20:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:20:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:20:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:20:54 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:20:54 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:20:55 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 is timed out.
Nov 18 19:20:55 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Successfully detached device vdb from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the live domain config.
Nov 18 19:20:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKUsWzGQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:20:55 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fe21cb-222d-4285-b733-07df6806ee5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:20:55 user nova-compute[74692]: No targets found.
Nov 18 19:20:55 user nova-compute[74692]: iSNS:
Nov 18 19:20:55 user nova-compute[74692]: No targets found.
Nov 18 19:20:55 user nova-compute[74692]: STATIC:
Nov 18 19:20:55 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc
Nov 18 19:20:55 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:20:55 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:20:55 user nova-compute[74692]: FIRMWARE:
Nov 18 19:20:55 user nova-compute[74692]: No targets found.
Nov 18 19:20:55 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:20:55 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:20:55 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6318972-d637-467e-90da-e85eb5f2ddb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[404ad40e-6cdb-4cfd-ac38-c046e1beced3]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc (non-flash)
Nov 18 19:20:55 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc (non-flash)
Nov 18 19:20:55 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41a4531240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d503fa5d-1165-4ca5-a050-c0f3c1fda416]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4b55ca-26c2-4e3b-af8a-a52291301594]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5475fb0-2fa8-4b29-8c5f-3f64f3a5ad80]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a543774-ff15-44c3-bb8a-27cbff304533]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e03c62-7a46-4c5e-975b-3b07ba696130]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d8c35b-5a50-4ca7-a5b8-27fc559e34d9]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc, portal: 172.16.0.220,3260]
Nov 18 19:20:55 user nova-compute[74692]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc, portal: 172.16.0.220,3260] successful.
Nov 18 19:20:55 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f271eb1-f0dd-4b32-a1d0-466756b111fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d77bfa-3ab4-40fd-9455-b0b90d0d32ab]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] <== disconnect_volume: return (278ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:20:55 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:20:56 user nova-compute[74692]: DEBUG nova.objects.instance [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lazy-loading 'flavor' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:20:56 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-cce846cd-d411-413d-9ab0-6b234e063a33 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.565s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:20:57 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:20:57 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:20:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:20:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:20:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:20:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:20:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:20:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:20:59 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:21:00 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:21:00 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:21:00 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 19:21:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:21:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:21:01 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:21:01 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:21:01 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updating instance_info_cache with network_info: [{"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:21:01 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:21:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:21:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:21:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:21:02 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:21:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:21:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:21:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:21:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:21:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:21:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:21:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:21:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:21:26 user nova-compute[74692]: DEBUG nova.objects.instance [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lazy-loading 'flavor' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:21:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:21:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:21:26 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:21:26 user nova-compute[74692]: INFO nova.compute.manager [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Attaching volume 45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 to /dev/vdb
Nov 18 19:21:26 user nova-compute[74692]: DEBUG os_brick.utils [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:21:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:26 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ca6f7e-9aed-4f28-b3d2-18cc6a04b1bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cf42cc7aff40\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:26 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b57fda-8722-4e3e-b71b-b54b0b88b075]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:26 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4c8766-8f08-44b1-bee7-e63696a62b61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[53597995-46b3-41b3-86fc-902236f60110]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Running cmd (subprocess): nvme version {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] 'nvme version' failed. Not Retrying. {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:21:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] nvme not present on system {{(pid=74692) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 19:21:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:27 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 19:21:27 user nova-compute[74692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 19:21:27 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a770d7-edfc-4855-a67e-10465858f3e1]: (4, '') {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74692) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 19:21:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 19:21:27 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.lightos [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] LIGHTOS: no hostnqn found. {{(pid=74692) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 19:21:27 user nova-compute[74692]: DEBUG os_brick.utils [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cf42cc7aff40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:21:27 user nova-compute[74692]: DEBUG nova.virt.block_device [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updating existing volume attachment record: b895c519-007a-4621-bea6-2af2f9fcfa4a {{(pid=74692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 19:21:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:21:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Calling os-brick to attach iSCSI Volume {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaUytKPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:21:32 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:21:32 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:21:32 user nova-compute[74692]: INFO os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8800ba6-1d66-4003-bb2b-484189c470e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 19:21:32 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1610ad95-0719-42a1-8e48-e02ae0203f08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6] added\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6] added
Nov 18 19:21:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f10a7e2-f582-4517-bd9e-4648982591dd]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad00a91-6837-4dba-b74b-70ef52163ef1]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JaUytKPH {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JaUytKPH" returned: 0 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea03b44-41d5-4541-8c9a-10105bc873e1]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JaUytKPH'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec952d2-2bfa-4ac8-9abd-462bb9fb297f]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6e9451-7743-48d2-a2b2-3ce138450c11]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:21:32 user nova-compute[74692]:  {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 19:21:32 user nova-compute[74692]:  {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:21:32 user nova-compute[74692]: WARNING os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 19:21:32 user nova-compute[74692]: 
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --login {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[49482ccd-e936-4044-8bf0-5786dd70f64a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6, portal: 172.16.0.220,3260]
Nov 18 19:21:32 user nova-compute[74692]: Login to [iface: default, target: iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6, portal: 172.16.0.220,3260] successful.
Nov 18 19:21:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d7ecb7-8c19-4ee2-b1f6-677deaeb8e21]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c3f65f-beae-489e-9961-9e6bee7b1ba6]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 (non-flash)
Nov 18 19:21:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 (non-flash)
Nov 18 19:21:32 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Connected to 172.16.0.220:3260 {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74692) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74692) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c723c2e4-ff77-48c7-9f6d-3e229245acd9]: (4, ('- - 0', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74692) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 19:21:32 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaUytKPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74692) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 19:21:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:21:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:21:33 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23062386562643361', 'path': '/dev/sdb'} {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:21:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062386562643361', 'path': '/dev/sdb'} {{(pid=74692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 19:21:33 user nova-compute[74692]: DEBUG nova.objects.instance [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lazy-loading 'flavor' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:21:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 19:21:33 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:21:33 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:21:33 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:21:33 user nova-compute[74692]:   <serial>45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6</serial>
Nov 18 19:21:33 user nova-compute[74692]: </disk>
Nov 18 19:21:33 user nova-compute[74692]:  {{(pid=74692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 19:21:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] No BDM found with device name vda, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:21:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 19:21:33 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] No VIF found with MAC fa:16:3e:97:31:e6, not building metadata {{(pid=74692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 19:21:33 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-754526c5-0701-4cfb-9717-44511a12704f tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.050s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:21:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:21:36 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:21:36 user nova-compute[74692]: INFO nova.compute.manager [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Detaching volume 45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6
Nov 18 19:21:36 user nova-compute[74692]: INFO nova.virt.block_device [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Attempting to driver detach volume 45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 from mountpoint /dev/vdb
Nov 18 19:21:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Attempting to detach device vdb from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the persistent domain config. {{(pid=74692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 19:21:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:21:36 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:21:36 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:21:36 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:21:36 user nova-compute[74692]:   <serial>45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6</serial>
Nov 18 19:21:36 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:21:36 user nova-compute[74692]: </disk>
Nov 18 19:21:36 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:21:36 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Successfully detached device vdb from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the persistent domain config.
Nov 18 19:21:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the live domain config. {{(pid=74692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 19:21:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.guest [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 19:21:36 user nova-compute[74692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 19:21:36 user nova-compute[74692]:   <source dev="/dev/sdb"/>
Nov 18 19:21:36 user nova-compute[74692]:   <target dev="vdb" bus="virtio"/>
Nov 18 19:21:36 user nova-compute[74692]:   <serial>45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6</serial>
Nov 18 19:21:36 user nova-compute[74692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 19:21:36 user nova-compute[74692]: </disk>
Nov 18 19:21:36 user nova-compute[74692]:  {{(pid=74692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 19:21:36 user nova-compute[74692]: DEBUG nova.virt.libvirt.driver [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 19:21:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:21:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:21:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:21:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:21:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:21:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:21:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:21:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:21:47 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:21:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:21:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:21:47 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:21:47 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:21:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:48 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:21:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:48 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74692) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:48 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:21:48 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:21:48 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=24.959930419921875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:21:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:21:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:21:48 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 19:21:48 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:21:48 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:21:48 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:21:48 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:21:48 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:21:48 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:21:53 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:21:54 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:21:54 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:21:56 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 is timed out.
Nov 18 19:21:56 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Successfully detached device vdb from instance b5582510-fe7f-4d4f-8c24-ec89438f8e77 from the live domain config.
Nov 18 19:21:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] calling os-brick to detach iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f41c447c6a0>, {'target_iqn': 'iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaUytKPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 19:21:56 user nova-compute[74692]: WARNING os_brick.initiator.connectors.base [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafad580-40d9-43a6-b255-b173eeec48b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 19:21:56 user nova-compute[74692]: No targets found.
Nov 18 19:21:56 user nova-compute[74692]: iSNS:
Nov 18 19:21:56 user nova-compute[74692]: No targets found.
Nov 18 19:21:56 user nova-compute[74692]: STATIC:
Nov 18 19:21:56 user nova-compute[74692]: Target: iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6
Nov 18 19:21:56 user nova-compute[74692]:         Portal: 172.16.0.220:3260,-1
Nov 18 19:21:56 user nova-compute[74692]:                 Iface Name: default
Nov 18 19:21:56 user nova-compute[74692]: FIRMWARE:
Nov 18 19:21:56 user nova-compute[74692]: No targets found.
Nov 18 19:21:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 19:21:56 user nova-compute[74692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 19:21:56 user nova-compute[74692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74692) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6', 0)] {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e675cea1-604f-4217-a833-1b3fff3cfe32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd66328a-3480-40f0-92d3-05bef1b1b647]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 (non-flash)\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 (non-flash)
Nov 18 19:21:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 (non-flash)
Nov 18 19:21:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41c46739a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6'): ({'sdb'}, set())}) {{(pid=74692) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Removing single pathed devices sdb {{(pid=74692) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d6abff-791c-4f8f-8df6-07778f1c1ff8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[75615483-7430-4f0a-a264-f7e9b2fd8787]: (4, ('ok\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Flushing IO for device /dev/sdb {{(pid=74692) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d8c2ec-4461-479a-b98d-06f8cc07026c]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74692) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[038bae7f-861f-49cf-b563-353e4bb2fea2]: (4, ('1', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.linuxscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] SCSI volumes sdb have been removed. {{(pid=74692) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6')] {{(pid=74692) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4bf351-04af-465a-b731-b1ae4550dc63]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --logout {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c6bb27-ca8f-43b0-ad41-9853d6b6c43f]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6, portal: 172.16.0.220,3260]
Nov 18 19:21:56 user nova-compute[74692]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6, portal: 172.16.0.220,3260] successful.
Nov 18 19:21:56 user nova-compute[74692]:  stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --op delete {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c6fe06-a5d2-4414-97d1-0ef5ed6d29e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c378c5f7-95a5-4f15-8c50-34c512f1ab91]: (4, ('', '')) {{(pid=84932) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74692) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.base [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] <== disconnect_volume: return (301ms) None {{(pid=74692) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 19:21:56 user nova-compute[74692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Disconnected iSCSI Volume {{(pid=74692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 19:21:57 user nova-compute[74692]: DEBUG nova.objects.instance [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lazy-loading 'flavor' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:21:57 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-3a732a4f-a499-43f9-98fd-e063a0809fd9 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.645s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:21:58 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:21:58 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:22:00 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:22:00 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:22:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:22:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:22:01 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 19:22:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 19:22:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquired lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 19:22:02 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Forcefully refreshing network info cache for instance {{(pid=74692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 19:22:02 user nova-compute[74692]: DEBUG nova.objects.instance [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lazy-loading 'info_cache' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:22:02 user nova-compute[74692]: DEBUG nova.network.neutron [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updating instance_info_cache with network_info: [{"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:22:02 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Releasing lock "refresh_cache-b5582510-fe7f-4d4f-8c24-ec89438f8e77" {{(pid=74692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 19:22:02 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updated the network info_cache for instance {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 19:22:02 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:22:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:22:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74692) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 19:22:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:22:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74692) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 19:22:03 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:22:04 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:22:08 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:13 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:22:18 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:23 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:28 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:33 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:43 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:22:44 user nova-compute[74692]: INFO nova.compute.manager [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Terminating instance
Nov 18 19:22:44 user nova-compute[74692]: DEBUG nova.compute.manager [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Start destroying the instance on the hypervisor. {{(pid=74692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-f1d83ed1-5c22-4971-bee2-751d90879526 req-46053792-430e-45d2-8454-6e8d2125a685 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received event network-vif-unplugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f1d83ed1-5c22-4971-bee2-751d90879526 req-46053792-430e-45d2-8454-6e8d2125a685 service nova] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f1d83ed1-5c22-4971-bee2-751d90879526 req-46053792-430e-45d2-8454-6e8d2125a685 service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-f1d83ed1-5c22-4971-bee2-751d90879526 req-46053792-430e-45d2-8454-6e8d2125a685 service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-f1d83ed1-5c22-4971-bee2-751d90879526 req-46053792-430e-45d2-8454-6e8d2125a685 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] No waiting events found dispatching network-vif-unplugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG nova.compute.manager [req-f1d83ed1-5c22-4971-bee2-751d90879526 req-46053792-430e-45d2-8454-6e8d2125a685 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received event network-vif-unplugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 for instance with task_state deleting. {{(pid=74692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 19:22:44 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:45 user nova-compute[74692]: INFO nova.virt.libvirt.driver [-] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Instance destroyed successfully.
Nov 18 19:22:45 user nova-compute[74692]: DEBUG nova.objects.instance [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lazy-loading 'resources' on Instance uuid b5582510-fe7f-4d4f-8c24-ec89438f8e77 {{(pid=74692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG nova.virt.libvirt.vif [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T19:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-813974990',display_name='tempest-SnapshotDataIntegrityTests-server-813974990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-813974990',id=53,image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkndiswWdxhV/SynkyAw/x8UF0cLt2FiGywQwAzD8zFiSw/hsPP/8rYA7XzDBqvEvMD+/n1vmipBEx79h8b9fJWOBB+pklP8EjbbN82rSBxVTgvma17vNdMPgnRO+a1vw==',key_name='tempest-keypair-187648696',keypairs=<?>,launch_index=0,launched_at=2023-11-18T19:16:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4701ace4033e4412bdd28fe34e82835a',ramdisk_id='',reservation_id='r-8fpcujwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='503b14b1-1e1e-41a7-a748-0e4d907ae048',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1806138183',owner_user_name='tempest-SnapshotDataIntegrityTests-1806138183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T19:16:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a560f1448bd14686ae3862f8387508bd',uuid=b5582510-fe7f-4d4f-8c24-ec89438f8e77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Converting VIF {"id": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "address": "fa:16:3e:97:31:e6", "network": {"id": "9e422f4b-0d40-4d77-8af6-c26586f383e3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2032904180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4701ace4033e4412bdd28fe34e82835a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap234d58d1-e9", "ovs_interfaceid": "234d58d1-e9a4-49c1-ba9f-41b529c97785", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG nova.network.os_vif_util [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:31:e6,bridge_name='br-int',has_traffic_filtering=True,id=234d58d1-e9a4-49c1-ba9f-41b529c97785,network=Network(9e422f4b-0d40-4d77-8af6-c26586f383e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap234d58d1-e9') {{(pid=74692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG os_vif [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:31:e6,bridge_name='br-int',has_traffic_filtering=True,id=234d58d1-e9a4-49c1-ba9f-41b529c97785,network=Network(9e422f4b-0d40-4d77-8af6-c26586f383e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap234d58d1-e9') {{(pid=74692) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap234d58d1-e9, bridge=br-int, if_exists=True) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8922b2dd-a036-4fb4-bfad-8174384c44ea) {{(pid=74692) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:45 user nova-compute[74692]: INFO os_vif [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:31:e6,bridge_name='br-int',has_traffic_filtering=True,id=234d58d1-e9a4-49c1-ba9f-41b529c97785,network=Network(9e422f4b-0d40-4d77-8af6-c26586f383e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap234d58d1-e9')
Nov 18 19:22:45 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Deleting instance files /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77_del
Nov 18 19:22:45 user nova-compute[74692]: INFO nova.virt.libvirt.driver [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Deletion of /opt/stack/data/nova/instances/b5582510-fe7f-4d4f-8c24-ec89438f8e77_del complete
Nov 18 19:22:45 user nova-compute[74692]: INFO nova.compute.manager [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 18 19:22:45 user nova-compute[74692]: DEBUG oslo.service.loopingcall [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74692) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG nova.compute.manager [-] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Deallocating network for instance {{(pid=74692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] deallocate_for_instance() {{(pid=74692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG nova.network.neutron [-] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Updating instance_info_cache with network_info: [] {{(pid=74692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 19:22:46 user nova-compute[74692]: INFO nova.compute.manager [-] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Took 0.93 seconds to deallocate network for instance.
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-f1d4532e-761d-4fa7-b29f-ad25dc7a71b7 req-495c988f-8c7e-4259-8693-06aaa422a2d7 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received event network-vif-deleted-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:22:46 user nova-compute[74692]: INFO nova.scheduler.client.report [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Deleted allocations for instance b5582510-fe7f-4d4f-8c24-ec89438f8e77
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-5d778f79-1bd0-4899-84e4-ad3545f6a2c4 tempest-SnapshotDataIntegrityTests-1806138183 tempest-SnapshotDataIntegrityTests-1806138183-project-member] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.331s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received event network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] No waiting events found dispatching network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:22:46 user nova-compute[74692]: WARNING nova.compute.manager [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received unexpected event network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 for instance with vm_state deleted and task_state None.
Nov 18 19:22:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received event network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] No waiting events found dispatching network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:22:46 user nova-compute[74692]: WARNING nova.compute.manager [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received unexpected event network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 for instance with vm_state deleted and task_state None.
Nov 18 19:22:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received event network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] No waiting events found dispatching network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:22:46 user nova-compute[74692]: WARNING nova.compute.manager [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received unexpected event network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 for instance with vm_state deleted and task_state None.
Nov 18 19:22:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received event network-vif-unplugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] No waiting events found dispatching network-vif-unplugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:22:46 user nova-compute[74692]: WARNING nova.compute.manager [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received unexpected event network-vif-unplugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 for instance with vm_state deleted and task_state None.
Nov 18 19:22:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received event network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] Acquiring lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] Lock "b5582510-fe7f-4d4f-8c24-ec89438f8e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:22:46 user nova-compute[74692]: DEBUG nova.compute.manager [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] No waiting events found dispatching network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 {{(pid=74692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 19:22:46 user nova-compute[74692]: WARNING nova.compute.manager [req-8ae99289-6609-4c3e-8a1a-367f726ddc5f req-d7172266-c3f6-481a-865c-a112286bd033 service nova] [instance: b5582510-fe7f-4d4f-8c24-ec89438f8e77] Received unexpected event network-vif-plugged-234d58d1-e9a4-49c1-ba9f-41b529c97785 for instance with vm_state deleted and task_state None.
Nov 18 19:22:49 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:22:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:22:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:22:49 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:22:49 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:22:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:22:50 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:22:50 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:22:50 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=9066MB free_disk=24.98687744140625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:22:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:22:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:22:50 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:22:50 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:22:50 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:22:50 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:22:50 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:22:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:22:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:22:56 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:22:56 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:22:58 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:22:59 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:23:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:23:00 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:23:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:23:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:23:03 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:23:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Starting heal instance info cache {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 19:23:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Rebuilding the list of instances to heal {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 19:23:03 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Didn't find any instances for network info cache update. {{(pid=74692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 19:23:05 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:23:05 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:23:06 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:23:10 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:23:15 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:23:20 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:23:25 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:23:30 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 19:23:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:23:35 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:23:38 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:23:40 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:23:41 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:23:45 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:23:50 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:23:50 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:23:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:23:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:23:50 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:23:50 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Auditing locally available compute resources for user (node: user) {{(pid=74692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 19:23:51 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:23:51 user nova-compute[74692]: WARNING nova.virt.libvirt.driver [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 19:23:51 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Hypervisor/Node resource view: name=user free_ram=9247MB free_disk=24.985759735107422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 19:23:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 19:23:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 19:23:51 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 19:23:51 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 19:23:51 user nova-compute[74692]: DEBUG nova.compute.provider_tree [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed in ProviderTree for provider: 582be55c-ee9f-496e-b354-5900b8401d2c {{(pid=74692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 19:23:51 user nova-compute[74692]: DEBUG nova.scheduler.client.report [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Inventory has not changed for provider 582be55c-ee9f-496e-b354-5900b8401d2c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 19:23:51 user nova-compute[74692]: DEBUG nova.compute.resource_tracker [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Compute_service record updated for user:user {{(pid=74692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 19:23:51 user nova-compute[74692]: DEBUG oslo_concurrency.lockutils [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=74692) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 19:23:55 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:23:57 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:23:57 user nova-compute[74692]: DEBUG nova.compute.manager [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 19:24:00 user nova-compute[74692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74692) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 19:24:00 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:24:01 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:24:02 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:24:02 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 19:24:02 user nova-compute[74692]: DEBUG oslo_service.periodic_task [None req-acd01d76-f929-4c07-abd2-fd232f61a33a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74692) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}